ICALEPCS2017 - List of Authors (Akeroyd, F.A.)

Paper	Title	Page
TUPHA029	Live Visualisation of Experiment Data at ISIS and the ESS	431
	M.J. Clarke, F.A. Akeroyd, O. Arnold, M.A. Gigg, L.A. Moore STFC/RAL/ISIS, Chilton, Didcot, Oxon, United Kingdom N.J. Draper, M.D. Jones Tessella, Abingdon, United Kingdom T.S. Richter ESS, Copenhagen, Denmark
	As part of the UK's in-kind contribution to the European Spallation Source, ISIS is working alongside the ESS and other partners to develop a new data streaming system for managing and distributing neutron experiment data. The new data streaming system is based on the open-source distributed streaming platform Apache Kafka. A central requirement of the system is to be able to supply live experiment data for processing and visualisation in near real-time via the Mantid data analysis framework. There already exists a basic TCP socket-based data streaming system at ISIS, but it has limitations in terms of scalability, reliability and functionality. The intention is for the new Kafka-based system to replace the existing system at ISIS. This migration will not only provide enhanced functionality for ISIS but also an opportunity for developing and testing the system prior to use at the ESS.
	Poster TUPHA029 [0.644 MB]
DOI •	reference for this paper ※ https://doi.org/10.18429/JACoW-ICALEPCS2017-TUPHA029
Export •	reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

TUPHA177	Status of the Development of the Experiment Data Acquisition Pipeline for the European Spallation Source	835
	A.H.C. Mukai, M.J. Christensen, J.M.C. Nilsson, T.S. Richter, M. Shetty ESS, Copenhagen, Denmark F.A. Akeroyd, M.J. Clarke STFC/RAL/ISIS, Chilton, Didcot, Oxon, United Kingdom M. Brambilla, M. Könnecke, D. Werder PSI, Villigen PSI, Switzerland M.D. Jones Tessella, Abingdon, United Kingdom
	Funding: This project is partially funded by the European Union Framework Programme for Research and Innovation Horizon 2020, under grant agreement 676548. The European Spallation Source will produce more data than existing neutron facilities, due to higher accelerator power and to the fact that all data will be collected in event mode with no hardware veto. Detector data will be acquired and aggregated with metadata coming from sources such as sample environment, choppers and motion control. To aggregate data we will use Apache Kafka with FlatBuffers serialisation. A common schema repository defines the formats to be used by the data producers and consumers. The main consumers we are prototyping are a file writer for NeXus files and live reduction and visualisation via Mantid. A Jenkins-based setup using virtual machines is being used for integration tests, and physical servers are available in an integration laboratory alongside real hardware. We present the current status of the data acquisition pipeline and results from the testing and integration work going on at the ESS Data Management and Software Centre in collaboration with in-kind and BrightnESS partners.
	Poster TUPHA177 [0.434 MB]
DOI •	reference for this paper ※ https://doi.org/10.18429/JACoW-ICALEPCS2017-TUPHA177
Export •	reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

TUPHA206	Upgrade of the ISIS Muon Front End Magnets: Old and New Instrument Control Systems Working in Harmony	939
	K.V.L. Baker, F.A. Akeroyd, M.J. Clarke, D.P. Keymer, T. Löhnert, C. Moreton-Smith, D.E. Oram STFC/RAL/ISIS, Chilton, Didcot, Oxon, United Kingdom J.R. Holt, A.T. Potter, I.H. Rey, T. A. Willemsen, K. Woods Tessella, Abingdon, United Kingdom J.S. Lord STFC/RAL, Chilton, Didcot, Oxon, United Kingdom
	When the European Muon beamlines at the ISIS pulsed neutron and muon source [1] upgraded their front end magnets, it was desired that these new magnets should be controllable remotely. This work was undertaken by the team responsible for instrument control, who are in the process of a phased upgrade of instrument control software from a locally developed system (SECI) to an EPICS [2] based one (IBEX [3,4]). To increase the complexity of the task, parts of the front end needed to be controlled only by an individual instrument beamline, whilst some values needed to be tuned to the best compromise available for all three beamlines. Furthermore, the muon instruments were not ready for an upgrade to a full IBEX system at that time. By combining SECI, IBEX and the Mantid [5] data reduction package the required control and tuning has been achieved. This paper will give details of the challenges, the topology of the solution, how the current mixed system is performing, and what will be changed when the muon instruments are converted to IBEX.
	Poster TUPHA206 [1.005 MB]
DOI •	reference for this paper ※ https://doi.org/10.18429/JACoW-ICALEPCS2017-TUPHA206
Export •	reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

THPHA167	EPICS Data Streaming and HDF File Writing for ESS Benchmarked Using the Virtual AMOR Instrument	1815
	D. Werder, M. Brambilla, M. Koennecke PSI, Villigen PSI, Switzerland F.A. Akeroyd, M.J. Clarke STFC/RAL/ISIS, Chilton, Didcot, Oxon, United Kingdom M.D. Jones Tessella, Abingdon, United Kingdom A.H.C. Mukai, J.M.C. Nilsson, T.S. Richter ESS, Copenhagen, Denmark
	Funding: This work is funded by the European Union Framework Programme for Research and Innovation Horizon 2020, under grant agreement 676548. As a contribution to the European Spallation Source as part of BrightnESS, the Paul Scherrer Institut is involved in the streaming of EPICS data and the writing of NeXus compliant HDF5 files. We combine this development with the transition of the AMOR instrument at the Paul Scherrer Institut to EPICS and a streaming based data architecture. To guide our development before ESS has operational equipment, we use a detailed simulation of the instrument AMOR at SINQ to test and integrate our data streaming components. We convert EPICS data sources to Google FlatBuffers as our message format and distribute them using Apache Kafka. On the file writing side, we combine the messages from EPICS data sources as well as from neutron events to write HDF5 files at rates up to 4.8 GiB/s using Parallel HDF. This platform will also be used for testing the experiment control software on top of EPICS.
	Poster THPHA167 [0.476 MB]
DOI •	reference for this paper ※ https://doi.org/10.18429/JACoW-ICALEPCS2017-THPHA167
Export •	reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

Paper

Title

Page

Live Visualisation of Experiment Data at ISIS and the ESS

431

M.J. Clarke, F.A. Akeroyd, O. Arnold, M.A. Gigg, L.A. Moore
STFC/RAL/ISIS, Chilton, Didcot, Oxon, United Kingdom
N.J. Draper, M.D. Jones
Tessella, Abingdon, United Kingdom
T.S. Richter
ESS, Copenhagen, Denmark

As part of the UK's in-kind contribution to the European Spallation Source, ISIS is working alongside the ESS and other partners to develop a new data streaming system for managing and distributing neutron experiment data. The new data streaming system is based on the open-source distributed streaming platform Apache Kafka. A central requirement of the system is to be able to supply live experiment data for processing and visualisation in near real-time via the Mantid data analysis framework. There already exists a basic TCP socket-based data streaming system at ISIS, but it has limitations in terms of scalability, reliability and functionality. The intention is for the new Kafka-based system to replace the existing system at ISIS. This migration will not only provide enhanced functionality for ISIS but also an opportunity for developing and testing the system prior to use at the ESS.

Poster TUPHA029 [0.644 MB]

DOI •

reference for this paper ※ https://doi.org/10.18429/JACoW-ICALEPCS2017-TUPHA029

Export •

reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

TUPHA177

Status of the Development of the Experiment Data Acquisition Pipeline for the European Spallation Source

835

A.H.C. Mukai, M.J. Christensen, J.M.C. Nilsson, T.S. Richter, M. Shetty
ESS, Copenhagen, Denmark
F.A. Akeroyd, M.J. Clarke
STFC/RAL/ISIS, Chilton, Didcot, Oxon, United Kingdom
M. Brambilla, M. Könnecke, D. Werder
PSI, Villigen PSI, Switzerland
M.D. Jones
Tessella, Abingdon, United Kingdom

Funding: This project is partially funded by the European Union Framework Programme for Research and Innovation Horizon 2020, under grant agreement 676548.
The European Spallation Source will produce more data than existing neutron facilities, due to higher accelerator power and to the fact that all data will be collected in event mode with no hardware veto. Detector data will be acquired and aggregated with metadata coming from sources such as sample environment, choppers and motion control. To aggregate data we will use Apache Kafka with FlatBuffers serialisation. A common schema repository defines the formats to be used by the data producers and consumers. The main consumers we are prototyping are a file writer for NeXus files and live reduction and visualisation via Mantid. A Jenkins-based setup using virtual machines is being used for integration tests, and physical servers are available in an integration laboratory alongside real hardware. We present the current status of the data acquisition pipeline and results from the testing and integration work going on at the ESS Data Management and Software Centre in collaboration with in-kind and BrightnESS partners.

Poster TUPHA177 [0.434 MB]

DOI •

reference for this paper ※ https://doi.org/10.18429/JACoW-ICALEPCS2017-TUPHA177

Export •

reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

TUPHA206

Upgrade of the ISIS Muon Front End Magnets: Old and New Instrument Control Systems Working in Harmony

939

K.V.L. Baker, F.A. Akeroyd, M.J. Clarke, D.P. Keymer, T. Löhnert, C. Moreton-Smith, D.E. Oram
STFC/RAL/ISIS, Chilton, Didcot, Oxon, United Kingdom
J.R. Holt, A.T. Potter, I.H. Rey, T. A. Willemsen, K. Woods
Tessella, Abingdon, United Kingdom
J.S. Lord
STFC/RAL, Chilton, Didcot, Oxon, United Kingdom

When the European Muon beamlines at the ISIS pulsed neutron and muon source [1] upgraded their front end magnets, it was desired that these new magnets should be controllable remotely. This work was undertaken by the team responsible for instrument control, who are in the process of a phased upgrade of instrument control software from a locally developed system (SECI) to an EPICS [2] based one (IBEX [3,4]). To increase the complexity of the task, parts of the front end needed to be controlled only by an individual instrument beamline, whilst some values needed to be tuned to the best compromise available for all three beamlines. Furthermore, the muon instruments were not ready for an upgrade to a full IBEX system at that time. By combining SECI, IBEX and the Mantid [5] data reduction package the required control and tuning has been achieved. This paper will give details of the challenges, the topology of the solution, how the current mixed system is performing, and what will be changed when the muon instruments are converted to IBEX.

Poster TUPHA206 [1.005 MB]

DOI •

reference for this paper ※ https://doi.org/10.18429/JACoW-ICALEPCS2017-TUPHA206

Export •

reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

THPHA167

EPICS Data Streaming and HDF File Writing for ESS Benchmarked Using the Virtual AMOR Instrument

1815

D. Werder, M. Brambilla, M. Koennecke
PSI, Villigen PSI, Switzerland
F.A. Akeroyd, M.J. Clarke
STFC/RAL/ISIS, Chilton, Didcot, Oxon, United Kingdom
M.D. Jones
Tessella, Abingdon, United Kingdom
A.H.C. Mukai, J.M.C. Nilsson, T.S. Richter
ESS, Copenhagen, Denmark

Funding: This work is funded by the European Union Framework Programme for Research and Innovation Horizon 2020, under grant agreement 676548.
As a contribution to the European Spallation Source as part of BrightnESS, the Paul Scherrer Institut is involved in the streaming of EPICS data and the writing of NeXus compliant HDF5 files. We combine this development with the transition of the AMOR instrument at the Paul Scherrer Institut to EPICS and a streaming based data architecture. To guide our development before ESS has operational equipment, we use a detailed simulation of the instrument AMOR at SINQ to test and integrate our data streaming components. We convert EPICS data sources to Google FlatBuffers as our message format and distribute them using Apache Kafka. On the file writing side, we combine the messages from EPICS data sources as well as from neutron events to write HDF5 files at rates up to 4.8 GiB/s using Parallel HDF. This platform will also be used for testing the experiment control software on top of EPICS.

Poster THPHA167 [0.476 MB]

DOI •

reference for this paper ※ https://doi.org/10.18429/JACoW-ICALEPCS2017-THPHA167

Export •

reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)