WEBL —  Data Management   (20-Oct-21   13:15—14:30)
Chair: V. Hardion, MAX IV Laboratory, Lund University, Lund, Sweden
WEBL   Video of full session »Data Management« (total time: 01:17:45 h:m:s)  
video icon  
  please see instructions how to view/control embeded videos  
Paper Title Page
WEBL01 FAIRmat - a Consortium of the German Research-Data Infrastructure (NFDI) 558
  • H. Junkes, P. Oppermann, R. Schlögl, A. Trunschke
    FHI, Berlin, Germany
  • M. Krieger, H. Weber
    FAU, Erlangen, Germany
  A sustainable infrastructure for provision, interlinkage, maintenance, and options for reuse of research data shall be created in Germany in the coming years. The consortium FAIRmat meets the interests of experimental and theoretical condensed-matter physics. This also includes, for example, chemical physics of solids, synthesis, and high-performance computing. All this is demonstrated by use cases from various areas of functional materials. The necessity of a FAIR data infrastructure in the FAIRmat* research field is very pressing. We need and want to support the actual, daily research work to further science. Besides storing, retrieving, and sharing data, a FAIR data infrastructure will also enable a completely new level of research. In the Area D "Digital Infrastructure" a Configurable Experiment Control System is to be developed here as a reference. EPICS was selected as an initial open source base system. The control system of the newly founded CATlab** in Berlin will be fully implemented according to the FAIRmat specifications.
FAIRmat : https://www.fair-di.eu/fairmat/fairmat/consortium
CatLab : https://www.helmholtz-berlin.de/projects/catlab/indexen.html
slides icon Slides WEBL01 [5.478 MB]  
DOI • reference for this paper ※ https://doi.org/10.18429/JACoW-ICALEPCS2021-WEBL01  
About • Received ※ 10 October 2021       Revised ※ 22 October 2021       Accepted ※ 21 December 2021       Issue date ※ 08 March 2022
Cite • reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)  
WEBL02 Prototype of Image Acquisition and Storage System for SHINE 564
  • H.H. Lv, D.P. Bai, X.M. Liu, H. Zhao
    SSRF, Shanghai, People’s Republic of China
  Shanghai HIgh repetition rate XFEL aNd Extreme light facility (SHINE) is a quasi-continuous wave hard X-ray free electron laser facility, which is currently under construction. The image acquisition and storage system has been designed to handle a large quantity of image data generated by the beam and X-ray diagnostics system, the laser system, etc. A prototype system with Camera Link cameras has been developed to acquire and to reliably transport data at a throughput of 1000MB/sec. The image data are transferred through ZeroMQ protocol to the storage where the image data and the relevant metadata are archived and made available for user analysis. For high-speed frames of image data storage, optimized schema is identified by comparing and testing four schemas. The image data are written to HDF5 files and the metadata pertaining to the image are stored in NoSQL database. It could deliver up to 1.2GB/sec storage speed. The performances are also contrasted between a stand-alone server and the Lustre file system. And the Lustre could provide a better performance. Details of the image acquisition, transfer, and storage schemas will be described in the paper.  
slides icon Slides WEBL02 [3.703 MB]  
DOI • reference for this paper ※ https://doi.org/10.18429/JACoW-ICALEPCS2021-WEBL02  
About • Received ※ 10 October 2021       Accepted ※ 21 November 2021       Issue date ※ 12 February 2022  
Cite • reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)  
Managing high-performance data flows and file structures  
  • J.M.C. Nilsson, T.S. Richter
    ESS, Copenhagen, Denmark
  • J.R. Harper
    STFC/RAL/ISIS, Chilton, Didcot, Oxon, United Kingdom
  • M.D. Jones
    Tessella, Abingdon, United Kingdom
  The beam intensity at the European Spallation Source will necessitate a high performance acquisition and recording system for the data from the user experiments. In addition to high neutron counts rates the expected large number of dynamic measurements per day calls for a flexible system that supports a high variability in sample set-ups. Apache Kafka has been chosen as the central data switchboard to handle all the event driven data sources from detectors as well as from the EPICS controls system. The file writing system centres around a facility wide pool of HDF5 file-writers that uses Apache Kafka also for command and control. File-writing jobs are posted to a topic on Apache Kafka and picked up by individual workers. This centralises and optimises resources, as I/O load can be balanced between different neutron instruments. Command messages embed a NeXus compliant structure to capture the raw data in a community agreed format. To simplify correctly defining the file structure, physical device locations can the visualised. Data inspection can be applied to find available data sources and easily allocate them locations in the file.  
slides icon Slides WEBL03 [1.851 MB]  
Cite • reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)  
WEBL04 Manage the Physics Settings on the Modern Accelerator 569
  • T. Zhang, K. Fukushima, T. Maruta, P.N. Ostroumov, A.S. Plastun, Q. Zhao
    FRIB, East Lansing, Michigan, USA
  Funding: U.S. Department of Energy Office of Science under Cooperative Agreement DESC0000661
The Facility for Rare Isotope Beams (FRIB) at Michigan State University is a unique modern user facility composed of a large-scale superconducting linac capable of accelerating heavy-ion beams from oxygen to uranium. An advanced EPICS-based control system is being used to operate this complex facility. High-level physics applications (HLA) developed before and during the staged commissioning of the linac were one of the critical tools that resulted in achieving the commissioning goals quickly, within several shifts. Many of these HLAs are expandable to other EPCIS controlled accelerators. Recent developed HLAs deal with the management of extensive data to achieve the repetitive high performance of ion beams in the entire linac measured by non-destructive diagnostics instruments, and open the possibilities to explore the extra values out of the data. This paper presents our recent significant development and utilization of these HLAs.
* T. Zhang et al. ’High-level Physics Controls Applications Development for FRIB’, ICALEPCS’19, TUCPR07, NY, USA, 2019.
slides icon Slides WEBL04 [9.835 MB]  
DOI • reference for this paper ※ https://doi.org/10.18429/JACoW-ICALEPCS2021-WEBL04  
About • Received ※ 19 October 2021       Accepted ※ 21 November 2021       Issue date ※ 02 January 2022  
Cite • reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)  
WEBL05 FAIR Meets EMIL: Principles in Practice 574
  • G. Günther, M. Bär, N. Greve, R. Krahl, M. Kubin, O. Mannix, W. Smith, S. Vadilonga, R. Wilks
    HZB, Berlin, Germany
  Findability, accessibility, interoperability, and reusability (FAIR) form a set of principles required to ready information for computational exploitation. The Energy Materials In-Situ Laboratory Berlin (EMIL) at BESSY II, with its unique analytical instrumentation in direct combination with an industrially-relevant deposition tool, is in the final phase of commissioning. It provides an ideal testbed to ensure workflows are developed around the FAIR principles; enhancing usability for both human and machine agents. FAIR indicators are applied to assess compliance with the principles on an experimental workflow realized using Bluesky. Additional metadata collection by integrating an instrument PID, an electronic laboratory book, and a sample tracking system is considered along with staff training. Data are collected in Nexus format and made available in the ICAT repository. This paper reports on experiences, problems overcome, and areas still in need of improvement in future perspectives.  
slides icon Slides WEBL05 [0.953 MB]  
DOI • reference for this paper ※ https://doi.org/10.18429/JACoW-ICALEPCS2021-WEBL05  
About • Received ※ 08 October 2021       Accepted ※ 22 December 2021       Issue date ※ 24 February 2022  
Cite • reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)