PCaPAC2014 - List of Authors (Mexner, W.)

Paper

Title

Page

Data Management at the Synchrotron Radiation Facility ANKA

13

D. Ressmann, A. Kopmann, V. Mauch, W. Mexner, A. Vondrous
KIT, Eggenstein-Leopoldshafen, Germany

The complete chain from submitting a proposal, collecting meta data, performing an experiment, towards analysis of these data and finally long term archive will be described. During this process a few obstacles have to be tackled. The workflow should be transparent to the user as well as to the beamline scientists. The final data will be stored in NeXus compatible HDF5 container format. Because the transfer of one large file is more efficient than transferring many small files, container formats enable a faster transfer of experiment data. At the same time HDF5 supports to store meta data together with the experiment data. For large data sets another implication is the performance to download the files. Furthermore the analysis software might not be available at each home institution; as a result it should be an option to access the experiment data on site. The meta data allows to find, analyse, preserve and curate the data in a long term archive, which will become a requirement fairly soon.

Slides WCO202 [2.380 MB]

WPO028

EPICS BEAST Alarm System Happily Purrs at ANKA Synchrotron Light Source

99

I. Križnar
Cosylab, Ljubljana, Slovenia
E. Hertle, E. Huttel, W. Mexner, A.-S. Müller, N.J. Smale
KIT, Eggenstein-Leopoldshafen, Germany
S. Marsching
Aquenos GmbH, Baden-Baden, Germany

Funding: ANKA Synchrotron Light Source, KIT, Karlsruhe
The control system of the ANKA synchrotron radiation source at KIT (Karlsruhe Institute of Technology) is adopting new, and converting old, devices into an EPICS control system. New GUI panels are developed in Control System Studio (CSS). EPICS alarming capabilities in connection with the BEAST alarm server tool-kit from the CSS bundle are used as an alarming solution. To accommodate ANKA future requirements as well as ANKA legacy solutions, we have decided to extend the basic functionality of BEAST with additional features in order to manage the alarming for different machine operation states. Since the database of alarm sources is been populated from scratch, we have been able take fresh approach in management and creation of alarm sources to build-up alarm trees. New alarm system is being used, tested and refined and future developed in production environment since end of 2013.

Poster WPO028 [1.344 MB]

FPO026

ADEI and Tango Archiving System – A Convenient Way to Archive and Represent Data

213

D. Haas, S.A. Chilingaryan, A. Kopmann, W. Mexner, D. Ressmann
KIT, Eggenstein-Leopoldshafen, Germany

Tango offers an efficient and powerful archiving mechanism of Tango attributes in a MySQL database. The tool Mambo allows an easy configuration of all to be archived data. This approved archiving concept was successfully introduced to ANKA (Angströmquelle Karlsruhe). To provide an efficient and intuitive web-based interface instead of complex database queries, the TANGO Archiving System was integrated into the “Advanced Data Extraction Infrastructure ADEI”. ADEI is intended to manage data of distributed heterogeneous devices in large-scale physics experiments. ADEI contains internal pre-processing, data quality checks and an intuitive web interface, that guarantees fast access and visualization of huge a data sets stored in the attached data sources like MySQL databases or data files. ADEI and the Tango archiving system have been successfully tested at ANKA's imaging beamlines. It is intended to deploy both at all ANKA beamlines.

Poster FPO026 [0.938 MB]

FPO034

Beamline Data Management at the Synchrotron ANKA

231

A. Vondrous, T. Jejkal, W. Mexner, D. Ressmann, R. Stotzka
KIT, Eggenstein-Leopoldshafen, Germany

We present an architecture consisting of measurement devices, beamline data management and data repository to enable data management at the synchrotron facility ANKA. The operators perform some data management tasks manually and individually for each measurement method. In order to provide the functionality of a data repository it is necessary to collect the data, aggregate metadata and to perform the ingests into the data repository. The data management layer between the measurement devices and the data repository is referred to beamline data management (BLDM), which performs data collection, metadata aggregation and data ingest. Shared libraries contain functionality like migration, ingest or metadata aggregation and form the basis of the BLDM. The workflows and the current state of execution are persisted to enable monitoring and error handling. After data ingest into the data repository, implemented with the KIT Data Manager, archiving, content preservation or bit preservation services are provided for the ingested data. BLDM can connect the existing infrastructure with the data repository without major changes of routine processes to build a data repository for a synchrotron.

FCO202

OpenGL-Based Data Analysis in Virtualized Self-Service Environments

237

V. Mauch, M. Bonn, S.A. Chilingaryan, A. Kopmann, W. Mexner, D. Ressmann
KIT, Eggenstein-Leopoldshafen, Germany

Funding: Federal Ministry of Education and Research, Germany
Modern data analysis applications for 2D/3D data samples apply complex visual output features which are often based on OpenGL, a multi-platform API for rendering vector graphics. They demand special computing workstations with a corresponding CPU/GPU power, enough main memory and fast network interconnects for a performant remote data access. For this reason, users depend heavily on available free workstations, both temporally and locally. The provision of virtual machines (VMs) accessible via a remote connection could avoid this inflexibility. However, the automatic deployment, operation and remote access of OpenGL-capable VMs with professional visualization applications is a non-trivial task. In this paper, we discuss a concept for a flexible analysis infrastructure that will be part in the project ASTOR, which is the abbreviation for “Arthropod Structure revealed by ultra-fast Tomography and Online Reconstruction”. We present an Analysis-as-a-Service (AaaS) approach based on the on-demand allocation of VMs with dedicated GPU cores and a corresponding analysis environment to provide a cloud-like analysis service for scientific users.

Slides FCO202 [1.126 MB]

FCO203

Making it all Work for Operators

240

I. Križnar
Cosylab, Ljubljana, Slovenia
E. Hertle, E. Huttel, W. Mexner, A.-S. Müller, N.J. Smale
KIT, Eggenstein-Leopoldshafen, Germany
S. Marsching
Aquenos GmbH, Baden-Baden, Germany

Funding: ANKA Synchrotron Light Source, KIT, Karlsruhe
As the control system of the ANKA synchrotron radiation source at KIT (Karlsruhe Institute of Technology) is being slowly upgraded it can become, at key stages, temporarily a mosaic of old and new panels while the operator learns to move across to the new system. With the development of general purpose tools, and careful planning of both the final and transition GUIs, we have been able to actually simplify the working environment for machine operators. In this paper we will explain concepts, guides and tools in which GUIs for operators are developed and deployed at ANKA.

Slides FCO203 [0.663 MB]

Paper	Title	Page
WCO202	Data Management at the Synchrotron Radiation Facility ANKA	13
	D. Ressmann, A. Kopmann, V. Mauch, W. Mexner, A. Vondrous KIT, Eggenstein-Leopoldshafen, Germany
	The complete chain from submitting a proposal, collecting meta data, performing an experiment, towards analysis of these data and finally long term archive will be described. During this process a few obstacles have to be tackled. The workflow should be transparent to the user as well as to the beamline scientists. The final data will be stored in NeXus compatible HDF5 container format. Because the transfer of one large file is more efficient than transferring many small files, container formats enable a faster transfer of experiment data. At the same time HDF5 supports to store meta data together with the experiment data. For large data sets another implication is the performance to download the files. Furthermore the analysis software might not be available at each home institution; as a result it should be an option to access the experiment data on site. The meta data allows to find, analyse, preserve and curate the data in a long term archive, which will become a requirement fairly soon.
	Slides WCO202 [2.380 MB]

WPO028	EPICS BEAST Alarm System Happily Purrs at ANKA Synchrotron Light Source	99
	I. Križnar Cosylab, Ljubljana, Slovenia E. Hertle, E. Huttel, W. Mexner, A.-S. Müller, N.J. Smale KIT, Eggenstein-Leopoldshafen, Germany S. Marsching Aquenos GmbH, Baden-Baden, Germany
	Funding: ANKA Synchrotron Light Source, KIT, Karlsruhe The control system of the ANKA synchrotron radiation source at KIT (Karlsruhe Institute of Technology) is adopting new, and converting old, devices into an EPICS control system. New GUI panels are developed in Control System Studio (CSS). EPICS alarming capabilities in connection with the BEAST alarm server tool-kit from the CSS bundle are used as an alarming solution. To accommodate ANKA future requirements as well as ANKA legacy solutions, we have decided to extend the basic functionality of BEAST with additional features in order to manage the alarming for different machine operation states. Since the database of alarm sources is been populated from scratch, we have been able take fresh approach in management and creation of alarm sources to build-up alarm trees. New alarm system is being used, tested and refined and future developed in production environment since end of 2013.
	Poster WPO028 [1.344 MB]

FPO026	ADEI and Tango Archiving System – A Convenient Way to Archive and Represent Data	213
	D. Haas, S.A. Chilingaryan, A. Kopmann, W. Mexner, D. Ressmann KIT, Eggenstein-Leopoldshafen, Germany
	Tango offers an efficient and powerful archiving mechanism of Tango attributes in a MySQL database. The tool Mambo allows an easy configuration of all to be archived data. This approved archiving concept was successfully introduced to ANKA (Angströmquelle Karlsruhe). To provide an efficient and intuitive web-based interface instead of complex database queries, the TANGO Archiving System was integrated into the “Advanced Data Extraction Infrastructure ADEI”. ADEI is intended to manage data of distributed heterogeneous devices in large-scale physics experiments. ADEI contains internal pre-processing, data quality checks and an intuitive web interface, that guarantees fast access and visualization of huge a data sets stored in the attached data sources like MySQL databases or data files. ADEI and the Tango archiving system have been successfully tested at ANKA's imaging beamlines. It is intended to deploy both at all ANKA beamlines.
	Poster FPO026 [0.938 MB]

FPO034	Beamline Data Management at the Synchrotron ANKA	231
	A. Vondrous, T. Jejkal, W. Mexner, D. Ressmann, R. Stotzka KIT, Eggenstein-Leopoldshafen, Germany
	We present an architecture consisting of measurement devices, beamline data management and data repository to enable data management at the synchrotron facility ANKA. The operators perform some data management tasks manually and individually for each measurement method. In order to provide the functionality of a data repository it is necessary to collect the data, aggregate metadata and to perform the ingests into the data repository. The data management layer between the measurement devices and the data repository is referred to beamline data management (BLDM), which performs data collection, metadata aggregation and data ingest. Shared libraries contain functionality like migration, ingest or metadata aggregation and form the basis of the BLDM. The workflows and the current state of execution are persisted to enable monitoring and error handling. After data ingest into the data repository, implemented with the KIT Data Manager, archiving, content preservation or bit preservation services are provided for the ingested data. BLDM can connect the existing infrastructure with the data repository without major changes of routine processes to build a data repository for a synchrotron.

FCO202	OpenGL-Based Data Analysis in Virtualized Self-Service Environments	237
	V. Mauch, M. Bonn, S.A. Chilingaryan, A. Kopmann, W. Mexner, D. Ressmann KIT, Eggenstein-Leopoldshafen, Germany
	Funding: Federal Ministry of Education and Research, Germany Modern data analysis applications for 2D/3D data samples apply complex visual output features which are often based on OpenGL, a multi-platform API for rendering vector graphics. They demand special computing workstations with a corresponding CPU/GPU power, enough main memory and fast network interconnects for a performant remote data access. For this reason, users depend heavily on available free workstations, both temporally and locally. The provision of virtual machines (VMs) accessible via a remote connection could avoid this inflexibility. However, the automatic deployment, operation and remote access of OpenGL-capable VMs with professional visualization applications is a non-trivial task. In this paper, we discuss a concept for a flexible analysis infrastructure that will be part in the project ASTOR, which is the abbreviation for “Arthropod Structure revealed by ultra-fast Tomography and Online Reconstruction”. We present an Analysis-as-a-Service (AaaS) approach based on the on-demand allocation of VMs with dedicated GPU cores and a corresponding analysis environment to provide a cloud-like analysis service for scientific users.
	Slides FCO202 [1.126 MB]

FCO203	Making it all Work for Operators	240
	I. Križnar Cosylab, Ljubljana, Slovenia E. Hertle, E. Huttel, W. Mexner, A.-S. Müller, N.J. Smale KIT, Eggenstein-Leopoldshafen, Germany S. Marsching Aquenos GmbH, Baden-Baden, Germany
	Funding: ANKA Synchrotron Light Source, KIT, Karlsruhe As the control system of the ANKA synchrotron radiation source at KIT (Karlsruhe Institute of Technology) is being slowly upgraded it can become, at key stages, temporarily a mosaic of old and new panels while the operator learns to move across to the new system. With the development of general purpose tools, and careful planning of both the final and transition GUIs, we have been able to actually simplify the working environment for machine operators. In this paper we will explain concepts, guides and tools in which GUIs for operators are developed and deployed at ANKA.
	Slides FCO203 [0.663 MB]