ICALEPCS2019 - List of Authors (Conforti, V.)

Paper	Title	Page
MOPHA032	Big Data Architectures for Logging and Monitoring Large Scale Telescope Arrays	268
	A. Costa, U. Becciani, P. Bruno, A.S. Calanducci, A. Grillo, S. Riggi, E. Sciacca, F. Vitello INAF-OACT, Catania, Italy V. Conforti, F. Gianotti INAF, Bologna, Italy J. Schwarz INAF-Osservatorio Astronomico di Brera, Merate, Italy G. Tosti Università degli di Perugia, Perugia, Italy
	Funding: This work was partially supported by the ASTRI "Flagship Project" financed by the Italian Ministry of Education, University, and Research and led by the Italian National Institute of Astrophysics. Large volumes of technical and logging data result from the operation of large scale astrophysical infrastructures. In the last few years several "Big Data" technologies have been developed to deal with a huge amount of data, e.g. in the Internet of Things (IoT) framework. We are comparing different stacks of Big Data/IoT architectures including high performance distributed messaging systems, time series databases, streaming systems, interactive data visualization. The main aim is to classify these technologies based on a set of use cases typically related to the data produced in the astronomical environment, with the objective to have a system that can be updated, maintained and customized with a minimal programming effort. We present the preliminary results obtained, using different Big Data stack solution to manage some use cases related to quasi real-time collection, processing and storage of the technical data, logging and technical alert produced by the array of nine ASTRI telescopes that are under development by INAF as a pathfinder array for the Cherenkov astronomy in the TeV energy range. ASTRI Project: http://www.brera.inaf.it/~astri/wordpress/ *CTA Project: https://www.cta-observatory.org/
	Poster MOPHA032 [1.327 MB]
DOI •	reference for this paper ※ https://doi.org/10.18429/JACoW-ICALEPCS2019-MOPHA032
About •	paper received ※ 02 October 2019 paper accepted ※ 09 October 2019 issue date ※ 30 August 2020
Export •	reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

WEMPR005	The Array Control and Data Acquisition System of the Cherenkov Telescope Array	1046
WEPHA117	use link to see paper's listing under its alternate paper code
	I. Oya, E. Antolini, M. Fuessling CTA, Heidelberg, Germany L. Baroncelli, A. Bulgarelli, V. Conforti, N. Parmiggiani INAF, Bologna, Italy J. Borkowski CAMK, Torun, Poland A. Carosi, J.N. Jacquemier, G. Maurin IN2P3-LAPP, Annecy-le-Vieux, France J. Colome CSIC-IEEC, Bellaterra, Spain C. Hoischen Universität Potsdam, Potsdam-Golm, Germany E. Lyard, R. Walter University of Geneva, Geneva, Switzerland D. Melkumyan, K. Mosshammer, I. Sadeh, T. Schmidt, P.A. Wegner DESY Zeuthen, Zeuthen, Germany U. Schwanke Humboldt University Berlin, Institut für Physik, Berlin, Germany J. Schwarz INAF-Osservatorio Astronomico di Brera, Merate, Italy G. Tosti Università degli di Perugia, Perugia, Italy
	The Cherenkov Telescope Array (CTA) project is the initiative to build the next-generation gamma-ray observatory. With more than 100 telescopes planned to be deployed in two sites, CTA is one of the largest astronomical facilities under construction. The Array Control and Data Acquisition (ACADA) system will be the central element of on-site CTA Observatory operations. The mission of the ACADA system is to manage and optimize the telescope array operations at each of the CTA sites. To that end, ACADA will provide all necessary means for the efficient execution of observations, and for the handling of the several Gb/s generated by each individual CTA telescope. The ACADA system will contain a real-time analysis pipeline, dedicated to the automatic generation of science alert candidates based on the inspection of data being acquired. These science alerts, together with external alerts arriving from other scientific installations, will permit ACADA to modify ongoing observations at sub-minute timescales in order to study high-impact scientific transient phenomena. This contribution describes the challenges, architecture, design principles, and development status of the ACADA system.
	Poster WEMPR005 [3.851 MB]
DOI •	reference for this paper ※ https://doi.org/10.18429/JACoW-ICALEPCS2019-WEMPR005
About •	paper received ※ 30 September 2019 paper accepted ※ 09 October 2019 issue date ※ 30 August 2020
Export •	reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

Paper

Title

Page

Big Data Architectures for Logging and Monitoring Large Scale Telescope Arrays

268

A. Costa, U. Becciani, P. Bruno, A.S. Calanducci, A. Grillo, S. Riggi, E. Sciacca, F. Vitello
INAF-OACT, Catania, Italy
V. Conforti, F. Gianotti
INAF, Bologna, Italy
J. Schwarz
INAF-Osservatorio Astronomico di Brera, Merate, Italy
G. Tosti
Università degli di Perugia, Perugia, Italy

Funding: This work was partially supported by the ASTRI "Flagship Project" financed by the Italian Ministry of Education, University, and Research and led by the Italian National Institute of Astrophysics.
Large volumes of technical and logging data result from the operation of large scale astrophysical infrastructures. In the last few years several "Big Data" technologies have been developed to deal with a huge amount of data, e.g. in the Internet of Things (IoT) framework. We are comparing different stacks of Big Data/IoT architectures including high performance distributed messaging systems, time series databases, streaming systems, interactive data visualization. The main aim is to classify these technologies based on a set of use cases typically related to the data produced in the astronomical environment, with the objective to have a system that can be updated, maintained and customized with a minimal programming effort. We present the preliminary results obtained, using different Big Data stack solution to manage some use cases related to quasi real-time collection, processing and storage of the technical data, logging and technical alert produced by the array of nine ASTRI telescopes that are under development by INAF as a pathfinder array for the Cherenkov astronomy in the TeV energy range.
*ASTRI Project: http://www.brera.inaf.it/~astri/wordpress/
**CTA Project: https://www.cta-observatory.org/

Poster MOPHA032 [1.327 MB]

DOI •

reference for this paper ※ https://doi.org/10.18429/JACoW-ICALEPCS2019-MOPHA032

About •

paper received ※ 02 October 2019 paper accepted ※ 09 October 2019 issue date ※ 30 August 2020

Export •

reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

WEMPR005

The Array Control and Data Acquisition System of the Cherenkov Telescope Array

1046

WEPHA117

use link to see paper's listing under its alternate paper code

I. Oya, E. Antolini, M. Fuessling
CTA, Heidelberg, Germany
L. Baroncelli, A. Bulgarelli, V. Conforti, N. Parmiggiani
INAF, Bologna, Italy
J. Borkowski
CAMK, Torun, Poland
A. Carosi, J.N. Jacquemier, G. Maurin
IN2P3-LAPP, Annecy-le-Vieux, France
J. Colome
CSIC-IEEC, Bellaterra, Spain
C. Hoischen
Universität Potsdam, Potsdam-Golm, Germany
E. Lyard, R. Walter
University of Geneva, Geneva, Switzerland
D. Melkumyan, K. Mosshammer, I. Sadeh, T. Schmidt, P.A. Wegner
DESY Zeuthen, Zeuthen, Germany
U. Schwanke
Humboldt University Berlin, Institut für Physik, Berlin, Germany
J. Schwarz
INAF-Osservatorio Astronomico di Brera, Merate, Italy
G. Tosti
Università degli di Perugia, Perugia, Italy

The Cherenkov Telescope Array (CTA) project is the initiative to build the next-generation gamma-ray observatory. With more than 100 telescopes planned to be deployed in two sites, CTA is one of the largest astronomical facilities under construction. The Array Control and Data Acquisition (ACADA) system will be the central element of on-site CTA Observatory operations. The mission of the ACADA system is to manage and optimize the telescope array operations at each of the CTA sites. To that end, ACADA will provide all necessary means for the efficient execution of observations, and for the handling of the several Gb/s generated by each individual CTA telescope. The ACADA system will contain a real-time analysis pipeline, dedicated to the automatic generation of science alert candidates based on the inspection of data being acquired. These science alerts, together with external alerts arriving from other scientific installations, will permit ACADA to modify ongoing observations at sub-minute timescales in order to study high-impact scientific transient phenomena. This contribution describes the challenges, architecture, design principles, and development status of the ACADA system.

Poster WEMPR005 [3.851 MB]

DOI •

reference for this paper ※ https://doi.org/10.18429/JACoW-ICALEPCS2019-WEMPR005

About •

paper received ※ 30 September 2019 paper accepted ※ 09 October 2019 issue date ※ 30 August 2020

Export •

reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)