The Joint Accelerator Conferences Website (JACoW) is an international collaboration that publishes the proceedings of accelerator conferences held around the world.
Title | Big Data Architectures for Logging and Monitoring Large Scale Telescope Arrays | |
Authors |
|
|
Abstract | Large volumes of technical and logging data result from the operation of large scale astrophysical infrastructures. In the last few years several "Big Data" technologies have been developed to deal with a huge amount of data, e.g. in the Internet of Things (IoT) framework. We are comparing different stacks of Big Data/IoT architectures including high performance distributed messaging systems, time series databases, streaming systems, interactive data visualization. The main aim is to classify these technologies based on a set of use cases typically related to the data produced in the astronomical environment, with the objective to have a system that can be updated, maintained and customized with a minimal programming effort. We present the preliminary results obtained, using different Big Data stack solution to manage some use cases related to quasi real-time collection, processing and storage of the technical data, logging and technical alert produced by the array of nine ASTRI telescopes that are under development by INAF as a pathfinder array for the Cherenkov astronomy in the TeV energy range. | |
Footnotes & References | *ASTRI Project: http://www.brera.inaf.it/~astri/wordpress/ **CTA Project: https://www.cta-observatory.org/ |
|
Funding | This work was partially supported by the ASTRI "Flagship Project" financed by the Italian Ministry of Education, University, and Research and led by the Italian National Institute of Astrophysics. | |
Paper | download MOPHA032.PDF [0.907 MB / 4 pages] | |
Poster | download MOPHA032_POSTER.PDF [1.327 MB] | |
Export | download ※ BibTeX ※ LaTeX ※ Text/Word ※ RIS ※ EndNote | |
Conference | ICALEPCS2019 | |
Series | International Conference on Accelerator and Large Experimental Physics Control Systems (17th) | |
Location | New York, NY, USA | |
Date | 05-11 October 2019 | |
Publisher | JACoW Publishing, Geneva, Switzerland | |
Editorial Board | Karen S. White (ORNL, Oak Ridge, TN, USA); Kevin A. Brown (BNL, Upton, NY, USA); Philip S. Dyer (BNL, Upton, NY, USA); Volker RW Schaa (GSI, Darmstadt, Germany) | |
Online ISBN | 978-3-95450-209-7 | |
Online ISSN | 2226-0358 | |
Received | 02 October 2019 | |
Accepted | 09 October 2019 | |
Issue Date | 30 August 2020 | |
DOI | doi:10.18429/JACoW-ICALEPCS2019-MOPHA032 | |
Pages | 268-271 | |
Copyright |
|