Author: Lyard, E.
Paper Title Page
THBPL03 A New ACS Bulk Data Transfer Service for CTA 1116
 
  • M.A. Araya, R.S. Castillo, M.I. Jara, L. Pizarro, H.H. von Brand
    UTFSM, Valparaíso, Chile
  • E. Lyard
    University of Geneva, Geneva, Switzerland
  • I. Oya
    DESY Zeuthen, Zeuthen, Germany
  • I. Oya
    Humboldt University Berlin, Institut für Physik, Berlin, Germany
 
  Funding: Centro Científico Tecnológico de Valparaíso (CONICYT FB-0821)
The ALMA Common Software (ACS) framework provides Bulk Data Transfer (BDT) service implementations that need to be updated for new projects that will use ACS, such as the Cherenkov Telescope Array (CTA) and other projects, with most cases having quite different requirements than ALMA. We propose a new open-source BDT service for ACS based on ZeroMQ, that meets CTA data transfer specifications while maintaining retro-compatibility with the closed-source solution used in ALMA. The service uses the push-pull pattern for data transfer, the publisher-subscriber pattern for data control, and Protocol Buffers for data serialization, having also the option to integrate other serialization options easily. Besides complying with ACS interface definition to be used by ACS components and clients, the service provide an independent API to be used outside the ACS framework. Our experiments show a good compromise between throughput and computational effort, suggesting that the service could scale up in terms of number of producers, number of consumers and network bandwidth.
 
video icon Talk as video stream: https://youtu.be/F0jOkHOz0uw  
slides icon Slides THBPL03 [7.087 MB]  
DOI • reference for this paper ※ https://doi.org/10.18429/JACoW-ICALEPCS2017-THBPL03  
Export • reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)