WEOAM01
IHEP, People’s Republic of China
| Paper | Title | Page |
|---|---|---|
WEOAM01 |
High-Throughput Data Orchestration and Streaming System for High Energy Photon Source | |
|
||
| The forthcoming fourth-generation light source, the High Energy Photon Source (HEPS), is expected to generate a massive amount of data with a throughput estimated at hundreds of terabytes per day. With the advancement of synchrotron radiation technology and experimental methodologies, the data transmission pipeline has become increasingly complex, evolving from a simple detector-to-storage single-channel in the past to a complex network with multiple data generators and applications. In order to ensure a favorable experimental experience, effective data management and distribution are essential. In response to these challenges, Mamba Data Worker (MDW) has been developed, which serves the primary functions of real-time detector data acquisition, interaction with multi-terminal dataflow, metadata extraction, online assembly and writing, and light weight online data processing. This work presents the design and development plan of MDW, outlines the essential technologies involved, and illustrates its current application at the Beijing Synchrotron Radiation Facility (BSRF). | ||
|
|
Slides WEOAM01 [65.711 MB] | |
| Cite • | reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml) | |