ICALEPCS2011 - List of Authors (Tanaka, R.)

Paper

Title

Page

New SPring-8 Control Room: Towards Unified Operation with SACLA and SPring-8 II Era.

296

A. Yamashita, R. Fujihara, N. Hosoda, Y. Ishizawa, H. Kimura, T. Masuda, C. Saji, T. Sugimoto, S. Suzuki, M. Takao, R. Tanaka
JASRI/SPring-8, Hyogo-ken, Japan
T. Fukui, Y. Otake
RIKEN/SPring-8, Hyogo, Japan

We have renovated the SPring-8 control room. This is the first major renovation since its inauguration in 1997. In 2011, the construction of SACLA (SPring-8 Angstrom Compact Laser Accelerator) was completed and it is planned to be controlled from the new control room for close cooperative operation with the SPring-8 storage ring. It is expected that another SPring-8 II project will require more workstations than the current control room. We have extended the control room area for these foreseen projects. In this renovation we have employed new technology which did not exist 14 years ago, such as a large LCD and silent liquid cooling workstations for comfortable operation environment. We have incorporated many ideas which were obtained during the 14 years experience of the design. The operation in the new control room began in April 2011 after a short period of the construction.

MOPMU019

The Gateways of Facility Control for SPring-8 Accelerators

473

M. Ishii, T. Masuda, R. Tanaka, A. Yamashita
JASRI/SPring-8, Hyogo-ken, Japan

We integrated the utilities data acquisition into the SPring-8 accelerator control system based on MADOCA framework. The utilities data such as air temperature, power line voltage and temperature of machine cooling water are helpful to study the correlation between the beam stability and the environmental conditions. However the accelerator control system had no way to take many utilities data managed by the facility control system, because the accelerator control system and the facility control system was independent system without an interconnection. In 2010, we had a chance to replace the old facility control system. At that time, we constructed the gateways between the MADOCA-based accelerator control system and the new facility control system installing BACnet, that is a data communication protocol for Building Automation and Control Networks, as a fieldbus. The system requirements were as follows: to monitor utilities data with required sampling rate and resolution, to store all acquired data in the accelerator database, to keep an independence between the accelerator control system and the facility control system, to have a future expandability to control the facilities from the accelerator control system. During the work, we outsourced to build the gateways including data taking software of MADOCA to solve the problems of less manpower and short work period. In this paper we describe the system design and the approach of outsourcing.

TUCAUST06

Event-Synchronized Data Acquisition System of 5 Giga-bps Data Rate for User Experiment at the XFEL Facility, SACLA

581

M. Yamaga, A. Amselem, T. Hirono, Y. Joti, A. Kiyomichi, T. Ohata, T. Sugimoto, R. Tanaka
JASRI/SPring-8, Hyogo-ken, Japan
T. Hatsui
RIKEN/SPring-8, Hyogo, Japan

A data acquisition (DAQ), control, and storage system has been developed for user experiments at the XFEL facility, SACLA, in the SPring-8 site. The anticipated experiments demand shot-by-shot DAQ in synchronization with the beam operation cycle in order to correlate the beam characteristics, and recorded data such as X-ray diffraction pattern. The experiments produce waveform or image data, of which the data size ranges from 8 up to 48 M byte for each x-ray pulse at 60 Hz. To meet these requirements, we have constructed a DAQ system that is operated in synchronization with the 60Hz of beam operation cycle. The system is designed to handle up to 5 Gbps data rate after compression, and consists of the trigger distributor/counters, the data-filling computers, the parallel-writing high-speed data storage, and the relational database. The data rate is reduced by on-the-fly data compression through front-end embedded systems. The self-described data structure enables to handle any type of data. The pipeline data-buffer at each computer node ensures integrity of the data transfer with the non-real-time operating systems, and reduces the development cost. All the data are transmitted via TCP/IP protocol over GbE and 10GbE Ethernet. To monitor the experimental status, the system incorporates with on-line visualization of waveform/images as well as prompt data mining by 10 PFlops scale supercomputer to check the data health. Partial system for the light source commissioning was released in March 2011. Full system will be released to public users in March 2012.

Slides TUCAUST06 [3.248 MB]

TUDAUST01

Inauguration of the XFEL Facility, SACLA, in SPring-8

585

R. Tanaka, Y. Furukawa, T. Hirono, M. Ishii, M. Kago, A. Kiyomichi, T. Masuda, T. Matsumoto, T. Matsushita, T. Ohata, C. Saji, T. Sugimoto, M. Yamaga, A. Yamashita
JASRI/SPring-8, Hyogo-ken, Japan
T. Fukui, T. Hatsui, N. Hosoda, H. Maesaka, T. Ohshima, T. Otake, Y. Otake, H. Takebe
RIKEN/SPring-8, Hyogo, Japan

The construction of the X-ray free electron laser facility (SACLA) in SPring-8 started in 2006. After 5 years of construction, the facility completed to accelerate electron beams in February 2011. The main component of the accelerator consists of 64 C-band RF units to accelerate beams up to 8GeV. The beam shape is compressed to a length of 30fs, and the beams are introduced into the 18 insertion devices to generate 0.1nm X-ray laser. The first SASE X-ray was observed after the beam commissioning. The beam tuning will continue to achieve X-ray laser saturation for frontier scientific experiments. The control system adopts the 3-tier standard model by using MADOCA framework developed in SPring-8. The upper control layer consists of Linux PCs for operator consoles, Sybase RDBMS for data logging and FC-based NAS for NFS. The lower consists of 100 Solaris-operated VME systems with newly developed boards for RF waveform processing, and the PLC is used for slow control. The Device-net is adopted for the frontend devices to reduce signal cables. The VME systems have a beam-synchronized data-taking link to meet 60Hz beam operation for the beam tuning diagnostics. The accelerator control has gateways to the facility utility system not only to monitor devices but also to control the tuning points of the cooling water. The data acquisition system for the experiments is challenging. The data rate coming from 2D multiport CCD is 3.4Gbps that produces 30TB image data in a day. A sampled data will be transferred to the 10PFlops supercomputer via 10Gbps Ethernet for data evaluation.

Slides TUDAUST01 [5.427 MB]

WEBHAUST03

Large-bandwidth Data Acquisition Network for XFEL Facility, SACLA

626

T. Sugimoto, Y. Joti, T. Ohata, R. Tanaka, M. Yamaga
JASRI/SPring-8, Hyogo-ken, Japan
T. Hatsui
RIKEN/SPring-8, Hyogo, Japan

We have developed a large-bandwidth data acquisition (DAQ) network for user experiments at the SPring-8 Angstrom Compact Free Electron Laser (SACLA) facility. The network connects detectors, on-line visualization terminals and a high-speed storage of the control and DAQ system to transfer beam diagnostic data of each X-ray pulse as well as the experimental data. The development of DAQ network system (DAQ-LAN) was one of the critical elements in the system development because the data with transfer rate reaching 5 Gbps should be stored and visualized with high availability. DAQ-LAN is also used for instrument control. In order to guarantee the operation of both the high-speed data transfer and instrument control, we have implemented physical and logical network system. The DAQ-LAN currently consists of six 10-GbE capable network switches exclusively used for the data transfer, and ten 1-GbE capable network switches for instrument control and on-line visualization. High-availability was achieved by link aggregation (LAG) with typical convergence time of 500 ms, which is faster than RSTP (2 sec.). To prevent network trouble caused by broadcast, DAQ-LAN is logically separated into twelve network segments. Logical network segmentation are based on DAQ applications such as data transfer, on-line visualization, and instrument control. The DAQ-LAN will connect the control and DAQ system to the on-site high performance computing system, and to the next-generation super computers in Japan including K-computer for instant data mining during the beamtime, and post analysis.

Slides WEBHAUST03 [5.795 MB]

WEPMN028

Development of Image Data Acquisition System for 2D Detector at SACLA (SPring-8 XFEL)

947

A. Kiyomichi, A. Amselem, T. Hirono, T. Ohata, R. Tanaka, M. Yamaga
JASRI/SPring-8, Hyogo-ken, Japan
T. Hatsui
RIKEN/SPring-8, Hyogo, Japan

The x-ray free electron laser facility SACLA (SPring-8 Angstrom Compact free electron LAser) was constructed and started beam commissioning from March 2011. For the requirements of proposed experiments at SACLA, x-ray multi-readout ports CCD detectors (MPCCD) have been developed to realize a system with the total amount of 4 Mega-pixels area and 16bit wide dynamic range at a frame rate of 60Hz shot rate. We have developed the image data-handling scheme using the event-synchronized data-acquisition system. The front-end system used the CameraLink interface that excels in abilities of real-time triggering and high-speed data transfer. For the total data rate up to 4Gbps, the image data are collected by dividing the CCD detector into eight segments, which handles 0.5M pixels each, and then sent to high-speed data storage in parallel. We prepared two types of Cameralink imaging system for the VME and PC base. The Image Distribution board is made up of logic-reconfigurable VME board with CameraLink mezzanine card. The front-end system of MPCCD detector consists of eight sets of Image Distribution boards. We plan to introduce the online lossless compression using FPGA with arithmetic coding algorithm. For wide adaptability of user requirements, we also prepared the PC based imaging system, which consists of Linux server and commercial CameraLink PCI interface. It does not contain compression function, but supports various type of CCD camera, for example, high-definition (1920x1080) single CCD camera.

Poster WEPMN028 [5.574 MB]

WEMMU011

Radiation Safety Interlock System for SACLA (XFEL/SPring-8)

710

M. Kago, T. Matsushita, N. Nariyama, C. Saji, R. Tanaka, A. Yamashita
JASRI/SPring-8, Hyogo-ken, Japan
Y. Asano, T. Hara, T. Itoga, Y. Otake, H. Takebe
RIKEN/SPring-8, Hyogo, Japan
H. Tanaka
RIKEN SPring-8 Center, Sayo-cho, Sayo-gun, Hyogo, Japan

The radiation safety interlock system for SACLA (XFEL/SPring-8) protects personnel from radiation hazards. The system controls access to the accelerator tunnel, monitors the status of safety equipment such as emergency stop buttons, and gives permission for accelerator operation. The special feature of the system is a fast beam termination when the system detects an unsafe state. A total beam termination time is required less than 16.6 ms (linac operation repetition cycle: 60 Hz). Especially important is the fast beam termination when the electron beams deviates from the proper transport route. Therefore, we developed optical modules in order to transmit a signal at a high speed for a long distance (an overall length of around 700 m). An exclusive system was installed for fast judgment of a proper beam route. It is independent from the main interlock system which manages access control and so on. The system achieved a response time of less than 7ms, which is sufficient for our demand. The construction of the system was completed in February 2011 and the system commenced operation in March 2011. We will report on the design of the system and its detailed performance.

Slides WEMMU011 [0.555 MB]

Poster WEMMU011 [0.571 MB]

Paper	Title	Page
MOPMN025	New SPring-8 Control Room: Towards Unified Operation with SACLA and SPring-8 II Era.	296
	A. Yamashita, R. Fujihara, N. Hosoda, Y. Ishizawa, H. Kimura, T. Masuda, C. Saji, T. Sugimoto, S. Suzuki, M. Takao, R. Tanaka JASRI/SPring-8, Hyogo-ken, Japan T. Fukui, Y. Otake RIKEN/SPring-8, Hyogo, Japan
	We have renovated the SPring-8 control room. This is the first major renovation since its inauguration in 1997. In 2011, the construction of SACLA (SPring-8 Angstrom Compact Laser Accelerator) was completed and it is planned to be controlled from the new control room for close cooperative operation with the SPring-8 storage ring. It is expected that another SPring-8 II project will require more workstations than the current control room. We have extended the control room area for these foreseen projects. In this renovation we have employed new technology which did not exist 14 years ago, such as a large LCD and silent liquid cooling workstations for comfortable operation environment. We have incorporated many ideas which were obtained during the 14 years experience of the design. The operation in the new control room began in April 2011 after a short period of the construction.

MOPMU019	The Gateways of Facility Control for SPring-8 Accelerators	473
	M. Ishii, T. Masuda, R. Tanaka, A. Yamashita JASRI/SPring-8, Hyogo-ken, Japan
	We integrated the utilities data acquisition into the SPring-8 accelerator control system based on MADOCA framework. The utilities data such as air temperature, power line voltage and temperature of machine cooling water are helpful to study the correlation between the beam stability and the environmental conditions. However the accelerator control system had no way to take many utilities data managed by the facility control system, because the accelerator control system and the facility control system was independent system without an interconnection. In 2010, we had a chance to replace the old facility control system. At that time, we constructed the gateways between the MADOCA-based accelerator control system and the new facility control system installing BACnet, that is a data communication protocol for Building Automation and Control Networks, as a fieldbus. The system requirements were as follows: to monitor utilities data with required sampling rate and resolution, to store all acquired data in the accelerator database, to keep an independence between the accelerator control system and the facility control system, to have a future expandability to control the facilities from the accelerator control system. During the work, we outsourced to build the gateways including data taking software of MADOCA to solve the problems of less manpower and short work period. In this paper we describe the system design and the approach of outsourcing.

TUCAUST06	Event-Synchronized Data Acquisition System of 5 Giga-bps Data Rate for User Experiment at the XFEL Facility, SACLA	581
	M. Yamaga, A. Amselem, T. Hirono, Y. Joti, A. Kiyomichi, T. Ohata, T. Sugimoto, R. Tanaka JASRI/SPring-8, Hyogo-ken, Japan T. Hatsui RIKEN/SPring-8, Hyogo, Japan
	A data acquisition (DAQ), control, and storage system has been developed for user experiments at the XFEL facility, SACLA, in the SPring-8 site. The anticipated experiments demand shot-by-shot DAQ in synchronization with the beam operation cycle in order to correlate the beam characteristics, and recorded data such as X-ray diffraction pattern. The experiments produce waveform or image data, of which the data size ranges from 8 up to 48 M byte for each x-ray pulse at 60 Hz. To meet these requirements, we have constructed a DAQ system that is operated in synchronization with the 60Hz of beam operation cycle. The system is designed to handle up to 5 Gbps data rate after compression, and consists of the trigger distributor/counters, the data-filling computers, the parallel-writing high-speed data storage, and the relational database. The data rate is reduced by on-the-fly data compression through front-end embedded systems. The self-described data structure enables to handle any type of data. The pipeline data-buffer at each computer node ensures integrity of the data transfer with the non-real-time operating systems, and reduces the development cost. All the data are transmitted via TCP/IP protocol over GbE and 10GbE Ethernet. To monitor the experimental status, the system incorporates with on-line visualization of waveform/images as well as prompt data mining by 10 PFlops scale supercomputer to check the data health. Partial system for the light source commissioning was released in March 2011. Full system will be released to public users in March 2012.
	Slides TUCAUST06 [3.248 MB]

TUDAUST01	Inauguration of the XFEL Facility, SACLA, in SPring-8	585
	R. Tanaka, Y. Furukawa, T. Hirono, M. Ishii, M. Kago, A. Kiyomichi, T. Masuda, T. Matsumoto, T. Matsushita, T. Ohata, C. Saji, T. Sugimoto, M. Yamaga, A. Yamashita JASRI/SPring-8, Hyogo-ken, Japan T. Fukui, T. Hatsui, N. Hosoda, H. Maesaka, T. Ohshima, T. Otake, Y. Otake, H. Takebe RIKEN/SPring-8, Hyogo, Japan
	The construction of the X-ray free electron laser facility (SACLA) in SPring-8 started in 2006. After 5 years of construction, the facility completed to accelerate electron beams in February 2011. The main component of the accelerator consists of 64 C-band RF units to accelerate beams up to 8GeV. The beam shape is compressed to a length of 30fs, and the beams are introduced into the 18 insertion devices to generate 0.1nm X-ray laser. The first SASE X-ray was observed after the beam commissioning. The beam tuning will continue to achieve X-ray laser saturation for frontier scientific experiments. The control system adopts the 3-tier standard model by using MADOCA framework developed in SPring-8. The upper control layer consists of Linux PCs for operator consoles, Sybase RDBMS for data logging and FC-based NAS for NFS. The lower consists of 100 Solaris-operated VME systems with newly developed boards for RF waveform processing, and the PLC is used for slow control. The Device-net is adopted for the frontend devices to reduce signal cables. The VME systems have a beam-synchronized data-taking link to meet 60Hz beam operation for the beam tuning diagnostics. The accelerator control has gateways to the facility utility system not only to monitor devices but also to control the tuning points of the cooling water. The data acquisition system for the experiments is challenging. The data rate coming from 2D multiport CCD is 3.4Gbps that produces 30TB image data in a day. A sampled data will be transferred to the 10PFlops supercomputer via 10Gbps Ethernet for data evaluation.
	Slides TUDAUST01 [5.427 MB]

WEBHAUST03	Large-bandwidth Data Acquisition Network for XFEL Facility, SACLA	626
	T. Sugimoto, Y. Joti, T. Ohata, R. Tanaka, M. Yamaga JASRI/SPring-8, Hyogo-ken, Japan T. Hatsui RIKEN/SPring-8, Hyogo, Japan
	We have developed a large-bandwidth data acquisition (DAQ) network for user experiments at the SPring-8 Angstrom Compact Free Electron Laser (SACLA) facility. The network connects detectors, on-line visualization terminals and a high-speed storage of the control and DAQ system to transfer beam diagnostic data of each X-ray pulse as well as the experimental data. The development of DAQ network system (DAQ-LAN) was one of the critical elements in the system development because the data with transfer rate reaching 5 Gbps should be stored and visualized with high availability. DAQ-LAN is also used for instrument control. In order to guarantee the operation of both the high-speed data transfer and instrument control, we have implemented physical and logical network system. The DAQ-LAN currently consists of six 10-GbE capable network switches exclusively used for the data transfer, and ten 1-GbE capable network switches for instrument control and on-line visualization. High-availability was achieved by link aggregation (LAG) with typical convergence time of 500 ms, which is faster than RSTP (2 sec.). To prevent network trouble caused by broadcast, DAQ-LAN is logically separated into twelve network segments. Logical network segmentation are based on DAQ applications such as data transfer, on-line visualization, and instrument control. The DAQ-LAN will connect the control and DAQ system to the on-site high performance computing system, and to the next-generation super computers in Japan including K-computer for instant data mining during the beamtime, and post analysis.
	Slides WEBHAUST03 [5.795 MB]

WEPMN028	Development of Image Data Acquisition System for 2D Detector at SACLA (SPring-8 XFEL)	947
	A. Kiyomichi, A. Amselem, T. Hirono, T. Ohata, R. Tanaka, M. Yamaga JASRI/SPring-8, Hyogo-ken, Japan T. Hatsui RIKEN/SPring-8, Hyogo, Japan
	The x-ray free electron laser facility SACLA (SPring-8 Angstrom Compact free electron LAser) was constructed and started beam commissioning from March 2011. For the requirements of proposed experiments at SACLA, x-ray multi-readout ports CCD detectors (MPCCD) have been developed to realize a system with the total amount of 4 Mega-pixels area and 16bit wide dynamic range at a frame rate of 60Hz shot rate. We have developed the image data-handling scheme using the event-synchronized data-acquisition system. The front-end system used the CameraLink interface that excels in abilities of real-time triggering and high-speed data transfer. For the total data rate up to 4Gbps, the image data are collected by dividing the CCD detector into eight segments, which handles 0.5M pixels each, and then sent to high-speed data storage in parallel. We prepared two types of Cameralink imaging system for the VME and PC base. The Image Distribution board is made up of logic-reconfigurable VME board with CameraLink mezzanine card. The front-end system of MPCCD detector consists of eight sets of Image Distribution boards. We plan to introduce the online lossless compression using FPGA with arithmetic coding algorithm. For wide adaptability of user requirements, we also prepared the PC based imaging system, which consists of Linux server and commercial CameraLink PCI interface. It does not contain compression function, but supports various type of CCD camera, for example, high-definition (1920x1080) single CCD camera.
	Poster WEPMN028 [5.574 MB]

WEMMU011	Radiation Safety Interlock System for SACLA (XFEL/SPring-8)	710
	M. Kago, T. Matsushita, N. Nariyama, C. Saji, R. Tanaka, A. Yamashita JASRI/SPring-8, Hyogo-ken, Japan Y. Asano, T. Hara, T. Itoga, Y. Otake, H. Takebe RIKEN/SPring-8, Hyogo, Japan H. Tanaka RIKEN SPring-8 Center, Sayo-cho, Sayo-gun, Hyogo, Japan
	The radiation safety interlock system for SACLA (XFEL/SPring-8) protects personnel from radiation hazards. The system controls access to the accelerator tunnel, monitors the status of safety equipment such as emergency stop buttons, and gives permission for accelerator operation. The special feature of the system is a fast beam termination when the system detects an unsafe state. A total beam termination time is required less than 16.6 ms (linac operation repetition cycle: 60 Hz). Especially important is the fast beam termination when the electron beams deviates from the proper transport route. Therefore, we developed optical modules in order to transmit a signal at a high speed for a long distance (an overall length of around 700 m). An exclusive system was installed for fast judgment of a proper beam route. It is independent from the main interlock system which manages access control and so on. The system achieved a response time of less than 7ms, which is sufficient for our demand. The construction of the system was completed in February 2011 and the system commenced operation in March 2011. We will report on the design of the system and its detailed performance.
	Slides WEMMU011 [0.555 MB]
	Poster WEMMU011 [0.571 MB]