高能同步辐射光源科学数据传输系统设计和实现

The Design and Implementation of Scientific Data Transfer System for High Energy Photon Source

【目的】高能同步辐射光源HEPS(High Energy Photon Source)是我国第一台高能量同步辐射光源,预计2025年建成。HEPS建成后,首批投入使用的15条光束线站预计每天会产生200TB实验数据。为满足不同阶段对实验数据的读写需求,会对海量实验数据进行分级存储和长期备份。如何将这些数据在不同存储介质之间稳定和高效地传输是HEPS实验中需要解决的重要问题。【方法】HEPS科学数据传输系统设计了多源DAQ接口、任务调度、消息队列、集群传输、日志监控、配置管理和消息通知等功能模块。【结论】系统实现了海量数据在不同存储介质间的高效、可靠传输。【结果】系统现部署在北京同步辐射多个线站,用作HEPS数据传输的前期验证,运行稳定、效果良好,为科研人员和用户提供了良好的数据传输服务。

[Objective]High Energy Photon Source(HEPS)is the first High Energy Photon Source in China.It is expected to be completed in 2025.After completion of HEPS,it is expected to produce 200TB of experimental data every day from the 15 public beamlines and stations in the first construction phase.To meet the needs of reading and writing experimental data at different stages,massive experimental data will be stored hierarchically and backed up for a long time.Therefore,it is necessary to transfer these data stably and efficiently between the different storage.[Methods]The HEPS scientific data transfer system is designed with a multi-source DAQ interface,task scheduling,message queue,cluster transfer,log monitoring,configuration management,message notification,etc.[Conclusions]The system realizes efficient and reliable transfer of massive data between different storage media.[Results]The system is now deployed in several line stations of the Beijing Synchrotron Radiation Facility,which is used for the preliminary verification of HEPS data transfer.It runs stably and has good effects,providing terrific data transfer services for researchers and users.