期刊文献+

高能物理实验径迹系统流式数据获取框架的研究

Research on streaming data acquisition framework for high energy physics tracking system
下载PDF
导出
摘要 高能物理实验研究基本粒子及其相互作用,需要获取和分析大量的实验数据以发现新粒子或测量已知粒子的特性。随着高能物理实验规模的不断扩大以及加速器能量和亮度的不断提升,海量数据的获取、处理及分析将更具挑战性。在高能物理实验中,径迹系统探测器的通道数和数据量尤为巨大,为了读出和在线处理径迹系统探测器产生的海量数据,本文结合Hadoop大数据框架,引入主流开源的大数据处理组件,研究实现了一种流式数据获取框架——BigDataDAQ,并应用于时间投影室探测器模型实验中。实验室性能测试结果表明:这一数据获取框架具有良好的数据吞吐和数据处理能力,且易于部署和管理,为未来高能物理径迹系统结合大数据框架研制处理海量数据的流式数据获取系统进行了有益的尝试,并提供了一种可行的解决方案。 [Background]High energy physics(HEP)experiments aimed at studying elementary particles and their interactions need to acquire and analyze large amount of experimental data to discover new particles or measure the properties of known particles.With the development of HEP experiments,the energy and luminosity of accelerators are increasing,the scale of experiments is expanding,and consequently the acquisition,processing and analysis of large amount of data will be more challenging.[Purpose]This study aims to design and implement a more advanced or effective distributed data acquisition framework to acquire and process the huge amount of data generated by tracking detectors for future HEP experiments where the number of channels and data volume of tracking detectors is extremely large.[Methods]The distributed data acquisition framework in HEP experiment divided into data flow software and online software was redesigned by using Hadoop big data framework,mainstream open source big data processing components was adopted to develope a new data acquisition framework—BigDataDAQ.Finally,this framework was applied to the prototype of the time projection chamber for verification.[Results&Conclusions]Results of performance test show that the framework has high performance in data throughput and data processing,and can be easily deployed and managed.It provides a feasible solution for the future data acquisition system of high energy physics experiment.
作者 吴冶 章红宇 朱科军 王之滨 陈玛丽 祁辉荣 WU Ye;ZHANG Hongyu;ZHU Kejun;WANG Zhibin;CHEN Mali;QI Huirong(State Key Laboratory of Particle Detection and Electronics,Institute of High Energy Physics,Chinese Academy of Sciences,Beijing 100049,China;University of Chinese Academy of Sciences,Beijing 100049,China)
出处 《核技术》 CAS CSCD 北大核心 2021年第6期65-74,共10页 Nuclear Techniques
基金 科技部国家重点研发计划项目(No.2018YFA0404300)资助。
关键词 高能物理实验 径迹系统探测器 数据获取系统 Hadoop大数据框架 流式数据处理 High energy physics experiment Tracking detectors Data acquisition system Hadoop big data framework Streaming data processing
  • 相关文献

参考文献2

二级参考文献14

  • 1Banga G, Mogul J C, and Druschel P. A Scalable and Explicit Event Delivery Mechanism for Unix In USENIX Annual Technical Conference,1999:253-265
  • 2Linux Programmer's Manual. RetHat AS4 随机帮助文档
  • 3http://www-900.ibm.com/developerWorks/crdlinux/kemel/ l-keme126/index.shtml
  • 4Marc J. Rochkind. Advanced. Unix Programming(Second Edition),Addison Wesley, 2004
  • 5Michael K.Johnson, Erik W.Troan. Linux Application Development, Addison Wesley,2005
  • 6Jonathan Lemon. Kqueue: A Generic and Scalable Event Notification Facility, FreeBSD Project
  • 7Niels Provos Chuck Lever. Scalable Network I/O in Linux, 2000
  • 8夏浩波.单例模式的设计与应用[J].电脑开发与应用,2011,24(1):58-59. 被引量:8
  • 9蒲凤平,陈建政.基于ZeroMQ的分布式系统[J].电子测试,2012,23(7):24-29. 被引量:27
  • 10许健,于鸿洋.一种Linux多线程应用下内存池的设计与实现[J].电子技术应用,2012,38(11):146-149. 被引量:5

共引文献9

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部