平方公里阵列(Square Kilometre Array, SKA)作为最大的射电望远镜,其观测产生的数据将首先由澳大利亚和南非两个台址传输到几百公里以外的科学数据处理中心,然后通过跨洲际高速互联网分发到上万公里距离的全球各个SKA区域中心(SKA Regi...平方公里阵列(Square Kilometre Array, SKA)作为最大的射电望远镜,其观测产生的数据将首先由澳大利亚和南非两个台址传输到几百公里以外的科学数据处理中心,然后通过跨洲际高速互联网分发到上万公里距离的全球各个SKA区域中心(SKA Regional Centre, SRC).在SKA第一阶段,每年预计有710 PB的数据需要通过至少100 Gbps的网络分发到各个SRC,如此高的网络带宽和数据规模对数据的传输与分发带来极大挑战.本文通过对TCP/UDP/HTTP等多种网络协议的分析,使用当前射电天文领域不同的软件测试研究了当前10 Gbps网络基础设施下的最佳传输方案参数,讨论了影响高速传输的因素,提出了相应的性能优化策略.这将为中国在SKA第一阶段正式观测前的网络建设和布局提供技术基础,也是未来SKA区域中心全球联网运行的技术积累.本文所描述的技术细节和方法对依赖大数据量跨国际节点交互的相关科学应用至关重要.展开更多
平方公里阵列(Square Kilometre Array, SKA)将成为世界上最大的综合孔径射电望远镜.凭借其高分辨率、超高灵敏度和超快巡天速度, SKA能以前所未有的细节探索宇宙.连续谱巡天是SKA的几个主要观测模式之一,为理解和认识射电天空奠定基础....平方公里阵列(Square Kilometre Array, SKA)将成为世界上最大的综合孔径射电望远镜.凭借其高分辨率、超高灵敏度和超快巡天速度, SKA能以前所未有的细节探索宇宙.连续谱巡天是SKA的几个主要观测模式之一,为理解和认识射电天空奠定基础. SKA探路者设备已经运行了几年,积累了丰富的巡天观测数据.中国天文学家正在为中国SKA区域中心(China SKA Regional Centre, CSRC)的建设进行积极的准备,已经完成了原型机.本文详细介绍了在CSRC原型机中部署SKA低频数据处理系统的进展.默奇森宽场阵列(Murchison Wide-field Array, MWA)是SKA低频阵列的先导项目.我们使用MWA的观测数据来验证成像管线系统的部署并测试其正确性. CSRC原型机的数据处理结果与已发表的结果一致,表明在CSRC原型机上部署开发的并行数据处理系统取得了巨大成功.而且,该原型机的灵活适配性和可扩展性使其可以轻松扩展,支持未来SKA第一阶段试运行期间的大规模连续谱成像实验.这些经验将有助于改善成像管线系统,并有助于完善CSRC.展开更多
The upcoming Square Kilometre Array (SKA) radio telescope will become the largest astronomical observation facility,and is expected to introduce revolutionary changes in major fields of natural sciences.These revoluti...The upcoming Square Kilometre Array (SKA) radio telescope will become the largest astronomical observation facility,and is expected to introduce revolutionary changes in major fields of natural sciences.These revolutionary changes help us to answer the fundamental questions related to the origins of the universe,life,cosmic magnetic field,the nature of gravity,and to search for extraterrestrial civilizations [1].展开更多
The Square Kilometre Array(SKA)project consists of delivering two largest radio telescope arrays being built by the SKA Observatory(SKAO),which is an intergovernmental organization bringing together nations from aroun...The Square Kilometre Array(SKA)project consists of delivering two largest radio telescope arrays being built by the SKA Observatory(SKAO),which is an intergovernmental organization bringing together nations from around the world with China being one of the major member countries.The computing resources needed to process,distribute,curate and use the vast amount of data that will be generated by the SKA telescopes are too large for the SKAO to manage on its own.To address this challenge,the SKAO is working with the international community to create a shared,distributed data,computing and networking capability called the SKA Regional Centre Alliance.In this model,the SKAO will be supported by a global network of SKA Regional Centres(SRCs)distributed around the world in its member countries to build an end-to-end science data system that will provide astronomers with high-quality science products.SRCs undertake deep processing,scientific analysis,and long-term storage of the SKA data,as well as user support.China has been actively participating in and promoting the construction of SRCs.This paper introduces the international cooperation and ongoing prototyping of the global SRC network,the basis for the construction of the China SRC and describes in detail the progress of the China SRC prototype.The paper also presents examples of scientific applications of SKA precursor and pathfinder telescopes performed using resources from the China SRC prototype.Finally,the future prospects of the China SRC are presented.展开更多
文摘平方公里阵列(Square Kilometre Array, SKA)作为最大的射电望远镜,其观测产生的数据将首先由澳大利亚和南非两个台址传输到几百公里以外的科学数据处理中心,然后通过跨洲际高速互联网分发到上万公里距离的全球各个SKA区域中心(SKA Regional Centre, SRC).在SKA第一阶段,每年预计有710 PB的数据需要通过至少100 Gbps的网络分发到各个SRC,如此高的网络带宽和数据规模对数据的传输与分发带来极大挑战.本文通过对TCP/UDP/HTTP等多种网络协议的分析,使用当前射电天文领域不同的软件测试研究了当前10 Gbps网络基础设施下的最佳传输方案参数,讨论了影响高速传输的因素,提出了相应的性能优化策略.这将为中国在SKA第一阶段正式观测前的网络建设和布局提供技术基础,也是未来SKA区域中心全球联网运行的技术积累.本文所描述的技术细节和方法对依赖大数据量跨国际节点交互的相关科学应用至关重要.
文摘平方公里阵列(Square Kilometre Array, SKA)将成为世界上最大的综合孔径射电望远镜.凭借其高分辨率、超高灵敏度和超快巡天速度, SKA能以前所未有的细节探索宇宙.连续谱巡天是SKA的几个主要观测模式之一,为理解和认识射电天空奠定基础. SKA探路者设备已经运行了几年,积累了丰富的巡天观测数据.中国天文学家正在为中国SKA区域中心(China SKA Regional Centre, CSRC)的建设进行积极的准备,已经完成了原型机.本文详细介绍了在CSRC原型机中部署SKA低频数据处理系统的进展.默奇森宽场阵列(Murchison Wide-field Array, MWA)是SKA低频阵列的先导项目.我们使用MWA的观测数据来验证成像管线系统的部署并测试其正确性. CSRC原型机的数据处理结果与已发表的结果一致,表明在CSRC原型机上部署开发的并行数据处理系统取得了巨大成功.而且,该原型机的灵活适配性和可扩展性使其可以轻松扩展,支持未来SKA第一阶段试运行期间的大规模连续谱成像实验.这些经验将有助于改善成像管线系统,并有助于完善CSRC.
基金supported by the National Key R&D Program of China(Grant No.2018YFA0404600)the International Cooperation Bureau of the Chinese Academy of Sciences(Grant No.114231KYSB20170003)
文摘The upcoming Square Kilometre Array (SKA) radio telescope will become the largest astronomical observation facility,and is expected to introduce revolutionary changes in major fields of natural sciences.These revolutionary changes help us to answer the fundamental questions related to the origins of the universe,life,cosmic magnetic field,the nature of gravity,and to search for extraterrestrial civilizations [1].
基金supported by the National Key R&D Program of China(Grant No.2018YFA0404603)Chinese Academy of Sciences International Partner Program(Grant No.114231KYSB20170003)+2 种基金National Natural Science Foundation of China(Grant No.12041301)Youth Innovation Promotion AssociationChinese Academy of Sciences(Grant Nos.201664,and2021258)。
文摘The Square Kilometre Array(SKA)project consists of delivering two largest radio telescope arrays being built by the SKA Observatory(SKAO),which is an intergovernmental organization bringing together nations from around the world with China being one of the major member countries.The computing resources needed to process,distribute,curate and use the vast amount of data that will be generated by the SKA telescopes are too large for the SKAO to manage on its own.To address this challenge,the SKAO is working with the international community to create a shared,distributed data,computing and networking capability called the SKA Regional Centre Alliance.In this model,the SKAO will be supported by a global network of SKA Regional Centres(SRCs)distributed around the world in its member countries to build an end-to-end science data system that will provide astronomers with high-quality science products.SRCs undertake deep processing,scientific analysis,and long-term storage of the SKA data,as well as user support.China has been actively participating in and promoting the construction of SRCs.This paper introduces the international cooperation and ongoing prototyping of the global SRC network,the basis for the construction of the China SRC and describes in detail the progress of the China SRC prototype.The paper also presents examples of scientific applications of SKA precursor and pathfinder telescopes performed using resources from the China SRC prototype.Finally,the future prospects of the China SRC are presented.