Cross-matching is a key technique to achieve fusion of multi-band astronomical catalogs. Due to different equipment such as various astronomical telescopes, the existence of measurement errors, and proper motions of t...Cross-matching is a key technique to achieve fusion of multi-band astronomical catalogs. Due to different equipment such as various astronomical telescopes, the existence of measurement errors, and proper motions of the celestial bodies, the same celestial object will have different positions in different catalogs, making it difficult to integrate multi-band or full-band astronomical data. In this study, we propose an online cross-matching method based on pseudo-spherical indexing techniques and develop a service combining with high performance computing system(Taurus) to improve cross-matching efficiency, which is designed for the Data Center of Xinjiang Astronomical Observatory. Specifically, we use Quad Tree Cube to divide the spherical blocks of the celestial object and map the 2D space composed of R.A. and decl. to 1D space and achieve correspondence between real celestial objects and spherical patches. Finally, we verify the performance of the service using Gaia 3 and PPMXL catalogs. Meanwhile, we send the matching results to VO tools-Topcat and Aladin respectively to get visual results. The experimental results show that the service effectively solves the speed bottleneck problem of crossmatching caused by frequent I/O, and significantly improves the retrieval and matching speed of massive astronomical data.展开更多
A telecommunication network used for the transmission of astronomical observation data,telescope remote control and other astronomical research purposes is a critical infrastructure.The monitoring and analysis of netw...A telecommunication network used for the transmission of astronomical observation data,telescope remote control and other astronomical research purposes is a critical infrastructure.The monitoring and analysis of network traffic,which help improve the network performance and the utilization of network resources,are a challenging task.The accurate identification of the astronomical data traffic will effectively improve transmission efficiency.In this paper,a classification method applied to types of traffic containing astronomical data using deep learning is proposed.The advantages of a convolutional neural network model in image classification are exploited to classify types of traffic containing astronomical data.The objective is to identify the mixed traffic in the network and accurately identify types of traffic containing astronomical data.The effectiveness of the model in improving classification accuracy is also discussed.Actual traffic data captured by Tcpdump and Wireshark are tested,and the experimental results indicate that the proposed method can accurately classify types of traffic containing astronomical data.展开更多
Data Center of Xinjiang Astronomical Observatory(XAO-DC)commenced operating in 2015,and provides services including archiving,releasing and retrieving precious astronomical data collected by the Nanshan 26 m Radio Tel...Data Center of Xinjiang Astronomical Observatory(XAO-DC)commenced operating in 2015,and provides services including archiving,releasing and retrieving precious astronomical data collected by the Nanshan 26 m Radio Telescope(NSRT)over the years,and realises the open sharing of astronomical observation data.The observation data from NSRT are transmitted to XAO-DC 100 km away through dedicated fiber for long-term storage.With the continuous increase of data,the static architecture of the current network cannot meet NSRT data-transmission requirements due to limited network bandwidth.To get high-speed data-transmission using the existing static network architecture,a method for reconstruction data-transmission network using Software-Defined Networks(SDN)is proposed.Benefit from the SDN’s data and control plane separation,and open programmable,combined with the Mininet simulation platform for experiments,the TCP throughput(of single thread)was improved by~24.7%,the TCP throughput(of multi threads)was improved by~9.8%,~40.9%,~35.5%and~11.7%.Compared with the current network architecture,the Latency was reduced by~63.2%.展开更多
基金supported by the National Key R&D Program of China (Nos. 2022YFF0711502 and 2021YFC2203502)the National Natural Science Foundation of China (NSFC)(12173077 and 12003062)+6 种基金the Tianshan Innovation Team Plan of Xinjiang Uygur Autonomous Region (2022D14020)the Tianshan Talent Project of Xinjiang Uygur Autonomous Region(2022TSYCCX0095)the Scientific Instrument Developing Project of the Chinese Academy of Sciences (grant No. PTYQ2022YZZD01)China National Astronomical Data Center (NADC)the Operation,Maintenance and Upgrading Fund for Astronomical Telescopes and Facility Instruments,budgeted from the Ministry of Finance of China (MOF)and administrated by the Chinese Academy of Sciences (CAS)Natural Science Foundation of Xinjiang Uygur Autonomous Region (2022D01A360)supported by Astronomical Big Data Joint Research Center,co-founded by National Astronomical Observatories,Chinese Academy of Sciences。
文摘Cross-matching is a key technique to achieve fusion of multi-band astronomical catalogs. Due to different equipment such as various astronomical telescopes, the existence of measurement errors, and proper motions of the celestial bodies, the same celestial object will have different positions in different catalogs, making it difficult to integrate multi-band or full-band astronomical data. In this study, we propose an online cross-matching method based on pseudo-spherical indexing techniques and develop a service combining with high performance computing system(Taurus) to improve cross-matching efficiency, which is designed for the Data Center of Xinjiang Astronomical Observatory. Specifically, we use Quad Tree Cube to divide the spherical blocks of the celestial object and map the 2D space composed of R.A. and decl. to 1D space and achieve correspondence between real celestial objects and spherical patches. Finally, we verify the performance of the service using Gaia 3 and PPMXL catalogs. Meanwhile, we send the matching results to VO tools-Topcat and Aladin respectively to get visual results. The experimental results show that the service effectively solves the speed bottleneck problem of crossmatching caused by frequent I/O, and significantly improves the retrieval and matching speed of massive astronomical data.
基金supported by the National Key R&D Program of China(Nos.2021YFC2203502 and 2022YFF0711502)Natural Science Foundation of Xinjiang Uygur Autonomous Region(2022D01A360)+6 种基金the National Natural Science Foundation of China(NSFC)(12173077 and 12003062)the Tianshan Innovation Team Plan of Xinjiang Uygur Autonomous Region(2022D14020)the Scientific Instrument Developing Project of the Chinese Academy of Sciences(Grant No.PTYQ2022YZZD01)the Operation,Maintenance and Upgrading Fund for Astronomical Telescopes and Facility Instruments,budgeted from the Ministry of Finance of China(MOF)and administrated by the Chinese Academy of Sciences(CAS)supported by Astronomical Big Data Joint Research Centerco-founded by National Astronomical Observatories,Chinese Academy of Sciences。
文摘A telecommunication network used for the transmission of astronomical observation data,telescope remote control and other astronomical research purposes is a critical infrastructure.The monitoring and analysis of network traffic,which help improve the network performance and the utilization of network resources,are a challenging task.The accurate identification of the astronomical data traffic will effectively improve transmission efficiency.In this paper,a classification method applied to types of traffic containing astronomical data using deep learning is proposed.The advantages of a convolutional neural network model in image classification are exploited to classify types of traffic containing astronomical data.The objective is to identify the mixed traffic in the network and accurately identify types of traffic containing astronomical data.The effectiveness of the model in improving classification accuracy is also discussed.Actual traffic data captured by Tcpdump and Wireshark are tested,and the experimental results indicate that the proposed method can accurately classify types of traffic containing astronomical data.
基金the National Natural Science Foundation of China(NSFC,Grant Nos.11803080,11873082 and 12003062)the National Key Research and Development Program of China(2018YFA0404704)+3 种基金the Youth Innovation Promotion Association,Chinese Academy of Sciences(CAS)the program of the Light in China’s Western Region(2019-XBQNXZ-B-018)supported by China National Astronomical Data Center(NADC)supported by Astronomical Big Data Joint Research Center,co-founded by National Astronomical Observatories,CAS。
文摘Data Center of Xinjiang Astronomical Observatory(XAO-DC)commenced operating in 2015,and provides services including archiving,releasing and retrieving precious astronomical data collected by the Nanshan 26 m Radio Telescope(NSRT)over the years,and realises the open sharing of astronomical observation data.The observation data from NSRT are transmitted to XAO-DC 100 km away through dedicated fiber for long-term storage.With the continuous increase of data,the static architecture of the current network cannot meet NSRT data-transmission requirements due to limited network bandwidth.To get high-speed data-transmission using the existing static network architecture,a method for reconstruction data-transmission network using Software-Defined Networks(SDN)is proposed.Benefit from the SDN’s data and control plane separation,and open programmable,combined with the Mininet simulation platform for experiments,the TCP throughput(of single thread)was improved by~24.7%,the TCP throughput(of multi threads)was improved by~9.8%,~40.9%,~35.5%and~11.7%.Compared with the current network architecture,the Latency was reduced by~63.2%.