Cross-matching is a key technique to achieve fusion of multi-band astronomical catalogs. Due to different equipment such as various astronomical telescopes, the existence of measurement errors, and proper motions of t...Cross-matching is a key technique to achieve fusion of multi-band astronomical catalogs. Due to different equipment such as various astronomical telescopes, the existence of measurement errors, and proper motions of the celestial bodies, the same celestial object will have different positions in different catalogs, making it difficult to integrate multi-band or full-band astronomical data. In this study, we propose an online cross-matching method based on pseudo-spherical indexing techniques and develop a service combining with high performance computing system(Taurus) to improve cross-matching efficiency, which is designed for the Data Center of Xinjiang Astronomical Observatory. Specifically, we use Quad Tree Cube to divide the spherical blocks of the celestial object and map the 2D space composed of R.A. and decl. to 1D space and achieve correspondence between real celestial objects and spherical patches. Finally, we verify the performance of the service using Gaia 3 and PPMXL catalogs. Meanwhile, we send the matching results to VO tools-Topcat and Aladin respectively to get visual results. The experimental results show that the service effectively solves the speed bottleneck problem of crossmatching caused by frequent I/O, and significantly improves the retrieval and matching speed of massive astronomical data.展开更多
The Xinjiang Astronomical Observatory Data Center faces issues related to delay-affected services. As a result, these services cannot be implemented in a timely manner due to the overloading of transmission links. In ...The Xinjiang Astronomical Observatory Data Center faces issues related to delay-affected services. As a result, these services cannot be implemented in a timely manner due to the overloading of transmission links. In this paper, the software-defined network technology is applied to the Xinjiang Astronomical Observatory Data Center Network(XAODCN). Specifically, a novel reconfiguration method is proposed to realise the software-defined Xinjiang Astronomical Observatory Data Center Network(SDXAO-DCN), and a network model is constructed. To overcome the congestion problem, a traffic load-balancing algorithm is designed for fast transmission of the service traffic by combining three factors: network structure, congestion level and transmission service. The proposed algorithm is compared with current commonly load-balancing algorithms which are used in data center to verify its efficiency. Simulation experiments show that the algorithm improved transmission performance and transmission quality for the SDXAO-DCN.展开更多
基金supported by the National Key R&D Program of China (Nos. 2022YFF0711502 and 2021YFC2203502)the National Natural Science Foundation of China (NSFC)(12173077 and 12003062)+6 种基金the Tianshan Innovation Team Plan of Xinjiang Uygur Autonomous Region (2022D14020)the Tianshan Talent Project of Xinjiang Uygur Autonomous Region(2022TSYCCX0095)the Scientific Instrument Developing Project of the Chinese Academy of Sciences (grant No. PTYQ2022YZZD01)China National Astronomical Data Center (NADC)the Operation,Maintenance and Upgrading Fund for Astronomical Telescopes and Facility Instruments,budgeted from the Ministry of Finance of China (MOF)and administrated by the Chinese Academy of Sciences (CAS)Natural Science Foundation of Xinjiang Uygur Autonomous Region (2022D01A360)supported by Astronomical Big Data Joint Research Center,co-founded by National Astronomical Observatories,Chinese Academy of Sciences。
文摘Cross-matching is a key technique to achieve fusion of multi-band astronomical catalogs. Due to different equipment such as various astronomical telescopes, the existence of measurement errors, and proper motions of the celestial bodies, the same celestial object will have different positions in different catalogs, making it difficult to integrate multi-band or full-band astronomical data. In this study, we propose an online cross-matching method based on pseudo-spherical indexing techniques and develop a service combining with high performance computing system(Taurus) to improve cross-matching efficiency, which is designed for the Data Center of Xinjiang Astronomical Observatory. Specifically, we use Quad Tree Cube to divide the spherical blocks of the celestial object and map the 2D space composed of R.A. and decl. to 1D space and achieve correspondence between real celestial objects and spherical patches. Finally, we verify the performance of the service using Gaia 3 and PPMXL catalogs. Meanwhile, we send the matching results to VO tools-Topcat and Aladin respectively to get visual results. The experimental results show that the service effectively solves the speed bottleneck problem of crossmatching caused by frequent I/O, and significantly improves the retrieval and matching speed of massive astronomical data.
基金supported by National Key R&D Program of China No.2021YFC2203502the National Natural Science Foundation of China (NSFC)(11803080,12173077,11873082,12003062)+2 种基金the Tianshan Innovation Team Plan of Xinjiang Uygur Autonomous Region (2022D14020)the Youth Innovation Promotion Association CASNational Key R&D Program of China No.2018 YFA0404704。
文摘The Xinjiang Astronomical Observatory Data Center faces issues related to delay-affected services. As a result, these services cannot be implemented in a timely manner due to the overloading of transmission links. In this paper, the software-defined network technology is applied to the Xinjiang Astronomical Observatory Data Center Network(XAODCN). Specifically, a novel reconfiguration method is proposed to realise the software-defined Xinjiang Astronomical Observatory Data Center Network(SDXAO-DCN), and a network model is constructed. To overcome the congestion problem, a traffic load-balancing algorithm is designed for fast transmission of the service traffic by combining three factors: network structure, congestion level and transmission service. The proposed algorithm is compared with current commonly load-balancing algorithms which are used in data center to verify its efficiency. Simulation experiments show that the algorithm improved transmission performance and transmission quality for the SDXAO-DCN.