摘要
随着巡天观测计划的进行,传统的数据库技术无法满足海量天文数据的存储以及检索性能的需求。针对海量天文数据存储以及锥形检索的高并发、高性能问题,采用数据库中间件技术,当海量数据到达传统数据库存储阈值时,能够通过中间件技术以分库分表的形式存储到数据库集群,充分整合关系型数据库和分布式技术的优点。利用MySQL数据库集成动态索引工具(Dynamic Index Facility,DIF)插件,在分布式数据库中建立伪球面索引,能够满足海量天文数据锥形索引的需求。
With the progress of sky survey projects,traditional database technology cannot satisfy the requirements of massive astronomical data storage and retrieval performance.In this paper,aiming at the high concurrency and performance of massive astronomical data storage and cone search,database middleware technology is used.When massive data reaches the limit of traditional database storage,it can be stored in the form of sub-database and sub-table through middleware technology.In the database cluster,the characteristics of the relational databases and distributed technology are fully integrated.In this article,with the application of MySQL database integrated DIF plug-in technology a pseudo-spherical index in a distributed database is established,which can meet the needs of spatial indexing in massive astronomical data.
作者
杨超
梁波
戴伟
卫守林
邓辉
王锋
Yang Chao;Liang Bo;Dai Wei;Wei Shoulin;Deng Hui;Wang Feng(School of Information Engineering and Automation,Kunming University of Science and Technology,Kunming 650500,China;Key Laboratory of Application of the Computer Technology of the Yunnan Province,Kunming University of Science and Technology,Kunming 650500,China;Center for Astrophysics,Guangzhou University,Guangzhou 510006,China)
出处
《天文研究与技术》
CSCD
2021年第3期397-404,共8页
Astronomical Research & Technology
基金
国家重点研发计划(2018YFA0404603)
国家自然科学天文联合基金(U1831204,U1931141)
国家自然科学基金(11961141001,11903009)
广州大学“创新强校工程”项目(2017KZDXM062)
云南省重点研发计划(2018IA054)
云南省应用基础研究项目(2017FB001,2018FB103)资助.
