摘要
随着智能网格业务不断发展,智能网格气象预报业务产品种类、数量日益增长,给产品的存储管理带来挑战。针对江西省智能网格气象预报业务产品收集及存储现状,采用PostgreSQL、Kibana、Elasticsearch等开源技术,提出了基于气象大数据云平台的气象数据湖建设思路,实现产品集中存储和管理,并提供统一共享服务,解决了海量多源数据产品存储、管理和共享等技术难题,为业务用户能够高效共享和应用数据产品提供数据环境支撑。
With the continuous development of intelligent grid business, the types and quantities of intelligent grid business products are increasing, which brings challenges to the storage management of products. Considering the current situation of intelligent grid business products in Jiangxi province, the idea of building a meteorological data lake based on the meteorological big data cloud platform is recommended using open-source technologies such as Postgre SQL, Kibana and Elasticsearch, in order to realize the centralized storage and management of intelligent grid business products, provide unified shared services, solve the technical problems of storage, management and sharing of massive multi-source data products, and provide data environment support for business users to efficiently sharing and applying data products.
作者
刘海燕
周雪莹
李显风
胡丽丽
Liu Haiyan;Zhou Xueying;Li Xianfeng;Hu Lili(Jiangxi Meteorological Information Center,Nanchang 330038,China)
出处
《气象与减灾研究》
2022年第1期64-69,共6页
Meteorology and Disaster Reduction Research
基金
江西省03专项及5G项目(编号:20212ABC03W02)
江西省气象科技重点项目(编号:JX2020Z19)
江西省气象科技面上项目(编号:JXQXJ2019015)。
关键词
数据湖
智能网格
业务产品
共享服务
data lake
intelligent grid
business products
shared services