大气环境科学综合数据采集共享平台建设及应用研究

Construction and Application of Comprehensive Data Collection and Sharing Platform for Atmospheric Environmental Science

为实现大气重污染成因与治理攻关项目数据的统一管理和数据共享,基于美国电子政务共享框架(Federal Enterprise Architecture Framework,FEA)方法论和数据中台思想,采用JAVA平台和SOA框架,以大气重污染成因与治理攻关项目科研数据为主,整合全社会大气科学数据资源,面向京津冀、汾渭平原大气污染成因与治理改善分析的核心业务需求,建设集多源异构数据采集、治理、共享、分析、发布于一体的大气环境科学数据采集与共享平台;建立完善的线上数据治理流程,采用多种算法实现大气业务数据集的实时质控;采用分级、分权限的数据共享机制和共享接口动态编辑技术,建立一站式数据枢纽.结果表明:①建立大气科学数据规范分类体系,提供从原始数据、二次数据产品、大气攻关信息发布等多种类型的数据共享服务.②建立海量多源异构综合数据集,包括空气质量、组分、污染源、气象、健康等11类,数据总量4.3 TB,包括7.5亿条数据和66万个文件.③开发交互式GIS服务和线上评估分析工具,实现环境空气质量评估、气象影响分析、组分变化、污染源统计四类主题数据服务.④向大气重污染成因与治理攻关项目各课题组、七省(市)提供多种形式共享,开放104个数据接口,实现21亿条数据、2万份文件、15个专题共享,有力地支撑了大气重污染成因与治理攻关项目的各项研究.

In order to achieve the unified management and sharing of data on the causes and governance of National Research Program for Key Issues in Air Pollution Control,we focused on the research data of National Research Program for Key Issues in Air Pollution Control and integrated the atmospheric science data resources of the whole society.We established an atmospheric environmental scientific data collection and sharing platform that integrates the collection,sharing,analysis and release system of multi-source heterogeneous data based on the Federal Enterprise Architecture Framework methodology and data-middle platform,with the focuse on the analysis of the causes and improvement of air pollution in the Beijing-Tianjin-Hebei and Fenwei Plains.The platform was built on the JAVA platform and SOA framework.The platform implemented a complete online data governance process,used multiple algorithms to achieve real-time quality control of atmospheric data sets,and established a one-stop data set through a hierarchical and sub-authorized data sharing mechanism and shared interface dynamic editing technology.This research:(1)Established a standardized classification system for atmospheric science data,and provided various types of data sharing services from original data,secondary data products,and release of atmospheric research information.(2)Established massive multi-source heterogeneous comprehensive data sets,including 11 categories such as air quality,components,pollution sources,meteorology and health.The total data was 4.3 TB,including 750 million pieces of data and 660,000 files.(3)Developed interactive GIS services and online assessment tools to achieve four types of thematic data services,including the assessment of environmental air quality,meteorology impact analysis,air composition change,and pollution source statistics.(4)Provided various types of data sharing to the research groups of the atmospheric research projects and seven provinces.The system opened 104 data interfaces,and shared 2.1 billion,20,000 data documents and 15 topics,which strongly supported other researches on National Research Program for Key Issues in Air Pollution Control.