基于分布式处理架构的数据共享交换平台设计

Design of data sharing and exchange platform based on distributed processing architecture

大数据是“新基建、数字经济、中国制造2025”的重要组成部分,已被列入国家战略性产业。随着我国数字化转型步伐加快,各个领域、各个行业对信息系统的需求增多,各类业务系统数量随之增加,产生的数据量也呈几何级增长。数据标准的统一出现一定的问题,所以建设一套数据共享交换平台,对解决数据标准不统一、数据共享不充分、数据使用效率较低等问题,将会有一定的效果。文章提出通过使用分布式处理架构,按照相关数据标准对来自不同环境的异构数据进行采集、加工、转换,得以实现信息资源的整合利用,消除“信息孤岛”。

Big data is an essential aspect of “New Infrastructure, Digital Economy, Made in China 2025”, which has b een listed as a national strategic industry. With the acceleration of China’s digital transformation, the demand for i nformation systems in various fields and industries has increased, the number of various commercial systems has i ncreased, and the amount of data generated has also showed a geometric growth. There are some problems in the u nification of data standards. In this way, the construction of a data sharing and exchange platform will have an impact o n solving the non-uniform data standards, inadequate data sharing, low efficient data use. This paper proposes the use o f distributed processing architecture in accordance with relevant data standards from different environments of heterogeneous data collection, processing, conversion, so as to achieve the integration of information resources, e liminating the “Information silo”.