基于JSON的异构数据集成的研究

Research on Heterogeneous Data Integration Based on JSON

随着大数据、互联网+时代的到来,越来越多的领域采用互联网技术完成日常的工作并产生了海量的数据信息,如何有效的实现海量数据的共享,解决异构数据的语法和语义的异构性是异构数据集成中亟需解决的问题。在传统的数据集成方案的基础上,结合中间件技术,JSON相关技术、Ontology相关技术,提出一种改进的异构数据集成方案。在该方案中,查询处理器模块,加入查询优化器和选择性复制器,提高查询效率。再针对地理信息系统领域,提出了完整的设计方案,并进行了实现,验证了这种方法的可行性。通过实例表明,基于JSON的异构数据集成中间件能够很好的实现对异构数据的资源共享,解决异构数据问题。

With the advent of big data, Internet plus era, Internet technology is used in more and more fields to complete the daily work and produce huge amounts of data. How to effectively realize the sharing of data, solve the heterogeneity of syntax and semantics of heterogeneous data integration is the problem to be solved in heterogeneous data. On the basis of traditional data integration scheme, combined with middleware technology, JSON related technology and Ontology related technology, an improved heterogeneous data integration scheme is proposed. In this scheme, the query pro-cessor module adds query optimizer and selective replicator to improve query efficiency. In the field of geographic information system, a complete design scheme is proposed and implemented, and the feasibility of this method is verified. The example shows that the heterogeneous data inte-gration middleware based on JSON can realize the resource sharing of heterogeneous data well and solve the problem of heterogeneous data.