多源异构数据接入技术及其在垂直领域应用框架的探索

Research on Multi-Source Heterogeneous Data Access Technology and Its Application Framework in Vertical Field

【目的】多源异构数据接入技术的突破对于切实解决垂直领域“数据孤岛”严峻问题,实现数据获取的全局性、真实性、实时性保障以及数据的互通融合应用尤为重要。【方法】本文在相关文献基础上,分析基于ETL的多源异构数据接入技术、基于语义本体的多源异构数据接入技术、基于机器人流程自动化的多源异构数据接入技术和基于云—端融合资源反射机制的多源异构数据接入技术等各类技术的内在机理与特点。【结果】对4种多源异构数据接入技术在垂直领域应用的典型框架进行探索设计,并进一步对4种技术特征进行归纳总结并横向对比,以期为相关实践应用提供有指导价值的示范与参考。【结论】本文对垂直领域大数据集成与互操作实践提供理论基础,如何充分利用技术关键方法更好地解决实时数据接入等技术局限性将作为未来研究重点。

[Objective]The breakthrough of multi-source heterogeneous data access technology is particularly important for effectively solving the severe problem of"data island"in the vertical field,achieving global,authenticity,real-time guarantee of data acquisition,and data fusion applications.[Methods]Through literature analysis,current researches on multi-source heterogeneous data access technologies of ETL based,semantic ontology based,robot process automation based and cloud side integration resource reflection mechanism based are summarized.The characteristics of various technologies are analyzed.[Results]Typical frameworks for the application of four multi-source heterogeneous data access technologies in the vertical field are explored and designed,and four technical features are summarized and compared,in order to provide valuable demonstration and reference for relevant practical applications.[Conclusions]A theoretical basis for the integration and interoperability practices of big data in the vertical field is provided,and how to fully utilize key technical methods to better solve the technical limitations of real-time data access will be the focus of future research.