基于查询语言转换的多源数据统一访问框架

Framework for Heterogeneous Data Unified Access Based on Language Translating

大数据时代,需要集成多样化数据管理分析工具完成业务需求,然而不同工具的数据访问接口标准不一,需要借助适配器进行接口转换以实现数据管理分析工具协作.因此,如何快速集成不同工具成为学术界与工业界亟待解决的问题.本文提出了一种基于查询语言转换的多源数据统一访问框架BAF4DUA(Bi-Adapter Framework for Data Unified Access),该框架采用双端接口适配方式,在数据提供者工具端和数据消费者工具端分别引入适配器对系统数据与查询语义进行适配,将查询语言与数据存储模型相分离,从而实现了数据提供者与数据消费者之间多对多、即插即用的数据访问,提高了应用的灵活性与扩展性.

In an era of big data,application needs to integrate various data management tools to fulfill its business requirements.However,these tools differ in their APIs and need adapters to communicate with each other.Therefore,how to integrate data management tools quickly becomes an important research problem in academia and industry.This study introduces a language translating based framework for heterogeneous data unified access,which is called the BiAdapter Framework for Data Unified Access(BAF4 DUA).In BAF4 DUA,two types of adapters are located at the data provider endpoint and data consumer endpoint to translate the query semantics and data model.The query language and data model are decoupled by the two adapters,thereby enabling many-to-many and plug-and-play data access modes between data providers and data consumers.In addition,the decoupled framework can also promote the flexibility and scalability of the application system.