基于元数据驱动的通用数据迁移工具

Generalized data migration tool based on metadata-driven

为解决企业数据模型升级需要在数据库间实现数据迁移的问题,创建基于元数据驱动的通用数据迁移工具,分析数据抽取、转换和加载体系结构,采用元数据驱动技术,结合企业数据迁移需求,定义数据迁移通用框架模型体系;处理映射模式的元数据表示,实现用元数据描述与存储映射模式.该方法实现用元数据驱动数据抽取、转换和加载引擎功能,技术与功能在中国石油数据中心大型数据迁移中应用,取得良好效果.

In order to realize data migration from database to database in the upgrading of the enterprise data models,we have designed a common data migration tools based on metadata-driven.Through analyzed the data extraction,transformation and loading architecture,using metadata-driven technology,we have combined with enterprise data migration needs,defined a common framework model system for data migration.The study is focused on the express of mapping schema,describing and storing metadata.Finally,the use of metadata to drive the implementation of the data extraction,transformation and loading engine functions has been realized.The technique has been well applied in large-scale data migration of China's oil data centers.