数字图书馆异构数据自动迁移技术研究

Research on automatic migration of heterogeneous data in digital library

利用基于SOA的迁移技术对异构数据进行自动迁移时,不仅迁移效率低,迁移效果也不好。针对上述问题,提出基于XML的数字图书馆异构数据自动迁移技术。对异构数据迁移原理进行简要介绍,并根据该原理制定基于XML的异构数据迁移策略。该策略主要分为三部分:首先对异构数据进行采集、验证、清洗以及暂存等一系列预处理,然后利用DMCTextFilter软件抽取数据,最后通过一个映射模型将抽取的数据转化成同一个XML格式,统一装载到数据库中,完成异构数据自动迁移。结果表明:与基于SOA的异构数据自动迁移技术相比,利用该技术进行数据迁移,数据丢失率降低了10%,迁移效果更好,且数据迁移所需时间缩短了4. 4 s,迁移效率更高。

Using the migration technology based on SOA to migrate heterogeneous data automatically,not only the migration efficiency is low,but also the migration effect is not good. In view of the above problems,the automatic migration technology of heterogeneous data in Digital Library Based on XML is proposed. Briefly introduceing the principle of heterogeneous data migration,according to this principle,the strategy of heterogeneous data migration based on XML is formulated. The strategy is divided into three parts. firstly,a series of pretreatments such as collecting,validating,cleaning and temporarily storing heterogeneous data,then extracting data with DMCTextFilter software,finally transforming the extracted data into the same XML format through a mapping model,loading the data into the database uniformly,and completing the automatic processing of heterogeneous data. The results show that compared with the automatic migration of heterogeneous data based on SOA,the data loss rate is reduced by 10%,the migration effect is better,and the time required for data migration is shortened by 4. 4s,and the migration efficiency is higher.