一种基于分布式数据仓库的文件集快速更新算法

A fast refreshment algorithm for filesets based on distributed data warehouse

异构数据源整合是企业数据共享的前提,而高效的数据更新不仅节约系统开销还能提供实时数据。在分布式数据仓库的数据预处理区快速更新变动的数据是一个非常重要的热点问题,利用增量文件集的快速更新算法进行ETL设计可以加快数据更新的速度,消除异构数据模式的不一致和语义冲突问题,成套电器集团公司的成功应用证明了该算法的有效性。

Integrating heterogeneous data source is a precondition to share for enterprise data, but highly-efficient data updating is not only economical in saving system expenses, but also available in offering real- time datum. Data change at a faster speed in distributed Data Warehouse is one of the very important hot issues. Developing the ETL design by utilizing fast algorithm of increment filesets can accelerate the speed of data change, and delete heterogeneous data between nonconformity and semanteme conflict, it proves the validity of algorithm by the successful application with the corporation working on sets of electric apparatus.