摘要
在数据集成中,经常碰到大数据量的集成问题,基于数据仓库方式的数据集成技术是一种比较流行的集成模式,提高该集成模式的查询以及实化视图的初始化效率、响应速度,并防止内存溢出,是数据集成中非常关注的地方。在基于数据仓库方式的数据集成模式中,利用基于内存控制的流水线处理方法,提高查询以及实化视图的初始化效率。实验证明,以上方法较同步方法不仅提高了数据集成效率,而且实现了内存控制。
In the data integration field,often encounter a large amount of data,an approach based on data warehouse data integration technology is a popular integration model,how to improve query and the initialization of materialized view's performance,response speed,and to do memory control to prevent memory overflow at this mode,are very concerned in data integration.In this paper,based on data warehouse data integration model,used a pipeline processing method to improve the efficiency of query initialization of materialized view,experiments and theory show that the above method not only improve the efficiency of data integration,and achieved a good memory control.
出处
《微型机与应用》
2010年第24期67-69,共3页
Microcomputer & Its Applications
关键词
数据集成
查询效率
内存控制
流水线
data integration
query efficiency
memory control
pipeline