期刊文献+

ETL执行的流水线优化 被引量:15

Optimization of ETL Execution by Pipelining Method
下载PDF
导出
摘要 ETL工具是构建和维护数据仓库的基本构件,由于它处理的是海量数据,如何有效地加快响应时间成为值得研究的问题.本文提出了ETL过程的“主表衍生”模式,并针对这种模式采用流水线算法来提高并行性从而加快ETL过程的响应时间,理论分析和实验表明具有好的效果. ETL is a tool responsible for data loading and maintaining of data warehouse.How to efficiently shorten the execution time is a big challenge because the volume of data to be processed is very large.This paper discusses the model of 'derived by one view' for ETL execution and gives the pipelining method by view horizontal partition to shorten the exectutin time.The theory and experiment proves it to be efficient.
出处 《小型微型计算机系统》 CSCD 北大核心 2005年第6期1013-1017,共5页 Journal of Chinese Computer Systems
基金 江苏省十五高科技项目(BG2001013)资助.
关键词 ETL 数据仓库 流水线 ETL data warehouse pipelining
  • 相关文献

参考文献7

  • 1Panos Vassiliadis, Chrstoph Quix, Yannis Vassiliou et al. A model for data warehouse operational processes[C]. The 12th Conference on Advanced Information Systems Engineering(CAISE'00),Stockholm, Sweden, 2000.
  • 2Panos Vassiliadis, Zografoula Vagena, Spiros Skiadopoulos et al. ARKTOS: towards the modeling , design,control and execution of ETL processes[J]. Information Systems, 2001, 26(8):537-561.
  • 3Timos K Sellie. Multiple-query optimization[J]. ACM trans-actions on database system, 1998,13 (1): 23- 52.
  • 4Panos Vassiliadis, Alkis Simitsis, Spiros Skiadopoulos. Conceptual modeling for ETL processes[C]. Proceedings of the 5th ACM International Workshop on Data Warehousing and OLAP,2002:14-21.
  • 5Panos Vassiliadis, Alkis Simitsis, Spiros Skiadopoulos. Modeling ETL activities as graphs [C]. In Proc. of 4th International Workshop on the Design and Management of Data Warehouses,Toronto Canada, 2002: 52-61.
  • 6Bouzeghoub M, Fabret F, Matulovic M. Modeling data warehouse refreshment process as a workflow application [C]. In Proc. Intl. Workshop on Design and Management of Data Warehouses, Heidelberg, Germany, 1999.
  • 7唐恒 赵传立.排序引论[M].北京:科学出版社,2002..

共引文献1

同被引文献101

引证文献15

二级引证文献95

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部