基于云计算的数据仓库ETL系统研究与优化

Research and Optimization of the Data Warehouse ETL System Based on Cloud Computing

随着数据仓库中数据规模的日益膨胀和数据实时性需求的不断提高,如何改进ETL体系已经成为保障数据仓库数据质量的关键内容.本文通过借鉴云计算模式强大的计算能力和存储能力,拟构建一种基于云计算的数据仓库ETL系统,该系统的基本理念是在充分利用现有设备、资源和技术的基础上,通过利用云计算"低硬件成本、高综合利用率、可扩展性强、高可靠性"的特点,优化现有ETL工作流程,以提升数据仓库ETL性能和效率.

With the continuous expansion of the data warehouse and the increase of the demand for the real -time data ,how to improve the ETL system has become the key elements of the data quality and security .By drawing on the computing power and storage capacity of the cloud computing model , this paper intends to build a cloud -based data warehouse ETL system .Its basic concept is that with the full use of existing equipment ,resources and technology and through the development of the characteristics of cloud computing as “low hardware costs , high comprehensive utilization ,scalability ,and high reliability” ,the existing ETL workflow can be optimized and the performance and efficiency can be enhanced .