摘要
ETL(Extraction Transformation Loading)作为煤炭企业数据中心建设过程中的重要环节,通常需要人为调度来实现数据的抽取、转换、清洗以及装载,数据挖掘的实时性和便利性存在着很大局限。本文对ETL调度过程进行研究,提出了智能化调度策略,实现了数据调度无需人工干预即可按照预定规则执行。经过煤炭企业数字化矿山建设项目的应用实例检验后,证明了此方案的可行性。
ETL(Extraction Transformation Loading),being an important link in the construction of Data Center,usually needs manual scheduling to achieve the data extraction,transformation,cleaning and loading.Thus it can be seen that there is a major limitation on the real-time performance and the convenience.Therefore,the scheduling process of ETL was studied,and the intelligent scheduling strategy was proposed,without manual intervention.That is to say,the ETL process can automatically perform according to predetermined rules.A datamation construction project of a coal enterprise proved the feasibility of this scheme.
出处
《中国煤炭》
北大核心
2012年第1期78-80,共3页
China Coal
基金
国家科技支撑计划课题--<煤矿安全高可靠性监控系统关键技术研究--监控系统数据可靠性和挖掘技术研究及示范>(2009BAK54B05)