基于Hadoop的煤炭企业数据共享系统设计

Design of Coal Enterprise Data Sharing System Based on Hadoop

针对煤炭企业数据处理能力的不足,将云计算技术应用到煤炭企业数据共享体系中,提出了一个利用Hadoop平台对煤炭企业数据进行高效共享的系统。首先,介绍了Hadoop平台及其关键技术;而后建立了应用于煤炭企业的数据共享模型,该模型抽取源数据并通过数据集成存储于数据仓库;最后结合煤炭企业实际需求,设计了数据管理平台,完成了数据集成、模型和并行关联算法的设计。

Aiming at the deficiency of data processing ability in coal enterprises, the cloud computing technology is applied to the data sharing system of coal enterprises, and a system of efficient sharing of coal enterprise data using Hadoop platform is put forward. Firstly, the Hadoop platform and its key technologies are introduced. Then, the data sharing model applied to coal enterprises is established, the model is used to extract the source data and store it in the data warehouse. Finally, the data management platform is designed according to the actual needs of the coal enterprises, the design of data integration, model and parallel association algorithm is completed.