基于Hadoop的分布式能源状态监测集成研究

Integrated Study of Distributed Energy State Monitoring based on Hadoop

本文主要研究基于Hadoop的数据存储平台在分布式能源接入监测数据存储上的应用。首先介绍了分布式能源接入状态监测数据的特征,分析出当前数据集成面临的问题,接着介绍了Hadoop平台,主要介绍了HDFS和Map Reduce的基本原理,然后介绍了传统关系型数据库和HDFS之间数据传输工具Sqoop的原理和使用情景。接着结合分布式能源接入状态监测数据的特征和Hadoop数据处理平台的优点设计出数据集成平台的基础架构,最后提出了几点不足和未来可以改进的方向。

This paper mainly studies the application distributed energy access monitoring data storage of data storageplatform based on Hadoop. Firstly, the characteristics of distributed energy access monitoring data are introduced,and the problems of current data integration are analyzed. Then the Hadoop platform is introduced. The basic princi-ples of Map Reduce and HDFS are introduced, and the principle and usage of Sqoop, which is the data transmissiontool between traditional relationship database and HDFS, is introduced. Then combined with the characteristics ofthe distributed energy access monitoring data and the advantages of Hadoop data processing platform, we design thebasic framework of the data integration platform, and finally put forward some problems and the points that in the fu-ture can be improved.