基于Hadoop的配电网数据存储及查询方法研究

Research on Data Storage and Query Method of Distribution Network Based on Hadoop

泛在电力物联网中大数据的存储和查询是至关重要的环节。重点探索了基于规范化集成的数据集成方法和配电网大数据的存储需求,主要研究了Hadoop等系统文件的分布情况、Hadoop分布式文件系统(Hadoop Distributed File System,HDFS)以及MapReduce模型的框架结构,进而对数据存储分布进行优化升级,并进行联合查询的工作。

The storage and query of large data in the power Internet of Things(IoT)is a crucial link.In this study,it mainly explores the method of data integration based on standardized integration and storage requirements of large data in distribution network.It mainly studies the distribution of system files such as Hadoop,the framework structure of Hadoop Distributed File System(HDFS)and MapReduce model,and then optimizes and upgrades the distribution of data storage and carries out joint query.