城镇居民能耗数据平台设计与实现

Design and Implementation of Urban Residents Energy Consumption Data Platform

电、水、气等行业存在信息无法共享、抄表、漏损等难题,并且具有数据异构、海量等特点,如何应对数据的集中治理和清洗是面临的挑战之一。文章基于非关系型数据库设计了一种多源数据平台,提出的数据平台包括数据传输、数据治理和数据发布,并研究了异构数据融合、批处理计算能力、高可用性、平台安全与可靠性四方面的关键技术。在实际工程应用中,通过对复杂数据的有效处理,验证了所设计的数据平台可以支持实际应用中的功能要求。

Electricity,water,gas and other industries have problems such as inability to share information,meter reading and leakage,and present the characteristics of heterogeneous and massive data.How to deal with the centralized management and cleaning of data is one of the challenges.This paper designs a multi-source data platform based on a non-relational database.The proposed data platform includes data transmission,data governance and data release,and studies heterogeneous data fusion,batch computing capability,high availability,platform security and reliability 4 key technologies.Through the effective processing of complex data,it shows that the data platform can support the functional requirements in practical applications.