面向电力大数据的多数据流实时处理技术研究

Research on Multi Data Stream Real-Time Processing Technology for Power Big Data

随着电力大数据的形成与深化应用,传统数据批处理技术已不能满足当前电网实时应用要求,多源数据的即时获取和实时关联计算已成为制约电力大数据全面应用的关键因素。论文梳理了国内外大数据实时处理的技术发展现状,探讨了电力大数据实时处理的应用需求,提出了一种面向多用户的电力大数据流计算服务体系,搭建了电力大数据实时流计算处理平台,以低压用户电量计算为典型应用场景对电力大数据实时计算平台的处理性能进行了验证。

With the formation and deepening of power big data,the traditional data batch technology cannot meet the requirements of real-time application of current power grid. Real-time acquisition and real-time correlation calculation of multi-source data has become a key factor to restrict the comprehensive application of big data. This paper combs the current situation of real-time processing of large-scale data processing at home and abroad,discusses the application requirements of real-time processing of power big data,and puts forward a real-time processing framework for multi-data stream for power big data,and builds real-time flow calculation platform to low-voltage user power calculation for the typical application scenarios for large-scale real-time computing platform for power processing performance is verified.