基于Kafka消息队列的电网设备准实时数据接入方法研究

Quasi-real-time Data Access Method of Power Network Equipment Based on Kafka Message Queue

为有效利用实时获取的电网设备状态信息,从数据的时空角度入手,提出一种针对基于Kafka消息队列的电网设备准实时数据接入方法。该方法在实时数据库与历史数据库之间引入消息队列缓存数据,解决两者数据传输速率不匹配问题;为电网设备测点与消息队列建立一一映射关系,减少元数据存储冗余;设计数据接入格式,可按需封装传输数据。为电力准实时数据接入提供了一种新的思路。

In order to effectively use the real-time state information of power network equipment,a method is suggested for the access of power network equipment quasi-real-time data based on Kafka message queue from the space and time perspective of data.This method has three advantages.First of all,it inserts the message queue cache data between the real-time database and historical database,which help to solve the problem of mismatching between two database data transmission speeds.Secondly, power network equipment measuring point with a message queue one-to-one mapping relationship is constructed, reducing metadata storage redundancy.Thirdly, design data access format to transmit data on demand.