基于多数据源校验的配电网数据质量在线监控方法与实现

Method of Online Monitoring of Distribution Network Data Quality Based on Multi-signal Congestion and Its Realization

随着配电系统地不断扩大,配电网中地电气设备数量也急剧增加,并且对电网运行数据质量要求更加精确。由于大规模随机操作监视和控制信号数据导致活动分发网络中的各种应用程序无法快速有效地提取有用信息,对此提出基于复杂事件处理(Complex Event Processing,CEP)的智能数据处理技术,通过ETL(Extract-Transform-Load)工具制定算法库、规则库,规则库可以通过嵌套查询、组合操作和模式匹配来确定,算法库可以打包内存分区和多线程处理,融合字频统计、关键字识别和消除等算法,从而实现对多数据源校验的配电网数据质量进行在线处理。

As the distribution system continues to expand, the number of electrical equipment in the distribution network has also increased dramatically, and the quality requirements for grid operation data have become more precise. Due to the large-scale random operation monitoring and control signal data, various applications in the active distribution network cannot extract useful information quickly and efficiently. This paper proposes intelligent data processing technology based on complex event processing(CEP) through ETL( the extract-transform-load tool), and develops an algorithm library and a rule base. The rule library can be determined by nested queries, combined operations, and pattern matching. The algorithm library can package memory partitions and multi-thread processing, combine word frequency statistics, keyword recognition, and eliminate other algorithms to achieve online processing of the data quality of the distribution network for multi-data source verification.