基于多变量自动回归的电力大数据异常值检测平台设计

Design of Power Big Data Outlier Detection Platform Based on Multivariate Automatic Regression

当前电力大数据异常值检测方法存在检测准确率低、耗时较长等问题,因此提出基于多变量自动回归的电力大数据异常值检测平台的设计方法。首先构建由数据源、数据收集、实时计算、数据管道、数据存储以及数据层组成的电力数据异常值检测平台。通过多变量自动回归方法完成电力数据挖掘以及异常数据的检测,并根据基本数据和异常数据线性组合生成电力数据评价值,并对评价值进行累积分布处理,最后利用高斯分布解决电力数据异常值稀疏的问题,实现数据异常值检测。实验结果表明,所设计平台检测准确率较高且耗时较短,具有可靠性。

The current power big data outlier detection methods have the problems of low detection accuracy and long time-consuming.Therefore, a design method of power big data outlier detection platform based on multivariable automatic regression is proposed.Firstly, a power data outlier detection platform is constructed, which consists of data source, data collection, real-time calculation,data pipeline, data storage and data layer. The power data mining and abnormal data detection are completed by multivariable automatic regression method, and the evaluation value of power data is generated according to the linear combination of basic data and abnormal data, and the evaluation value is processed by cumulative distribution. Finally, the problem of sparse outliers in power data is solved by using gaussian distribution, and outliers detection is realized. The experimental results show that the designed platform has high detection accuracy, short time consumption and reliability.