Short-Term Household Load Forecasting Based on Attention Mechanism and CNN-ICPSO-LSTM

Accurate load forecasting forms a crucial foundation for implementing household demand response plans andoptimizing load scheduling. When dealing with short-term load data characterized by substantial fluctuations,a single prediction model is hard to capture temporal features effectively, resulting in diminished predictionaccuracy. In this study, a hybrid deep learning framework that integrates attention mechanism, convolution neuralnetwork (CNN), improved chaotic particle swarm optimization (ICPSO), and long short-term memory (LSTM), isproposed for short-term household load forecasting. Firstly, the CNN model is employed to extract features fromthe original data, enhancing the quality of data features. Subsequently, the moving average method is used for datapreprocessing, followed by the application of the LSTM network to predict the processed data. Moreover, the ICPSOalgorithm is introduced to optimize the parameters of LSTM, aimed at boosting the model’s running speed andaccuracy. Finally, the attention mechanism is employed to optimize the output value of LSTM, effectively addressinginformation loss in LSTM induced by lengthy sequences and further elevating prediction accuracy. According tothe numerical analysis, the accuracy and effectiveness of the proposed hybrid model have been verified. It canexplore data features adeptly, achieving superior prediction accuracy compared to other forecasting methods forthe household load exhibiting significant fluctuations across different seasons.

A Levenberg–Marquardt Based Neural Network for Short-Term Load Forecasting

Short-term load forecasting (STLF) is part and parcel of theefficient working of power grid stations. Accurate forecasts help to detect thefault and enhance grid reliability for organizing sufficient energy transactions.STLF ranges from an hour ahead prediction to a day ahead prediction. Variouselectric load forecasting methods have been used in literature for electricitygeneration planning to meet future load demand. A perfect balance regardinggeneration and utilization is still lacking to avoid extra generation and misusageof electric load. Therefore, this paper utilizes Levenberg–Marquardt(LM) based Artificial Neural Network (ANN) technique to forecast theshort-term electricity load for smart grids in a much better, more precise,and more accurate manner. For proper load forecasting, we take the mostcritical weather parameters along with historical load data in the form of timeseries grouped into seasons, i.e., winter and summer. Further, the presentedmodel deals with each season’s load data by splitting it into weekdays andweekends. The historical load data of three years have been used to forecastweek-ahead and day-ahead load demand after every thirty minutes makingload forecast for a very short period. The proposed model is optimized usingthe Levenberg-Marquardt backpropagation algorithm to achieve results withcomparable statistics. Mean Absolute Percent Error (MAPE), Root MeanSquared Error (RMSE), R2, and R are used to evaluate the model. Comparedwith other recent machine learning-based mechanisms, our model presentsthe best experimental results with MAPE and R2 scores of 1.3 and 0.99,respectively. The results prove that the proposed LM-based ANN modelperforms much better in accuracy and has the lowest error rates as comparedto existing work.

Research on Short-Term Load Forecasting of Distribution Stations Based on the Clustering Improvement Fuzzy Time Series Algorithm

An improved fuzzy time series algorithmbased on clustering is designed in this paper.The algorithm is successfully applied to short-term load forecasting in the distribution stations.Firstly,the K-means clustering method is used to cluster the data,and the midpoint of two adjacent clustering centers is taken as the dividing point of domain division.On this basis,the data is fuzzed to form a fuzzy time series.Secondly,a high-order fuzzy relation with multiple antecedents is established according to the main measurement indexes of power load,which is used to predict the short-term trend change of load in the distribution stations.Matlab/Simulink simulation results show that the load forecasting errors of the typical fuzzy time series on the time scale of one day and one week are[−50,20]and[−50,30],while the load forecasting errors of the improved fuzzy time series on the time scale of one day and one week are[−20,15]and[−20,25].It shows that the fuzzy time series algorithm improved by clustering improves the prediction accuracy and can effectively predict the short-term load trend of distribution stations.

Short-Term Power Load Forecasting with Hybrid TPA-BiLSTM Prediction Model Based on CSSA

Since the existing prediction methods have encountered difficulties in processing themultiple influencing factors in short-term power load forecasting,we propose a bidirectional long short-term memory(BiLSTM)neural network model based on the temporal pattern attention(TPA)mechanism.Firstly,based on the grey relational analysis,datasets similar to forecast day are obtained.Secondly,thebidirectional LSTM layermodels the data of thehistorical load,temperature,humidity,and date-type and extracts complex relationships between data from the hidden row vectors obtained by the BiLSTM network,so that the influencing factors(with different characteristics)can select relevant information from different time steps to reduce the prediction error of the model.Simultaneously,the complex and nonlinear dependencies between time steps and sequences are extracted by the TPA mechanism,so the attention weight vector is constructed for the hidden layer output of BiLSTM and the relevant variables at different time steps are weighted to influence the input.Finally,the chaotic sparrow search algorithm(CSSA)is used to optimize the hyperparameter selection of the model.The short-term power load forecasting on different data sets shows that the average absolute errors of short-termpower load forecasting based on our method are 0.876 and 4.238,respectively,which is lower than other forecastingmethods,demonstrating the accuracy and stability of our model.

Load-forecasting method for IES based on LSTM and dynamic similar days with multi-features

To fully exploit the rich characteristic variation laws of an integrated energy system(IES)and further improve the short-term load-forecasting accuracy,a load-forecasting method is proposed for an IES based on LSTM and dynamic similar days with multi-features.Feature expansion was performed to construct a comprehensive load day covering the load and meteorological information with coarse and fine time granularity,far and near time periods.The Gaussian mixture model(GMM)was used to divide the scene of the comprehensive load day,and gray correlation analysis was used to match the scene with the coarse time granularity characteristics of the day to be forecasted.Five typical days with the highest correlation with the day to be predicted in the scene were selected to construct a“dynamic similar day”by weighting.The key features of adjacent days and dynamic similar days were used to forecast multi-loads with fine time granularity using LSTM.Comparing the static features as input and the selection method of similar days based on non-extended single features,the effectiveness of the proposed prediction method was verified.

Theory Study and Application of the BP-ANN Method for Power Grid Short-Term Load Forecasting

Aiming at the low accuracy problem of power system short-term load forecasting by traditional methods, a back-propagation artificial neural network （BP-ANN） based method for short-term load forecasting is presented in this paper. The forecast points are related to prophase adjacent data as well as the periodical long-term historical load data. Then the short-term load forecasting model of Shanxi Power Grid （China） based on BP-ANN method and correlation analysis is established. The simulation model matches well with practical power system load, indicating the BP-ANN method is simple and with higher precision and practicality.

Medium Term Load Forecasting for Jordan Electric Power System Using Particle Swarm Optimization Algorithm Based on Least Square Regression Methods

This paper presents a technique for Medium Term Load Forecasting (MTLF) using Particle Swarm Optimization (PSO) algorithm based on Least Squares Regression Methods to forecast the electric loads of the Jordanian grid for year of 2015. Linear, quadratic and exponential forecast models have been examined to perform this study and compared with the Auto Regressive (AR) model. MTLF models were influenced by the weather which should be considered when predicting the future peak load demand in terms of months and weeks. The main contribution for this paper is the conduction of MTLF study for Jordan on weekly and monthly basis using real data obtained from National Electric Power Company NEPCO. This study is aimed to develop practical models and algorithm techniques for MTLF to be used by the operators of Jordan power grid. The results are compared with the actual peak load data to attain minimum percentage error. The value of the forecasted weekly and monthly peak loads obtained from these models is examined using Least Square Error (LSE). Actual reported data from NEPCO are used to analyze the performance of the proposed approach and the results are reported and compared with the results obtained from PSO algorithm and AR model.

Short-term load forecasting based on fuzzy neural network

The fuzzy neural network is applied to the short-term load forecasting. The fuzzy rules and fuzzy membership functions of the network are obtained through fuzzy neural network learming. Three inference algorithms, i.e. themultiplicative inference, the maximum inference and the minimum inference, are used for comparison. The learningalgorithms corresponding to the inference methods are derived from back-propagation algorithm. To validate the fuzzyneural network model, the network is used to Predict short-term load by compaing the network output against the realload data from a local power system supplying electricity to a large steel manufacturer. The experimental results aresatisfactory.

Short-Term Load Forecasting Using Radial Basis Function Neural Network

An accurate short-term forecasting method for load of electric power system can help the electric power system’s operator to reduce the risk of unreliability of electricity supply. This paper proposed a radial basis function (RBF) neural network method to forecast the short-term load of electric power system. To demonstrate the effectiveness of the proposed method, the method is tested on the practical load data information of the Tai power system. The good agreements between the realistic values and forecasting values are obtained;the numerical results show that the proposed forecasting method is accurate and reliable.

Deep Learning Network for Energy Storage Scheduling in Power Market Environment Short-Term Load Forecasting Model

In the electricity market,fluctuations in real-time prices are unstable,and changes in short-term load are determined by many factors.By studying the timing of charging and discharging,as well as the economic benefits of energy storage in the process of participating in the power market,this paper takes energy storage scheduling as merely one factor affecting short-term power load,which affects short-term load time series along with time-of-use price,holidays,and temperature.A deep learning network is used to predict the short-term load,a convolutional neural network(CNN)is used to extract the features,and a long short-term memory(LSTM)network is used to learn the temporal characteristics of the load value,which can effectively improve prediction accuracy.Taking the load data of a certain region as an example,the CNN-LSTM prediction model is compared with the single LSTM prediction model.The experimental results show that the CNN-LSTM deep learning network with the participation of energy storage in dispatching can have high prediction accuracy for short-term power load forecasting.

Short-Term Electricity Price Forecasting Using a Combination of Neural Networks and Fuzzy Inference

This paper presents an artificial neural network, ANN, based approach for estimating short-term wholesale electricity prices using past price and demand data. The objective is to utilize the piecewise continuous na-ture of electricity prices on the time domain by clustering the input data into time ranges where the variation trends are maintained. Due to the imprecise nature of cluster boundaries a fuzzy inference technique is em-ployed to handle data that lies at the intersections. As a necessary step in forecasting prices the anticipated electricity demand at the target time is estimated first using a separate ANN. The Australian New-South Wales electricity market data was used to test the system. The developed system shows considerable im-provement in performance compared with approaches that regard price data as a single continuous time se-ries, achieving MAPE of less than 2% for hours with steady prices and 8% for the clusters covering time pe-riods with price spikes.

Wavelet time series MPARIMA modeling for power system short term load forecasting

The wavelet power system short term load forecasting(STLF) uses a mulriple periodical autoregressive integrated moving average(MPARIMA) model to model the mulriple near periodicity, nonstationarity and nonlinearity existed in power system short term quarter hour load time series, and can therefore accurately forecast the quarter hour loads of weekdays and weekends, and provide more accurate results than the conventional techniques, such as artificial neural networks and autoregressive moving average(ARMA) models test results. Obtained with a power system networks in a city in Northeastern part of China confirm the validity of the approach proposed.

Short-term load forecasting model based on gated recurrent unit and multi-head attention

Short-term load forecasting(STLF)plays a crucial role in the smart grid.However,it is challenging to capture the long-time dependence and the nonlinear relationship due to the comprehensive fluctuations of the electrical load.In this paper,an STLF model based on gated recurrent unit and multi-head attention(GRU-MA)is proposed to address the aforementioned problems.The proposed model accommodates the time series and nonlinear relationship of load data through gated recurrent unit(GRU)and exploits multi-head attention(MA)to learn the decisive features and long-term dependencies.Additionally,the proposed model is compared with the support vector regression(SVR)model,the recurrent neural network and multi-head attention(RNN-MA)model,the long short-term memory and multi-head attention(LSTM-MA)model,the GRU model,and the temporal convolutional network(TCN)model using the public dataset of the Global Energy Forecasting Competition 2014(GEFCOM2014).The results demonstrate that the GRU-MA model has the best prediction accuracy.

Optimized Adaptive Fuzzy Forecasting System with Application

In this paper, a fuzzy forecasting system is designed and implemented by which an original forecasting model can be obtained by data learning. The model parameters can then be adaptively optimized through gradient information of real-time data. Thus, the system is of extinguished adaptive feature and self-learning capability. Afterwards, experimental research efforts are put forward to carry out electric power load forecasting. Experimental results demonstrate the satisfactory performances of the intelligent forecasting system.

基于误差幅空特性分析的空间负荷预测误差评价方法

对空间负荷预测误差进行有效评价是客观认识预测结果,指导预测结果合理应用的前提。然而,现有空间负荷预测误差评价的研究存在对误差的空间分布不考虑或考虑不充分导致评价不准确的问题。为此,提出一种基于误差幅空特性分析的空间负荷预测误差评价方法。首先,从空间负荷预测误差幅值大小和空间分布对电网规划影响的角度出发,对误差的幅空特性进行详细分析;其次,利用运输问题的数学模型来表征正负误差的幅空抵消特性,使用各空间邻近度–幅值误差值曲线与x轴围成面积之和来表征剩余未抵消误差的幅空叠加特性;然后,分别通过伏格尔法和各梯形面积累加公式来计算正负误差的幅空抵消影响值和剩余未抵消误差的幅空叠加影响值,并在此基础上构建空间负荷预测误差评价指标;最后,基于误差对电网规划的实际影响给出对误差评价指标性能的检验方法。算例分析表明,与传统方法相比,该文所提误差评价方法从幅值和空间两个维度实现了对空间负荷预测误差更为全面的评估,与误差对电网规划影响的实际情况贴近度更高。

基于VMD-改进最优加权法的短期负荷变权组合预测策略

为提升短期电力负荷预测精度,提出了一种变权组合预测策略。首先,为了降低负荷数据的不平稳度,使用变分模态分解(variational mode decomposition,VMD)将负荷数据分解成了高频、低频、残差3种特征模态分量。其次,充分计及负荷数据的时序特点,参考指数加权法原理设计自适应误差重要性量化函数,并结合组合模型在时间窗口内的历史负荷数据的均方预测误差设计改进最优加权法的目标函数和约束条件,以完成子模型的准确变权。最后,针对波动较强的高频分量选定极端梯度提升(XGBoost)和卷积神经网络-长短期记忆(CNN-LSTM)模型并使用改进最优加权法进行组合预测、低频分量使用多元线性回归(MLR)模型预测、残差分量使用LSTM模型预测,叠加各模态分量的预测结果,实现了短期负荷数据的准确预测。实验结果表明,使用策略组合模型的平均绝对百分比误差为4.18%。与使用传统组合策略的组合模型相比,平均绝对百分比预测误差平均降低了0.87%。

基于聚合二次模态分解及Informer的短期负荷预测

针对区域级负荷的非平稳性及长序列预测精度低的问题,该文提出了一种基于聚合二次模态分解及Informer的短期负荷预测方法。首先,运用改进完全集合经验模态分解(improved complete ensemble empirical mode decomposition with adaptive noise,ICEEMDAN)对负荷序列进行初步分解,削弱原始序列的随机性与波动性;其次,根据子序列的样本熵计算结果进行聚合,并通过比较不同的聚合方式选出最优重构方案;然后,利用变分模态分解对高复杂度的合作模态函数进行二次分解;充分考虑到电价、气象等因素对负荷的影响,采用随机森林(random forest,RF)算法进行相关性分析,从而为每个子序列构建不同的高耦合度特征矩阵并输入Informer进行建模,并通过其多层次编码及稀疏多头自注意力机制等方式提高对负荷序列的预测效率;最后采用巴塞罗那区域级负荷数据集进行实例验证,结果显示所提框架有效解决了模态分解过程中的模态混叠以及高频分量问题,并且其长序列预测均方根误差相比其他经典深度学习模型最高降低了65.28%。

基于EMD与机器学习算法的近零能耗建筑负荷预测方法

采用皮尔逊相关系数法分析了不同特征变量与冷热负荷的相关性,确定了预测模型的输入特征变量。采用经验模态分解(EMD)对逐日冷热负荷按频分解,然后采用机器学习算法,即反向传播神经网络(BPNN)、随机森林(RF)和支持向量机(SVM),分别对不同频率的负荷量进行了训练、验证,最后重构得到了近零能耗建筑预测负荷。基于上述方法,以北京市某近零能耗居住建筑为研究对象,比较了不同算法预测结果的精确度。结果表明:采用EMD与RF算法相结合对近零能耗建筑冷热负荷的预测精确度较高。进一步采用穷举搜索法对模型初设参数进行了优化,冷热负荷预测结果精确度提高,冷负荷预测结果的决定系数R2、平均绝对百分比误差MAPE分别为0.996、1.32%,热负荷预测结果的R2、MAPE分别为0.997、0.79%。