Short-Term Household Load Forecasting Based on Attention Mechanism and CNN-ICPSO-LSTM

Accurate load forecasting forms a crucial foundation for implementing household demand response plans andoptimizing load scheduling. When dealing with short-term load data characterized by substantial fluctuations,a single prediction model is hard to capture temporal features effectively, resulting in diminished predictionaccuracy. In this study, a hybrid deep learning framework that integrates attention mechanism, convolution neuralnetwork (CNN), improved chaotic particle swarm optimization (ICPSO), and long short-term memory (LSTM), isproposed for short-term household load forecasting. Firstly, the CNN model is employed to extract features fromthe original data, enhancing the quality of data features. Subsequently, the moving average method is used for datapreprocessing, followed by the application of the LSTM network to predict the processed data. Moreover, the ICPSOalgorithm is introduced to optimize the parameters of LSTM, aimed at boosting the model’s running speed andaccuracy. Finally, the attention mechanism is employed to optimize the output value of LSTM, effectively addressinginformation loss in LSTM induced by lengthy sequences and further elevating prediction accuracy. According tothe numerical analysis, the accuracy and effectiveness of the proposed hybrid model have been verified. It canexplore data features adeptly, achieving superior prediction accuracy compared to other forecasting methods forthe household load exhibiting significant fluctuations across different seasons.

A Levenberg–Marquardt Based Neural Network for Short-Term Load Forecasting

Short-term load forecasting (STLF) is part and parcel of theefficient working of power grid stations. Accurate forecasts help to detect thefault and enhance grid reliability for organizing sufficient energy transactions.STLF ranges from an hour ahead prediction to a day ahead prediction. Variouselectric load forecasting methods have been used in literature for electricitygeneration planning to meet future load demand. A perfect balance regardinggeneration and utilization is still lacking to avoid extra generation and misusageof electric load. Therefore, this paper utilizes Levenberg–Marquardt(LM) based Artificial Neural Network (ANN) technique to forecast theshort-term electricity load for smart grids in a much better, more precise,and more accurate manner. For proper load forecasting, we take the mostcritical weather parameters along with historical load data in the form of timeseries grouped into seasons, i.e., winter and summer. Further, the presentedmodel deals with each season’s load data by splitting it into weekdays andweekends. The historical load data of three years have been used to forecastweek-ahead and day-ahead load demand after every thirty minutes makingload forecast for a very short period. The proposed model is optimized usingthe Levenberg-Marquardt backpropagation algorithm to achieve results withcomparable statistics. Mean Absolute Percent Error (MAPE), Root MeanSquared Error (RMSE), R2, and R are used to evaluate the model. Comparedwith other recent machine learning-based mechanisms, our model presentsthe best experimental results with MAPE and R2 scores of 1.3 and 0.99,respectively. The results prove that the proposed LM-based ANN modelperforms much better in accuracy and has the lowest error rates as comparedto existing work.

Research on Short-Term Load Forecasting of Distribution Stations Based on the Clustering Improvement Fuzzy Time Series Algorithm

An improved fuzzy time series algorithmbased on clustering is designed in this paper.The algorithm is successfully applied to short-term load forecasting in the distribution stations.Firstly,the K-means clustering method is used to cluster the data,and the midpoint of two adjacent clustering centers is taken as the dividing point of domain division.On this basis,the data is fuzzed to form a fuzzy time series.Secondly,a high-order fuzzy relation with multiple antecedents is established according to the main measurement indexes of power load,which is used to predict the short-term trend change of load in the distribution stations.Matlab/Simulink simulation results show that the load forecasting errors of the typical fuzzy time series on the time scale of one day and one week are[−50,20]and[−50,30],while the load forecasting errors of the improved fuzzy time series on the time scale of one day and one week are[−20,15]and[−20,25].It shows that the fuzzy time series algorithm improved by clustering improves the prediction accuracy and can effectively predict the short-term load trend of distribution stations.

Short-Term Power Load Forecasting with Hybrid TPA-BiLSTM Prediction Model Based on CSSA

Since the existing prediction methods have encountered difficulties in processing themultiple influencing factors in short-term power load forecasting,we propose a bidirectional long short-term memory(BiLSTM)neural network model based on the temporal pattern attention(TPA)mechanism.Firstly,based on the grey relational analysis,datasets similar to forecast day are obtained.Secondly,thebidirectional LSTM layermodels the data of thehistorical load,temperature,humidity,and date-type and extracts complex relationships between data from the hidden row vectors obtained by the BiLSTM network,so that the influencing factors(with different characteristics)can select relevant information from different time steps to reduce the prediction error of the model.Simultaneously,the complex and nonlinear dependencies between time steps and sequences are extracted by the TPA mechanism,so the attention weight vector is constructed for the hidden layer output of BiLSTM and the relevant variables at different time steps are weighted to influence the input.Finally,the chaotic sparrow search algorithm(CSSA)is used to optimize the hyperparameter selection of the model.The short-term power load forecasting on different data sets shows that the average absolute errors of short-termpower load forecasting based on our method are 0.876 and 4.238,respectively,which is lower than other forecastingmethods,demonstrating the accuracy and stability of our model.

Long-Term Electrical Load Forecasting in Rwanda Based on Support Vector Machine Enhanced with Q-SVM Optimization Kernel Function

In recent years, Rwanda’s rapid economic development has created the “Rwanda Africa Wonder”, but it has also led to a substantial increase in energy consumption with the ambitious goal of reaching universal access by 2024. Meanwhile, on the basis of the rapid and dynamic connection of new households, there is uncertainty about generating, importing, and exporting energy whichever imposes a significant barrier. Long-Term Load Forecasting (LTLF) will be a key to the country’s utility plan to examine the dynamic electrical load demand growth patterns and facilitate long-term planning for better and more accurate power system master plan expansion. However, a Support Vector Machine (SVM) for long-term electric load forecasting is presented in this paper for accurate load mix planning. Considering that an individual forecasting model usually cannot work properly for LTLF, a hybrid Q-SVM will be introduced to improve forecasting accuracy. Finally, effectively assess model performance and efficiency, error metrics, and model benchmark parameters there assessed. The case study demonstrates that the new strategy is quite useful to improve LTLF accuracy. The historical electric load data of Rwanda Energy Group (REG), a national utility company from 1998 to 2020 was used to test the forecast model. The simulation results demonstrate the proposed algorithm enhanced better forecasting accuracy.

The Influence of Air Pollution Concentrations on Solar Irradiance Forecasting Using CNN-LSTM-mRMR Feature Extraction

Maintaining a steady power supply requires accurate forecasting of solar irradiance,since clean energy resources do not provide steady power.The existing forecasting studies have examined the limited effects of weather conditions on solar radiation such as temperature and precipitation utilizing convolutional neural network(CNN),but no comprehensive study has been conducted on concentrations of air pollutants along with weather conditions.This paper proposes a hybrid approach based on deep learning,expanding the feature set by adding new air pollution concentrations,and ranking these features to select and reduce their size to improve efficiency.In order to improve the accuracy of feature selection,a maximum-dependency and minimum-redundancy(mRMR)criterion is applied to the constructed feature space to identify and rank the features.The combination of air pollution data with weather conditions data has enabled the prediction of solar irradiance with a higher accuracy.An evaluation of the proposed approach is conducted in Istanbul over 12 months for 43791 discrete times,with the main purpose of analyzing air data,including particular matter(PM10 and PM25),carbon monoxide(CO),nitric oxide(NOX),nitrogen dioxide(NO_(2)),ozone(O₃),sulfur dioxide(SO_(2))using a CNN,a long short-term memory network(LSTM),and MRMR feature extraction.Compared with the benchmark models with root mean square error(RMSE)results of 76.2,60.3,41.3,32.4,there is a significant improvement with the RMSE result of 5.536.This hybrid model presented here offers high prediction accuracy,a wider feature set,and a novel approach based on air concentrations combined with weather conditions for solar irradiance prediction.

Short-Term and Long-Term Price Forecasting Models for the Future Exchange of Mongolian Natural Sea Buckthorn Market

Sea buckthorn market floated uncertainly within a narrow range. The market situation provided upward pressure on prices, and producer and consumer interest were poor, coupled with weak prices in the regional markets. The objectives of the study are: 1) to estimate the relationship between wild Sea buckthorn (SB) price and Supply, Demand, while some other factors of crude oil price and exchange rate by using simultaneous Supply-Demand and Price system equation and Vector Error Correction Method (VECM);2) to forecast the short-term and long-term SB price;3) to compare and evaluate the price forecasting models. Firstly, the data was analyzed by Ferris and Engle-Granger’s procedure;secondly, both price forecasting methodologies were tested by Pindyck-Rubinfeld and Makridakis’s procedure. The result shows that the VECM model is more efficient using yearly data;a short-term price forecast decreases, and a long-term price forecast is predicted to increase the Mongolian Sea buckthorn market.

A forecasting model for wave heights based on a long short-term memory neural network

To explore new operational forecasting methods of waves,a forecasting model for wave heights at three stations in the Bohai Sea has been developed.This model is based on long short-term memory(LSTM)neural network with sea surface wind and wave heights as training samples.The prediction performance of the model is evaluated,and the error analysis shows that when using the same set of numerically predicted sea surface wind as input,the prediction error produced by the proposed LSTM model at Sta.N01 is 20%,18%and 23%lower than the conventional numerical wave models in terms of the total root mean square error(RMSE),scatter index(SI)and mean absolute error(MAE),respectively.Particularly,for significant wave height in the range of 3–5 m,the prediction accuracy of the LSTM model is improved the most remarkably,with RMSE,SI and MAE all decreasing by 24%.It is also evident that the numbers of hidden neurons,the numbers of buoys used and the time length of training samples all have impact on the prediction accuracy.However,the prediction does not necessary improve with the increase of number of hidden neurons or number of buoys used.The experiment trained by data with the longest time length is found to perform the best overall compared to other experiments with a shorter time length for training.Overall,long short-term memory neural network was proved to be a very promising method for future development and applications in wave forecasting.

Theory Study and Application of the BP-ANN Method for Power Grid Short-Term Load Forecasting

Aiming at the low accuracy problem of power system short-term load forecasting by traditional methods, a back-propagation artificial neural network （BP-ANN） based method for short-term load forecasting is presented in this paper. The forecast points are related to prophase adjacent data as well as the periodical long-term historical load data. Then the short-term load forecasting model of Shanxi Power Grid （China） based on BP-ANN method and correlation analysis is established. The simulation model matches well with practical power system load, indicating the BP-ANN method is simple and with higher precision and practicality.

Short-term and imminent geomagnetic anomalies of the Wenchuan M_S8.0 earthquake and exploration on earthquake forecast

The diurnal variation of the geomagnetic vertical component is exhibited mainly by changes of phase and amplitude before strong earthquakes. Based on data recorded by the network of geomagnetic observatories in China for many years, the anomalous features of the appearance time of the minima of diurnal variations （i.e, low-point time） of the geo- magnetic vertical components and the variation of their spatial distribution （i.e, phenomena of low-point displacement） have been studied before the Wenchuan Ms8.0 earthquake. The strong aftershocks after two months＇ quiescence of M6 aftershocks of the Ms8.0 event were forecasted based on these studies. There are good correlativities between these geomagnetic anoma- lies and occurrences of earthquakes. It has been found that most earthquakes occur near the boundary line of sudden changes of the low-point time and generally within four days before or after the 27th or 41st day counting from the day of the appearance of the anomaly. In addition, the imminent anomalies in diurnal-variation amplitudes near the epicentral areas have also been studied before the Wenchuan earthquake.

Case Study of a Short-Term Wave Energy Forecasting Scheme:North Indian Ocean

Short-term forecasts of wave energy play a key role in the daily operation,maintenance planning,and electrical grid operation of power farms.In this study,we propose a short-term wave energy forecast scheme and use the North Indian Ocean(NIO)as a case study.Compared with the traditional forecast scheme,our proposed scheme considers more forecast elements.In addition to the traditional short-term forecast factors related to wave energy(wave power,significant wave height(SWH),wave period),our scheme emphasizes the forecast of a series of key factors that are closely related to the effectiveness of the energy output,capture efficiency,and conversion efficiency.These factors include the available rate,total storage,effective storage,co-occurrence of wave power-wave direction,co-occurrence of the SWH-wave period,and the wave energy at key points.In the regional nesting of nu-merical simulations of wave energy in the NIO,the selection of the southern boundary is found to have a significant impact on the simulation precision,especially during periods of strong swell processes of the South Indian Ocean(SIO)westerly.During tropical cyclone‘VARDAH’in the NIO,as compared with the simulation precision obtained with no expansion of the southern boundary(scheme-1),when the southern boundary is extended to the tropical SIO(scheme-2),the improvement in simulation precision is significant,with an obvious increase in the correlation coefficient and decrease in error.In addition,the improvement is much more significant when the southern boundary extends to the SIO westerly(scheme-3).In the case of strong swell processes generated by the SIO westerly,the improvement obtained by scheme-3 is even more significant.

Long-Term Load Forecasting of Southern Governorates of Jordan Distribution Electric System

Load forecasting is vitally important for electric industry in the deregulated economy. This paper aims to face the power crisis and to achieve energy security in Jordan. Our participation is localized in the southern parts of Jordan including, Ma’an, Karak and Aqaba. The available statistical data about the load of southern part of Jordan are supplied by electricity Distribution Company. Mathematical and statistical methods attempted to forecast future demand by determining trends of past results and use the trends to extrapolate the curve demand in the future.

Spatial and temporal synthesized probability gain for middle and long-term earthquake forecast and its preliminary application

The principle of middle and long-term earthquake forecast model of spatial and temporal synthesized probability gain and the evaluation of forecast efficiency (R-values) of various forecast methods are introduced in this paper. The R-value method, developed by Xu (1989), is further developed here, and can be applied to more complicated cases. Probability gains in spatial and/or temporal domains and the R-values for different forecast methods are estimated in North China. The synthesized probability gain is then estimated as an example.

Short-Term Wind Power Prediction Based on ICEEMDAN-SE-LSTM Neural Network Model with Classifying Seasonal

Wind power prediction is very important for the economic dispatching of power systems containing wind power.In this work,a novel short-term wind power prediction method based on improved complete ensemble empirical mode decomposition with adaptive noise(ICEEMDAN)and(long short-term memory)LSTM neural network is proposed and studied.First,the original data is prepossessed including removing outliers and filling in the gaps.Then,the random forest algorithm is used to sort the importance of each meteorological factor and determine the input climate characteristics of the forecast model.In addition,this study conducts seasonal classification of the annual data where ICEEMDAN is adopted to divide the original wind power sequence into numerous modal components according to different seasons.On this basis,sample entropy is used to calculate the complexity of each component and reconstruct them into trend components,oscillation components,and random components.Then,these three components are input into the LSTM neural network,respectively.Combined with the predicted values of the three components,the overall power prediction results are obtained.The simulation shows that ICEEMDAN-SE-LSTM achieves higher prediction accuracy ranging from 1.57%to 9.46%than other traditional models,which indicates the reliability and effectiveness of the proposed method for power prediction.

Statistical Transformation Indicators of Short-Term to Long-Term Using Flood Regional Coefficients (Case Study: East Azarbaijan Province, Iran)

Changing contexts in a long-term and short-term perspective should be managed within an integrated risk management framework that accounts for both temporary management strategies and permanent preventive measures to reduce the impact of natural hazard processes. In this study, statistical transformation indicators of short-term (20 year) to long-term (30 year) used flood regional coefficients. After the tests of data validation and the reconstruction of missing and outlier data, the data of 18 hydrometric stations were completed for 30 years (1985 to 2014). In the next phase, the return period values were prepared for 20-year and 30-year statistical periods (1985 to 2004 and 1985 to 2014) using the HYFA software. Thus the 20-year to 30-year ratio for various return period discharges obtained and these dimensionless values were plotted for the return periods of 2, 5, 10, 20, 50 and 100 years, also fitted the logarithmic trend line and the values of coefficients of the relationship were obtained. The statistics including average, standard deviation, coefficient of variation (CV), skewness coefficient (CS) and Kurtosis coefficient (CK) were calculated for 20-year data period for each station and we identified the statistics as independent parameters and the coefficients of A and B as dependent parameter, thus analyzed using linear multivariate regression, and regional factors were obtained. In the hydrometric station with 17-027 code, the discharge using the regional factors was calculated and compared with the discharge values of 30 years data. The results showed that there is little difference between the observed and estimated values from regional factors thus this method can be used in projects that require at least 30 years of data.

Short-term and long-term risk factors in gastric cance

While in chronic diseases, such as diabetes, mortalityrates slowly increases with age, in oncological seriesmortality usually changes dramatically during thefollow-up, often in an unpredictable pattern. Forinstance, in gastric cancer mortality peaks in thefirst two years of follow-up and declines thereafter.Also several risk factors, such as TNM stage, largelyaffect mortality in the first years after surgery, whileafterward their effect tends to fade. Temporal trendsin mortality were compared between a gastric cancerseries and a cohort of type 2 diabetic patients. Forthis purpose, 937 patients, undergoing curativegastrectomy with D1/D2/D3 lymphadenectomy forgastric cancer in three GIRCG （Gruppo Italiano RicercaCancro Gastrico = Italian Research Group for GastricCancer） centers, were compared with 7148 type 2diabetic patients from the Verona Diabetes Study. Inthe early/advanced gastric cancer series, mortality fromrecurrence peaked to 200 deaths per 1000 personyears1 year after gastrectomy and then declined,becoming lower than 40 deaths per 1000 person-yearsafter 5 years and lower than 20 deaths after 8 years.Mortality peak occurred earlier in more advanced Tand N tiers. At variance, in the Verona diabetic cohort overall mortality slowly increased during a 10-yearfollow-up, with ageing of the type 2 diabetic patients.Seasonal oscillations were also recorded, mortalitybeing higher during winter than during summer. Alsothe most important prognostic factors presented adifferent temporal pattern in the two diseases： whilethe prognostic significance of T and N stage markedlydecrease over time, differences in survival amongpatients treated with diet, oral hypoglycemic drugsor insulin were consistent throughout the follow-up.Time variations in prognostic significance of main riskfactors, their impact on survival analysis and possiblesolutions were evaluated in another GIRCG series of568 patients with advanced gastric cancer, undergoingcurative gastrectomy with D2/D3 lymphadenectomy.Survival curves in the two different histotypes （intestinaland mixed/diffuse） were superimposed in the first threeyears of follow-up and diverged thereafter. Likewise,survival curves as a function of site （fundus vs body/antrum） started to diverge after the first year. On thecontrary, survival curves differed among age classesfrom the very beginning, due to different post-operativemortality, which increased from 0.5% in patients aged65-74 years to 9.9% in patients aged 75-91 years;this discrepancy later disappeared. Accordingly, theproportional hazards assumption of the Cox modelwas violated, as regards age, site and histology. Tocope with this problem, multivariable survival analysiswas performed by separately considering either thefirst two years of follow-up or subsequent years.Histology and site were significant predictors only aftertwo years, while T and N, although significant bothin the short-term and in the long-term, became lessimportant in the second part of follow-up. Increasingage was associated with higher mortality in the firsttwo years, but not thereafter. Splitting survival timewhen performing survival analysis allows to distinguishbetween short-term and long-term risk factors.Alternative statistical solutions could be to excludepost-operative mortality, to introduce in the modeltime-dependent covariates or to stratify on variablesviolating proportionality assumption.

Study of Holocene glacier degradation in central Asia by isotopic methods for long-term forecast of climate changes

This article presents a summary of our studies of Holocene moraines and glaciers of the Tien-Shan, Pamir, and Himalaya moun- mills with the purpose of providing pattern regularity of the Holocene glaciation decomposition. We developed a method for ob- taining reliable radiocarbon dating of moraines with the use of autochthonous organic matter dispersed in fine-grained morainic material, as well there were shown new possibilities of isotope-oxygen and isotope-uranium analysis for the Holocene glaciations dynamics. We found that Holocene glaciations disintegrate stadiaUy according to the decaying principle, and seven main stages may be distinguished. We achieved the absolute dating of the first three stages, identifying these periods as 8,000, 5,000, and 3,400 years ago. The application of the above-mentioned isotope methods of the Holocene glaciations and moraines study will allow re- searchers to improve the offered model of the Holocene glaciations disintegration; it will be great contribution to salvation of the problem of long-term climatic and glaciations forecast.

Short-term load forecasting based on fuzzy neural network

The fuzzy neural network is applied to the short-term load forecasting. The fuzzy rules and fuzzy membership functions of the network are obtained through fuzzy neural network learming. Three inference algorithms, i.e. themultiplicative inference, the maximum inference and the minimum inference, are used for comparison. The learningalgorithms corresponding to the inference methods are derived from back-propagation algorithm. To validate the fuzzyneural network model, the network is used to Predict short-term load by compaing the network output against the realload data from a local power system supplying electricity to a large steel manufacturer. The experimental results aresatisfactory.

Short-Term Electricity Price Forecasting Using a Combination of Neural Networks and Fuzzy Inference

This paper presents an artificial neural network, ANN, based approach for estimating short-term wholesale electricity prices using past price and demand data. The objective is to utilize the piecewise continuous na-ture of electricity prices on the time domain by clustering the input data into time ranges where the variation trends are maintained. Due to the imprecise nature of cluster boundaries a fuzzy inference technique is em-ployed to handle data that lies at the intersections. As a necessary step in forecasting prices the anticipated electricity demand at the target time is estimated first using a separate ANN. The Australian New-South Wales electricity market data was used to test the system. The developed system shows considerable im-provement in performance compared with approaches that regard price data as a single continuous time se-ries, achieving MAPE of less than 2% for hours with steady prices and 8% for the clusters covering time pe-riods with price spikes.

Long-Term Electricity Demand Forecasting for Malaysia Using Artificial Neural Networks in the Presence of Input and Model Uncertainties

Electricity demand is also known as load in electric power system.This article presents a Long-Term Load Forecasting(LTLF)approach for Malaysia.An Artificial Neural Network(ANN)of 5-layer Multi-Layered Perceptron(MLP)structure has been designed and tested for this purpose.Uncertainties of input variables and ANN model were introduced to obtain the prediction for years 2022 to 2030.Pearson correlation was used to examine the input variables for model construction.The analysis indicates that Primary Energy Supply(PES),population,Gross Domestic Product(GDP)and temperature are strongly correlated.The forecast results by the proposed method(henceforth referred to as UQ-SNN)were compared with the results obtained by a conventional Seasonal Auto-Regressive Integrated Moving Average(SARIMA)model.The R^(2)scores for UQ-SNN and SARIMA are 0.9994 and 0.9787,respectively,indicating that UQ-SNN is more accurate in capturing the non-linearity and the underlying relationships between the input and output variables.The proposed method can be easily extended to include other input variables to increase the model complexity and is suitable for LTLF.With the available input data,UQ-SNN predicts Malaysia will consume 207.22 TWh of electricity,with standard deviation(SD)of 6.10 TWh by 2030.