Attention-Based and Time Series Models for Short-Term Forecasting of COVID-19 Spread

The growing number of COVID-19 cases puts pressure on healthcare services and public institutions worldwide.The pandemic has brought much uncertainty to the global economy and the situation in general.Forecasting methods and modeling techniques are important tools for governments to manage critical situations caused by pandemics,which have negative impact on public health.The main purpose of this study is to obtain short-term forecasts of disease epidemiology that could be useful for policymakers and public institutions to make necessary short-term decisions.To evaluate the effectiveness of the proposed attention-based method combining certain data mining algorithms and the classical ARIMA model for short-term forecasts,data on the spread of the COVID-19 virus in Lithuania is used,the forecasts of epidemic dynamics were examined,and the results were presented in the study.Nevertheless,the approach presented might be applied to any country and other pandemic situations.The COVID-19 outbreak started at different times in different countries,hence some countries have a longer history of the disease with more historical data than others.The paper proposes a novel approach to data registration and machine learning-based analysis using data from attention-based countries for forecast validation to predict trends of the spread of COVID-19 and assess risks.

Application of Grey Theory to Ionospheric Short-term Forecasting

By analysis of historical data of the ionosphere, it is suggested to apply grey theory to ionospheric short-term forecasting, grey range information entropy is defined to determine the optimum grey length of the sample sequence, the prediction model based on residual error is constructed, and the observation data of multiple ionospheric observation stations in China are adopted for test. The prediction result indicates that the average grey range information entropy calculation results reflect the cyclical effects of solar rotation, precision of the forecasting method in high latitudes is higher than low latitudes, and its error is large relatively in more intense solar activity season, the effect of forecasting 1 day in advance of average relative residuals are less than 1 MHz, the average precision is more than 90%. It provides a new way of thinking for the ionospheric foF2 short-term forecast in the future.

Real-Time Short-Term Forecasting Based on Information Management

Traffic congestions and road accidents continue to increase in industry countries. There are three basic strategies to relieve congestion. The first strategy is to increase the transportation infrastructure. However, this strategy is very expensive and can only be accomplished in the long-term. The second strategy is to limit the traffic demand or make traveling more expensive that will be strongly opposed by travelers. The third strategy is to focus on efficient and intelligent utilization of the existing transportation infrastructures. This strategy is gaining more and more attention because it’s well. Currently, the Intelligent Transportation System (ITS) is the most promising approach to implementing the third strategy. Various forecast schemes have been proposed to manage the traffic data. Many studies showed that the moving average schemes offered meaningful results compared to different forecast schemes. This paper considered the moving average schemes, namely, simple moving average, weighted moving average, and exponential moving average. Furthermore, the performance analysis of the shortterm forecast schemes will be discussed. Moreover, the real-time forecast model will consider the abnormal condition detection.

Short-term forecasting optimization algorithms for wind speed along Qinghai-Tibet railway based on different intelligent modeling theories

To protect trains against strong cross-wind along Qinghai-Tibet railway, a strong wind speed monitoring and warning system was developed. And to obtain high-precision wind speed short-term forecasting values for the system to make more accurate scheduling decision, two optimization algorithms were proposed. Using them to make calculative examples for actual wind speed time series from the 18th meteorological station, the results show that: the optimization algorithm based on wavelet analysis method and improved time series analysis method can attain high-precision multi-step forecasting values, the mean relative errors of one-step, three-step, five-step and ten-step forecasting are only 0.30%, 0.75%, 1.15% and 1.65%, respectively. The optimization algorithm based on wavelet analysis method and Kalman time series analysis method can obtain high-precision one-step forecasting values, the mean relative error of one-step forecasting is reduced by 61.67% to 0.115%. The two optimization algorithms both maintain the modeling simple character, and can attain prediction explicit equations after modeling calculation.

Short-Term Forecasting of Urban Water Consumption Based on the Largest Lyapunov Exponent

An approach for short-term forecasting of municipal water consumption was presented based on the largest Lyapunov exponent of chaos theory. The chaotic characteristics of time series of urban water consumption were examined by means of the largest Lyapunov exponent and correlation dimension. By using the largest Lyapunov exponent a short-term forecasting model for urban water consumption was developed, which was compared with the artificial neural network (ANN) approach in a case study. The result indicates that the model based on the largest Lyapunov exponent has higher prediction precision and forecasting stability than the ANN method, and its forecasting mean relative error is 9.6% within its maximum predictable time scale while it is 60.6% beyond the scale.

Investigating Periodic Dependencies to Improve Short-Term Load Forecasting

With a further increase in energy flexibility for customers,short-term load forecasting is essential to provide benchmarks for economic dispatch and real-time alerts in power grids.The electrical load series exhibit periodic patterns and share high associations with metrological data.However,current studies have merely focused on point-wise models and failed to sufficiently investigate the periodic patterns of load series,which hinders the further improvement of short-term load forecasting accuracy.Therefore,this paper improved Autoformer to extract the periodic patterns of load series and learn a representative feature from deep decomposition and reconstruction.In addition,a novel multi-factor attention mechanism was proposed to handle multi-source metrological and numerical weather prediction data and thus correct the forecasted electrical load.The paper also compared the proposed model with various competitive models.As the experimental results reveal,the proposed model outperforms the benchmark models and maintains stability on various types of load consumers.

A Levenberg–Marquardt Based Neural Network for Short-Term Load Forecasting

Short-term load forecasting (STLF) is part and parcel of theefficient working of power grid stations. Accurate forecasts help to detect thefault and enhance grid reliability for organizing sufficient energy transactions.STLF ranges from an hour ahead prediction to a day ahead prediction. Variouselectric load forecasting methods have been used in literature for electricitygeneration planning to meet future load demand. A perfect balance regardinggeneration and utilization is still lacking to avoid extra generation and misusageof electric load. Therefore, this paper utilizes Levenberg–Marquardt(LM) based Artificial Neural Network (ANN) technique to forecast theshort-term electricity load for smart grids in a much better, more precise,and more accurate manner. For proper load forecasting, we take the mostcritical weather parameters along with historical load data in the form of timeseries grouped into seasons, i.e., winter and summer. Further, the presentedmodel deals with each season’s load data by splitting it into weekdays andweekends. The historical load data of three years have been used to forecastweek-ahead and day-ahead load demand after every thirty minutes makingload forecast for a very short period. The proposed model is optimized usingthe Levenberg-Marquardt backpropagation algorithm to achieve results withcomparable statistics. Mean Absolute Percent Error (MAPE), Root MeanSquared Error (RMSE), R2, and R are used to evaluate the model. Comparedwith other recent machine learning-based mechanisms, our model presentsthe best experimental results with MAPE and R2 scores of 1.3 and 0.99,respectively. The results prove that the proposed LM-based ANN modelperforms much better in accuracy and has the lowest error rates as comparedto existing work.

The Influence of Air Pollution Concentrations on Solar Irradiance Forecasting Using CNN-LSTM-mRMR Feature Extraction

Maintaining a steady power supply requires accurate forecasting of solar irradiance,since clean energy resources do not provide steady power.The existing forecasting studies have examined the limited effects of weather conditions on solar radiation such as temperature and precipitation utilizing convolutional neural network(CNN),but no comprehensive study has been conducted on concentrations of air pollutants along with weather conditions.This paper proposes a hybrid approach based on deep learning,expanding the feature set by adding new air pollution concentrations,and ranking these features to select and reduce their size to improve efficiency.In order to improve the accuracy of feature selection,a maximum-dependency and minimum-redundancy(mRMR)criterion is applied to the constructed feature space to identify and rank the features.The combination of air pollution data with weather conditions data has enabled the prediction of solar irradiance with a higher accuracy.An evaluation of the proposed approach is conducted in Istanbul over 12 months for 43791 discrete times,with the main purpose of analyzing air data,including particular matter(PM10 and PM25),carbon monoxide(CO),nitric oxide(NOX),nitrogen dioxide(NO_(2)),ozone(O₃),sulfur dioxide(SO_(2))using a CNN,a long short-term memory network(LSTM),and MRMR feature extraction.Compared with the benchmark models with root mean square error(RMSE)results of 76.2,60.3,41.3,32.4,there is a significant improvement with the RMSE result of 5.536.This hybrid model presented here offers high prediction accuracy,a wider feature set,and a novel approach based on air concentrations combined with weather conditions for solar irradiance prediction.

Seasonal Characteristics of Forecasting Uncertainties in Surface PM_(2.5)Concentration Associated with Forecast Lead Time over the Beijing-Tianjin-Hebei Region

Forecasting uncertainties among meteorological fields have long been recognized as the main limitation on the accuracy and predictability of air quality forecasts.However,the particular impact of meteorological forecasting uncertainties on air quality forecasts specific to different seasons is still not well known.In this study,a series of forecasts with different forecast lead times for January,April,July,and October of 2018 are conducted over the Beijing-Tianjin-Hebei(BTH)region and the impacts of meteorological forecasting uncertainties on surface PM_(2.5)concentration forecasts with each lead time are investigated.With increased lead time,the forecasted PM_(2.5)concentrations significantly change and demonstrate obvious seasonal variations.In general,the forecasting uncertainties in monthly mean surface PM_(2.5)concentrations in the BTH region due to lead time are the largest(80%)in spring,followed by autumn(~50%),summer(~40%),and winter(20%).In winter,the forecasting uncertainties in total surface PM_(2.5)mass due to lead time are mainly due to the uncertainties in PBL heights and hence the PBL mixing of anthropogenic primary particles.In spring,the forecasting uncertainties are mainly from the impacts of lead time on lower-tropospheric northwesterly winds,thereby further enhancing the condensation production of anthropogenic secondary particles by the long-range transport of natural dust.In summer,the forecasting uncertainties result mainly from the decrease in dry and wet deposition rates,which are associated with the reduction of near-surface wind speed and precipitation rate.In autumn,the forecasting uncertainties arise mainly from the change in the transport of remote natural dust and anthropogenic particles,which is associated with changes in the large-scale circulation.

Scientific Advances and Weather Services of the China Meteorological Administration’s National Forecasting Systems during the Beijing 2022 Winter Olympics

Since the Beijing 2022 Winter Olympics was the first Winter Olympics in history held in continental winter monsoon climate conditions across complex terrain areas,there is a deficiency of relevant research,operational techniques,and experience.This made providing meteorological services for this event particularly challenging.The China Meteorological Administration(CMA)Earth System Modeling and Prediction Centre,achieved breakthroughs in research on short-and medium-term deterministic and ensemble numerical predictions.Several key technologies crucial for precise winter weather services during the Winter Olympics were developed.A comprehensive framework,known as the Operational System for High-Precision Weather Forecasting for the Winter Olympics,was established.Some of these advancements represent the highest level of capabilities currently available in China.The meteorological service provided to the Beijing 2022 Games also exceeded previous Winter Olympic Games in both variety and quality.This included achievements such as the“100-meter level,minute level”downscaled spatiotemporal resolution and forecasts spanning 1 to 15 days.Around 30 new technologies and over 60 kinds of products that align with the requirements of the Winter Olympics Organizing Committee were developed,and many of these techniques have since been integrated into the CMA’s operational national forecasting systems.These accomplishments were facilitated by a dedicated weather forecasting and research initiative,in conjunction with the preexisting real-time operational forecasting systems of the CMA.This program represents one of the five subprograms of the WMO’s high-impact weather forecasting demonstration project(SMART2022),and continues to play an important role in their Regional Association(RA)II Research Development Project(Hangzhou RDP).Therefore,the research accomplishments and meteorological service experiences from this program will be carried forward into forthcoming highimpact weather forecasting activities.This article provides an overview and assessment of this program and the operational national forecasting systems.

Better use of experience from other reservoirs for accurate production forecasting by learn-to-learn method

To assess whether a development strategy will be profitable enough,production forecasting is a crucial and difficult step in the process.The development history of other reservoirs in the same class tends to be studied to make predictions accurate.However,the permeability field,well patterns,and development regime must all be similar for two reservoirs to be considered in the same class.This results in very few available experiences from other reservoirs even though there is a lot of historical information on numerous reservoirs because it is difficult to find such similar reservoirs.This paper proposes a learn-to-learn method,which can better utilize a vast amount of historical data from various reservoirs.Intuitively,the proposed method first learns how to learn samples before directly learning rules in samples.Technically,by utilizing gradients from networks with independent parameters and copied structure in each class of reservoirs,the proposed network obtains the optimal shared initial parameters which are regarded as transferable information across different classes.Based on that,the network is able to predict future production indices for the target reservoir by only training with very limited samples collected from reservoirs in the same class.Two cases further demonstrate its superiority in accuracy to other widely-used network methods.

Generalized load graphical forecasting method based on modal decomposition

In a“low-carbon”context,the power load is affected by the coupling of multiple factors,which gradually evolves from the traditional“pure load”to the generalized load with the dual characteristics of“load+power supply.”Traditional time-series forecasting methods are no longer suitable owing to the complexity and uncertainty associated with generalized loads.From the perspective of image processing,this study proposes a graphical short-term prediction method for generalized loads based on modal decomposition.First,the datasets are normalized and feature-filtered by comparing the results of Xtreme gradient boosting,gradient boosted decision tree,and random forest algorithms.Subsequently,the generalized load data are decomposed into three sets of modalities by modal decomposition,and red,green,and blue(RGB)images are generated using them as the pixel values of the R,G,and B channels.The generated images are diversified,and an optimized DenseNet neural network was used for training and prediction.Finally,the base load,wind power,and photovoltaic power generation data are selected,and the characteristic curves of the generalized load scenarios under different permeabilities of wind power and photovoltaic power generation are obtained using the density-based spatial clustering of applications with noise algorithm.Based on the proposed graphical forecasting method,the feasibility of the generalized load graphical forecasting method is verified by comparing it with the traditional time-series forecasting method.

Comparison among the UECM Model, and the Composite Model in Forecasting Malaysian Imports

For more than a century, forecasting models have been crucial in a variety of fields. Models can offer the most accurate forecasting outcomes if error terms are normally distributed. Finding a good statistical model for time series predicting imports in Malaysia is the main target of this study. The decision made during this study mostly addresses the unrestricted error correction model (UECM), and composite model (Combined regression—ARIMA). The imports of Malaysia from the first quarter of 1991 to the third quarter of 2022 are employed in this study’s quarterly time series data. The forecasting outcomes of the current study demonstrated that the composite model offered more probabilistic data, which improved forecasting the volume of Malaysia’s imports. The composite model, and the UECM model in this study are linear models based on responses to Malaysia’s imports. Future studies might compare the performance of linear and nonlinear models in forecasting.

CALTM:A Context-Aware Long-Term Time-Series Forecasting Model

Time series data plays a crucial role in intelligent transportation systems.Traffic flow forecasting represents a precise estimation of future traffic flow within a specific region and time interval.Existing approaches,including sequence periodic,regression,and deep learning models,have shown promising results in short-term series forecasting.However,forecasting scenarios specifically focused on holiday traffic flow present unique challenges,such as distinct traffic patterns during vacations and the increased demand for long-term forecastings.Consequently,the effectiveness of existing methods diminishes in such scenarios.Therefore,we propose a novel longterm forecasting model based on scene matching and embedding fusion representation to forecast long-term holiday traffic flow.Our model comprises three components:the similar scene matching module,responsible for extracting Similar Scene Features;the long-short term representation fusion module,which integrates scenario embeddings;and a simple fully connected layer at the head for making the final forecasting.Experimental results on real datasets demonstrate that our model outperforms other methods,particularly in medium and long-term forecasting scenarios.

A Novel Hybrid Ensemble Learning Approach for Enhancing Accuracy and Sustainability in Wind Power Forecasting

Accurate wind power forecasting is critical for system integration and stability as renewable energy reliance grows.Traditional approaches frequently struggle with complex data and non-linear connections. This article presentsa novel approach for hybrid ensemble learning that is based on rigorous requirements engineering concepts.The approach finds significant parameters influencing forecasting accuracy by evaluating real-time Modern-EraRetrospective Analysis for Research and Applications (MERRA2) data from several European Wind farms usingin-depth stakeholder research and requirements elicitation. Ensemble learning is used to develop a robust model,while a temporal convolutional network handles time-series complexities and data gaps. The ensemble-temporalneural network is enhanced by providing different input parameters including training layers, hidden and dropoutlayers along with activation and loss functions. The proposed framework is further analyzed by comparing stateof-the-art forecasting models in terms of Root Mean Squared Error (RMSE) and Mean Absolute Error (MAE),respectively. The energy efficiency performance indicators showed that the proposed model demonstrates errorreduction percentages of approximately 16.67%, 28.57%, and 81.92% for MAE, and 38.46%, 17.65%, and 90.78%for RMSE for MERRAWind farms 1, 2, and 3, respectively, compared to other existingmethods. These quantitativeresults show the effectiveness of our proposed model with MAE values ranging from 0.0010 to 0.0156 and RMSEvalues ranging from 0.0014 to 0.0174. This work highlights the effectiveness of requirements engineering in windpower forecasting, leading to enhanced forecast accuracy and grid stability, ultimately paving the way for moresustainable energy solutions.

Research on Short-Term Load Forecasting of Distribution Stations Based on the Clustering Improvement Fuzzy Time Series Algorithm

An improved fuzzy time series algorithmbased on clustering is designed in this paper.The algorithm is successfully applied to short-term load forecasting in the distribution stations.Firstly,the K-means clustering method is used to cluster the data,and the midpoint of two adjacent clustering centers is taken as the dividing point of domain division.On this basis,the data is fuzzed to form a fuzzy time series.Secondly,a high-order fuzzy relation with multiple antecedents is established according to the main measurement indexes of power load,which is used to predict the short-term trend change of load in the distribution stations.Matlab/Simulink simulation results show that the load forecasting errors of the typical fuzzy time series on the time scale of one day and one week are[−50,20]and[−50,30],while the load forecasting errors of the improved fuzzy time series on the time scale of one day and one week are[−20,15]and[−20,25].It shows that the fuzzy time series algorithm improved by clustering improves the prediction accuracy and can effectively predict the short-term load trend of distribution stations.

Short-Term Power Load Forecasting with Hybrid TPA-BiLSTM Prediction Model Based on CSSA

Since the existing prediction methods have encountered difficulties in processing themultiple influencing factors in short-term power load forecasting,we propose a bidirectional long short-term memory(BiLSTM)neural network model based on the temporal pattern attention(TPA)mechanism.Firstly,based on the grey relational analysis,datasets similar to forecast day are obtained.Secondly,thebidirectional LSTM layermodels the data of thehistorical load,temperature,humidity,and date-type and extracts complex relationships between data from the hidden row vectors obtained by the BiLSTM network,so that the influencing factors(with different characteristics)can select relevant information from different time steps to reduce the prediction error of the model.Simultaneously,the complex and nonlinear dependencies between time steps and sequences are extracted by the TPA mechanism,so the attention weight vector is constructed for the hidden layer output of BiLSTM and the relevant variables at different time steps are weighted to influence the input.Finally,the chaotic sparrow search algorithm(CSSA)is used to optimize the hyperparameter selection of the model.The short-term power load forecasting on different data sets shows that the average absolute errors of short-termpower load forecasting based on our method are 0.876 and 4.238,respectively,which is lower than other forecastingmethods,demonstrating the accuracy and stability of our model.

Effects of data smoothing and recurrent neural network(RNN)algorithms for real-time forecasting of tunnel boring machine(TBM)performance

Tunnel boring machines(TBMs)have been widely utilised in tunnel construction due to their high efficiency and reliability.Accurately predicting TBM performance can improve project time management,cost control,and risk management.This study aims to use deep learning to develop real-time models for predicting the penetration rate(PR).The models are built using data from the Changsha metro project,and their performances are evaluated using unseen data from the Zhengzhou Metro project.In one-step forecast,the predicted penetration rate follows the trend of the measured penetration rate in both training and testing.The autoregressive integrated moving average(ARIMA)model is compared with the recurrent neural network(RNN)model.The results show that univariate models,which only consider historical penetration rate itself,perform better than multivariate models that take into account multiple geological and operational parameters(GEO and OP).Next,an RNN variant combining time series of penetration rate with the last-step geological and operational parameters is developed,and it performs better than other models.A sensitivity analysis shows that the penetration rate is the most important parameter,while other parameters have a smaller impact on time series forecasting.It is also found that smoothed data are easier to predict with high accuracy.Nevertheless,over-simplified data can lose real characteristics in time series.In conclusion,the RNN variant can accurately predict the next-step penetration rate,and data smoothing is crucial in time series forecasting.This study provides practical guidance for TBM performance forecasting in practical engineering.

Building the ARIMA Model for Forecasting the Production of Vietnam’s Coffee Export

Coffee is a significant industry, accounting for 3% of Vietnam’s GDP, with annual export turnover consistently exceeding USD 3 billion. Despite global economic challenges affecting purchasing power at various times, Vietnam’s coffee exports in December 2023 continued to surge, reaching the highest level in the past 9 months at 190,000 tons, a 59.3% increase compared to November 2023, but still a slight 3.5% decrease from the same period last year. The export turnover reached USD 538 million, a 51% increase from November 2023 and a 26.4% increase from the same period last year. Therefore, forecasting the coffee export volume holds significant importance for coffee producers nationwide. This research employs the Box-Jenkins method to construct an ARIMA model for forecasting Vietnam’s coffee export volume based on annual data published by the General Statistics Office. Results indicate that among the models considered, the ARIMA(1, 1, 2) model is the most suitable. The study also provides short-term forecasts for Vietnam’s coffee export volume. However, the current model is limited to forecasting and is not yet optimized, as the assumed linearity in the model is a simplification.

Maximizing Supermarket Profits:Data-Driven Strategies for Pricing,Sales,and Forecasting

The actual circumstances of daily life are crucial for the purchasing and pricing strategies of supermarkets.Developing strategies based on these circumstances can assist businesses in ensuring profits and fostering win-win cooperation.This paper explores methods to maximize profit through purchasing and sales strategies.Initially,the relevant data for various categories of vegetables is integrated.Through histograms,their sales patterns are directly understood,highlighting the most popular vegetables.Upon analyzing each vegetable category,it becomes evident that their sales data do not conform to normal distributions.Therefore,Spearman correlation coefficients are calculated,revealing strong correlations between certain categories,such as aquatic roots and edible fungi.A line chart depicting the top ten selling vegetables indicates a noticeable periodicity.Traditional fitting methods struggle to adequately model the sales of each vegetable category and their relationship with cost-plus pricing.To address this,additional factors such as holidays,weeks,and months are incorporated using techniques like random forest regression.This approach yields cost-plus pricing dependence curves that better capture the relationship,while effectively managing noise.Regarding sales volume prediction,the original data displays significant volatility,necessitating the handling of outliers using the threshold method.For missing data,linear interpolation is employed to mitigate the impact of continuous missing values on prediction accuracy.Subsequently,Adam-optimized long short-term memory(LSTM)networks are utilized to forecast incoming quantities for the next seven days.By extrapolating from normal sales volume,market capacity is estimated,allowing for additional sales through discount strategies.This framework has the potential to increase original income by 1.1 times.