A New Multidimensional Time Series Forecasting Method Based on the EOF Iteration Scheme

In this paper a new .mnultidimensional time series forecasting scheme based on the empirical orthogonal function (EOF) stepwise iteration process is introduced. The scheme is tested in a series of forecast experiments of Nino3 SST anomalies and Tahiti-Darwin SO index. The results show that the scheme is feasible and ENSO predictable.

Performance evaluation of series and parallel strategies for financial time series forecasting

Background:Improving financial time series forecasting is one of the most challenging and vital issues facing numerous financial analysts and decision makers.Given its direct impact on related decisions,various attempts have been made to achieve more accurate and reliable forecasting results,of which the combining of individual models remains a widely applied approach.In general,individual models are combined under two main strategies:series and parallel.While it has been proven that these strategies can improve overall forecasting accuracy,the literature on time series forecasting remains vague on the choice of an appropriate strategy to generate a more accurate hybrid model.Methods:Therefore,this study’s key aim is to evaluate the performance of series and parallel strategies to determine a more accurate one.Results:Accordingly,the predictive capabilities of five hybrid models are constructed on the basis of series and parallel strategies compared with each other and with their base models to forecast stock price.To do so,autoregressive integrated moving average(ARIMA)and multilayer perceptrons(MLPs)are used to construct two series hybrid models,ARIMA-MLP and MLP-ARIMA,and three parallel hybrid models,simple average,linear regression,and genetic algorithm models.Conclusion:The empirical forecasting results for two benchmark datasets,that is,the closing of the Shenzhen Integrated Index(SZII)and that of Standard and Poor’s 500(S&P 500),indicate that although all hybrid models perform better than at least one of their individual components,the series combination strategy produces more accurate hybrid models for financial time series forecasting.

Comparison of Missing Data Imputation Methods in Time Series Forecasting

Time series forecasting has become an important aspect of data analysis and has many real-world applications.However,undesirable missing values are often encountered,which may adversely affect many forecasting tasks.In this study,we evaluate and compare the effects of imputationmethods for estimating missing values in a time series.Our approach does not include a simulation to generate pseudo-missing data,but instead perform imputation on actual missing data and measure the performance of the forecasting model created therefrom.In an experiment,therefore,several time series forecasting models are trained using different training datasets prepared using each imputation method.Subsequently,the performance of the imputation methods is evaluated by comparing the accuracy of the forecasting models.The results obtained from a total of four experimental cases show that the k-nearest neighbor technique is the most effective in reconstructing missing data and contributes positively to time series forecasting compared with other imputation methods.

Artificial Neural Networks for COVID-19 Time Series Forecasting

Today, COVID-19 pandemic has become the greatest worldwide threat, as it spreads rapidly among individuals in most countries around the world. This study concerns the problem of daily prediction of new COVID-19 cases in Italy, aiming to find the best predictive model for daily infection number in countries with a large number of confirmed cases. Finding the most accurate forecasting model would help allocate medical resources, handle the spread of the pandemic and get more prepared in terms of health care systems. We compare the forecasting performance of linear and nonlinear forecasting models using daily COVID-19 data for the period between 22 February 2020 and 10 January 2022. We discuss various forecasting approaches, including an Autoregressive Integrated Moving Average (ARIMA) model, a Nonlinear Autoregressive Neural Network (NARNN) model, a TBATS model and Exponential Smoothing on the data collected from 22 February 2020 to 10 January 2022 and compared their accuracy using the data collected from 26 March 2020 to 04 April 2020, choosing the model with the lowest Mean Absolute Percentage Error (MAPE) value. Since the linear models seem not to easily follow the nonlinear patterns of daily confirmed COVID-19 cases, Artificial Neural Network (ANN) has been successfully applied to solve problems of forecasting nonlinear models. The model has been used for daily prediction of COVID-19 cases for the next 20 days without any additional intervention. The prediction model can be applied to other countries struggling with the COVID-19 pandemic and to any possible future pandemics.

Effects of data smoothing and recurrent neural network(RNN)algorithms for real-time forecasting of tunnel boring machine(TBM)performance

Tunnel boring machines(TBMs)have been widely utilised in tunnel construction due to their high efficiency and reliability.Accurately predicting TBM performance can improve project time management,cost control,and risk management.This study aims to use deep learning to develop real-time models for predicting the penetration rate(PR).The models are built using data from the Changsha metro project,and their performances are evaluated using unseen data from the Zhengzhou Metro project.In one-step forecast,the predicted penetration rate follows the trend of the measured penetration rate in both training and testing.The autoregressive integrated moving average(ARIMA)model is compared with the recurrent neural network(RNN)model.The results show that univariate models,which only consider historical penetration rate itself,perform better than multivariate models that take into account multiple geological and operational parameters(GEO and OP).Next,an RNN variant combining time series of penetration rate with the last-step geological and operational parameters is developed,and it performs better than other models.A sensitivity analysis shows that the penetration rate is the most important parameter,while other parameters have a smaller impact on time series forecasting.It is also found that smoothed data are easier to predict with high accuracy.Nevertheless,over-simplified data can lose real characteristics in time series.In conclusion,the RNN variant can accurately predict the next-step penetration rate,and data smoothing is crucial in time series forecasting.This study provides practical guidance for TBM performance forecasting in practical engineering.

Multivariate Time Series Forecasting with Transfer Entropy Graph

Multivariate Time Series(MTS)forecasting is an essential problem in many fields.Accurate forecasting results can effectively help in making decisions.To date,many MTS forecasting methods have been proposed and widely applied.However,these methods assume that the predicted value of a single variable is affected by all other variables,ignoring the causal relationship among variables.To address the above issue,we propose a novel end-to-end deep learning model,termed graph neural network with neural Granger causality,namely CauGNN,in this paper.To characterize the causal information among variables,we introduce the neural Granger causality graph in our model.Each variable is regarded as a graph node,and each edge represents the casual relationship between variables.In addition,convolutional neural network filters with different perception scales are used for time series feature extraction,to generate the feature of each node.Finally,the graph neural network is adopted to tackle the forecasting problem of the graph structure generated by the MTS.Three benchmark datasets from the real world are used to evaluate the proposed CauGNN,and comprehensive experiments show that the proposed method achieves state-of-the-art results in the MTS forecasting task.

AN ENSEMBLE MODEL OF ARIMA AND ANN WITH RESTRICTED BOLTZMANN MACHINE BASED ON DECOMPOSITION OF DISCRETE WAVELET TRANSFORM FOR TIME SERIES FORECASTING

Time series forecasting research area mainly focuses on developing effective forecasting models toimprove prediction accuracy. An ensemble model composed of autoregressive integrated movingaverage （ARIMA）, artificial neural network （ANN）, restricted Boltzmann machines （RBM）, anddiscrete wavelet transform （DWT） is presented in this paper. In the proposed model, DWT firstdecomposes time series into approximation and detail. Then Khashei and Bijari＇s model, which is anensemble model of ARIMA and ANN, is applied to the approximation and detail to extract their bothlinear and nonlinear components and fit the relationship between the components as a function insteadof additive relationship. Furthermore, RBM is used to perform pre-training for generating initialweights and biases based on inputs feature for ANN. Finally, the forecasted approximation and detailare combined to obtain final forecasting. The forecasting capability of the proposed model is testedwith three well-known time series： sunspot, Canadian lynx, exchange rate time series. The predictionperformance is compared to the other six forecasting models. The results indicate that the proposedmodel gives the best performance in all three data sets and all three measures （i.e. MSE, MAE andMAPE）.

Seasonal Based Electricity Demand Forecasting Using Time Series Analysis

Consumption of the electric power highly depends on the Season under consideration. The various means of power generation methods using renewable resources such as sunlight, wind, rain, tides, and waves are season dependent. This paves the way for analyzing the demand for electric power based on various Seasons. Many traditional methods are utilized previously for the seasonal based electricity demand forecasting. With the development of the advanced tools, these methods are replaced by efficient forecasting techniques. In this paper, a WEKA time series forecasting is being done for the electric power demand for the three seasons such as summer, winter and rainy seasons. The monthly electric consumption data of domestic category is collected from Tamil Nadu Electricity Board (TNEB). Data collected has been pruned based on the three seasons. The WEKA learning algorithms such as Multilayer Perceptron, Support Vector Machine, Linear Regression, and Gaussian Process are used for implementation. The Mean Absolute Error (MAE) and Direction Accuracy (DA) are calculated for the WEKA learning algorithms and they are compared to find the best learning algorithm. The Support Vector Machine algorithm exhibits low Mean Absolute Error and high Direction Accuracy than other WEKA learning algorithms. Hence, the Support Vector Machine learning algorithm is proven to be the WEKA learning algorithm for seasonal based electricity demand forecasting. The need of the hour is to predict and act in the deficit power. This paper is a prelude for such activity and an eye opener in this field.

Multi-factor high-order intuitionistic fuzzy timeseries forecasting model

Fuzzy sets theory cannot describe the neutrality degreeof data, which has largely limited the objectivity of fuzzy time seriesin uncertain data forecasting. With this regard, a multi-factor highorderintuitionistic fuzzy time series forecasting model is built. Inthe new model, a fuzzy clustering algorithm is used to get unequalintervals, and a more objective technique for ascertaining membershipand non-membership functions of the intuitionistic fuzzy setis proposed. On these bases, forecast rules based on multidimensionalintuitionistic fuzzy modus ponens inference are established.Finally, contrast experiments on the daily mean temperature ofBeijing are carried out, which show that the novel model has aclear advantage of improving the forecast accuracy.

Massive feature extraction for explaining and foretelling hydroclimatic time series forecastability at the global scale

Statistical analyses and descriptive characterizations are sometimes assumed to be offering information on time series forecastability.Despite the scientific interest suggested by such assumptions,the relationships between descriptive time series features(e.g.,temporal dependence,entropy,seasonality,trend and linearity features)and actual time series forecastability(quantified by issuing and assessing forecasts for the past)are scarcely studied and quantified in the literature.In this work,we aim to fill in this gap by investigating such relationships,and the way that they can be exploited for understanding hydroclimatic forecastability and its patterns.To this end,we follow a systematic framework bringing together a variety of–mostly new for hydrology–concepts and methods,including 57 descriptive features and nine seasonal time series forecasting methods(i.e.,one simple,five exponential smoothing,two state space and one automated autoregressive fractionally integrated moving average methods).We apply this framework to three global datasets originating from the larger Global Historical Climatology Network(GHCN)and Global Streamflow Indices and Metadata(GSIM)archives.As these datasets comprise over 13,000 monthly temperature,precipitation and river flow time series from several continents and hydroclimatic regimes,they allow us to provide trustable characterizations and interpretations of 12-month ahead hydroclimatic forecastability at the global scale.We first find that the exponential smoothing and state space methods for time series forecasting are rather equally efficient in identifying an upper limit of this forecastability in terms of Nash-Sutcliffe efficiency,while the simple method is shown to be mostly useful in identifying its lower limit.We then demonstrate that the assessed forecastability is strongly related to several descriptive features,including seasonality,entropy,(partial)autocorrelation,stability,(non)linearity,spikiness and heterogeneity features,among others.We further(i)show that,if such descriptive information is available for a monthly hydroclimatic time series,we can even foretell the quality of its future forecasts with a considerable degree of confidence,and(ii)rank the features according to their efficiency in explaining and foretelling forecastability.We believe that the obtained rankings are of key importance for understanding forecastability.Spatial forecastability patterns are also revealed through our experiments,with East Asia(Europe)being characterized by larger(smaller)monthly temperature time series forecastability and the Indian subcontinent(Australia)being characterized by larger(smaller)monthly precipitation time series forecastability,compared to other continental-scale regions,and less notable differences characterizing monthly river flow from continent to continent.A comprehensive interpretation of such patters through massive feature extraction and feature-based time series clustering is shown to be possible.Indeed,continental-scale regions characterized by different degrees of forecastability are also attributed to different clusters or mixtures of clusters(because of their essential differences in terms of descriptive features).

A Measurement Study of the Ethereum Underlying P2P Network

This work carried out a measurement study of the Ethereum Peer-to-Peer(P2P)network to gain a better understanding of the underlying nodes.Ethereum was applied because it pioneered distributed applications,smart contracts,and Web3.Moreover,its application layer language“Solidity”is widely used in smart contracts across different public and private blockchains.To this end,we wrote a new Ethereum client based on Geth to collect Ethereum node information.Moreover,various web scrapers have been written to collect nodes’historical data fromthe Internet Archive and the Wayback Machine project.The collected data has been compared with two other services that harvest the number of Ethereumnodes.Ourmethod has collectedmore than 30% more than the other services.The data trained a neural network model regarding time series to predict the number of online nodes in the future.Our findings show that there are less than 20% of the same nodes daily,indicating thatmost nodes in the network change frequently.It poses a question of the stability of the network.Furthermore,historical data shows that the top ten countries with Ethereum clients have not changed since 2016.The popular operating system of the underlying nodes has shifted from Windows to Linux over time,increasing node security.The results have also shown that the number of Middle East and North Africa(MENA)Ethereum nodes is neglected compared with nodes recorded from other regions.It opens the door for developing new mechanisms to encourage users from these regions to contribute to this technology.Finally,the model has been trained and demonstrated an accuracy of 92% in predicting the future number of nodes in the Ethereum network.

A Novel Hybrid FA-Based LSSVR Learning Paradigm for Hydropower Consumption Forecasting

Due to the nonlinearity and nonstationary of hydropower market data, a novel hybrid learning paradigm is proposed to predict hydropower consumption, by incorporating firefly algorithm （FA） into least square support vector regression （LSSVR）, i.e., FA-based LSSVR model. In the novel model, the powerful and effective artificial intelligence （AI） technique, i.e., LSSVR, is employed to forecast hydropower consumption. Furthermore, a promising AI optimization tool, i.e., FA, is espe- cially introduced to address the crucial but difficult task of parameters determination in LSSVR （e.g., hyper and kernel function parameters）. With the Chinese hydropower consumption as sample data, the empirical study has statistically confirmed the superiority of the novel FA-based LSSVR model to other benchmark models （including existing popular traditional econometric models, AI models and similar hybrid LSSVRs with other popular parameter searching tools）~ in terms of level and direc- tional accuracy. The empirical results also imply that the hybrid FA-based LSSVR learning paradigm with powerful forecasting tool and parameters optimization method can be employed as an effective forecasting tool for not only hydropower consumption but also other complex data.

Forecasting Damage Mechanics By Deep Learning

We in this paper exploit time series algorithm based deep learning in forecasting damage mechanics problems.The methodologies that are able to work accurately for less computational and resolving attempts are a significant demand nowadays.Relied on learning an amount of information from given data,the long short-term memory(LSTM)method and multi-layer neural networks(MNN)method are applied to predict solutions.Numerical examples are implemented for predicting fracture growth rates of L-shape concrete specimen under load ratio,single-edge-notched beam forced by 4-point shear and hydraulic fracturing in permeable porous media problems such as storage-toughness fracture regime and fracture-height growth in Marcellus shale.The predicted results by deep learning algorithms are well-agreed with experimental data.

Machine Learning and Classical Forecasting Methods Based Decision Support Systems for COVID-19

From late 2019 to the present day,the coronavirus outbreak tragically affected the whole world and killed tens of thousands of people.Many countries have taken very stringent measures to alleviate the effects of the coronavirus disease 2019(COVID-19)and are still being implemented.In this study,various machine learning techniques are implemented to predict possible confirmed cases and mortality numbers for the future.According to these models,we have tried to shed light on the future in terms of possible measures to be taken or updating the current measures.Support Vector Machines(SVM),Holt-Winters,Prophet,and Long-Short Term Memory(LSTM)forecasting models are applied to the novel COVID-19 dataset.According to the results,the Prophet model gives the lowest Root Mean Squared Error(RMSE)score compared to the other three models.Besides,according to this model,a projection for the future COVID-19 predictions of Turkey has been drawn and aimed to shape the current measures against the coronavirus.

Runtime Power Allocation Based on Multi-GPU Utilization in GAMESS

To improve the power consumption of parallel applications at the runtime, modern processors provide frequency scaling and power limiting capabilities. In this work, a runtime strategy is proposed to maximize performance under a given power budget by distributing the available power according to the relative GPU utilization. Time series forecasting methods were used to develop workload prediction models that provide accurate prediction of GPU utilization during application execution. Experiments were performed on a multi-GPU computing platform DGX-1 equipped with eight NVIDIA V100 GPUs used for quantum chemistry calculations in the GAMESS package. For a limited power budget, the proposed strategy may deliver as much as hundred times better GAMESS performance than that obtained when the power is distributed equally among all the GPUs.

Inventory Management and Demand Forecasting Improvement of a Forecasting Model Based on Artificial Neural Networks

Forecasting is predicting or estimating a future event or trend.Supply chains have been constantly growing in most countries ever since the industrial revolution of the 18th century.As the competitiveness between supply chains intensifies day by day,companies are shifting their focus to predictive analytics techniques to minimize costs and boost productivity and profits.Excessive inventory(overstock)and stock outs are very significant issues for suppliers.Excessive inventory levels can lead to loss of revenue because the company's capital is tied up in excess inventory.Excess inventory can also lead to increased storage,insurance costs and labor as well as lower and degraded quality based on the nature of the product.Shortages or out of stock can lead to lost sales and a decline in customer contentment and loyalty to the store.If clients are unable to find the right products on the shelves,they may switch to another vendor or purchase alternative items.Demand forecasting is valuable for planning,scheduling and improving the coordination of all supply chain activities.This paper discusses the use of neural networks for seasonal time series forecasting.Our objective is to evaluate the contribution of the correct choice of the transfer function by proposing a new form of the transfer function to improve the quality of the forecast.

Holt-Winters Algorithm to Predict the Stock Value Using Recurrent Neural Network

Prediction of stock market value is highly risky because it is based on the concept of Time Series forecasting system that can be used for investments in a safe environment with minimized chances of loss.The proposed model uses a real time dataset offifteen Stocks as input into the system and based on the data,predicts or forecast future stock prices of different companies belonging to different sectors.The dataset includes approximatelyfifteen companies from different sectors and forecasts their results based on which the user can decide whether to invest in the particular company or not;the forecasting is done for the next quarter.Our model uses 3 main concepts for forecasting results.Thefirst one is for stocks that show periodic change throughout the season,the‘Holt-Winters Triple Exponential Smoothing’.3 basic things taken into conclusion by this algorithm are Base Level,Trend Level and Seasoning Factor.The value of all these are calculated by us and then decomposition of all these factors is done by the Holt-Winters Algorithm.The second concept is‘Recurrent Neural Network’.The specific model of recurrent neural network that is being used is Long-Short Term Memory and it’s the same as the Normal Neural Network,the only difference is that each intermediate cell is a memory cell and retails its value till the next feedback loop.The third concept is Recommendation System whichfilters and predict the rating based on the different factors.

An Improved Granulated Convolutional Neural Network Data Analysis Model for COVID-19 Prediction

As COVID-19 poses a major threat to people’s health and economy,there is an urgent need for forecasting methodologies that can anticipate its trajectory efficiently.In non-stationary time series forecasting jobs,there is frequently a hysteresis in the anticipated values relative to the real values.The multilayer deep-time convolutional network and a feature fusion network are combined in this paper’s proposal of an enhanced Multilayer Deep Time Convolutional Neural Network(MDTCNet)for COVID-19 prediction to address this problem.In particular,it is possible to record the deep features and temporal dependencies in uncertain time series,and the features may then be combined using a feature fusion network and a multilayer perceptron.Last but not least,the experimental verification is conducted on the prediction task of COVID-19 real daily confirmed cases in the world and the United States with uncertainty,realizing the short-term and long-term prediction of COVID-19 daily confirmed cases,and verifying the effectiveness and accuracy of the suggested prediction method,as well as reducing the hysteresis of the prediction results.

A Deep-Learning Prediction Model for Imbalanced Time Series Data Forecasting

Time series forecasting has attracted wide attention in recent decades.However,some time series are imbalanced and show different patterns between special and normal periods,leading to the prediction accuracy degradation of special periods.In this paper,we aim to develop a unified model to alleviate the imbalance and thus improving the prediction accuracy for special periods.This task is challenging because of two reasons:(1)the temporal dependency of series,and(2)the tradeoff between mining similar patterns and distinguishing different distributions between different periods.To tackle these issues,we propose a self-attention-based time-varying prediction model with a two-stage training strategy.First,we use an encoder–decoder module with the multi-head self-attention mechanism to extract common patterns of time series.Then,we propose a time-varying optimization module to optimize the results of special periods and eliminate the imbalance.Moreover,we propose reverse distance attention in place of traditional dot attention to highlight the importance of similar historical values to forecast results.Finally,extensive experiments show that our model performs better than other baselines in terms of mean absolute error and mean absolute percentage error.

Monte Carlo forecasting of time series data using Polynomial-Fourier series model

The perishable nature of tourism products and services makes forecasting an important tool for tourism planning,especially in the current COVID-19 pandemic time.The forecast assists tourism organizations in decision-making regarding resource allocations to avoid shortcomings.This study is motivated by the need to model periodic time series with linear and nonlinear trends.A hybrid Polynomial-Fourier series model that uses the combination of polynomial and Fourier fittings to capture and forecast time series data was proposed.The proposed model is applied to monthly foreign visitors to Turkey from January 2014 to August 2020 dataset and diagnostic checks show that the proposed model produces a statistically good fit.To improve the model forecast,a Monte Carlo simulation scheme with 100 simulation paths is applied to the model residue.The mean of the 100 simulation paths within±2σbounds from the model curve was taken and found to give statistically acceptable results.