Deep Learning for Financial Time Series Prediction:A State-of-the-Art Review of Standalone and HybridModels

Financial time series prediction,whether for classification or regression,has been a heated research topic over the last decade.While traditional machine learning algorithms have experienced mediocre results,deep learning has largely contributed to the elevation of the prediction performance.Currently,the most up-to-date review of advanced machine learning techniques for financial time series prediction is still lacking,making it challenging for finance domain experts and relevant practitioners to determine which model potentially performs better,what techniques and components are involved,and how themodel can be designed and implemented.This review article provides an overview of techniques,components and frameworks for financial time series prediction,with an emphasis on state-of-the-art deep learning models in the literature from2015 to 2023,including standalonemodels like convolutional neural networks(CNN)that are capable of extracting spatial dependencies within data,and long short-term memory(LSTM)that is designed for handling temporal dependencies;and hybrid models integrating CNN,LSTM,attention mechanism(AM)and other techniques.For illustration and comparison purposes,models proposed in recent studies are mapped to relevant elements of a generalized framework comprised of input,output,feature extraction,prediction,and related processes.Among the state-of-the-artmodels,hybrid models like CNNLSTMand CNN-LSTM-AM in general have been reported superior in performance to stand-alone models like the CNN-only model.Some remaining challenges have been discussed,including non-friendliness for finance domain experts,delayed prediction,domain knowledge negligence,lack of standards,and inability of real-time and highfrequency predictions.The principal contributions of this paper are to provide a one-stop guide for both academia and industry to review,compare and summarize technologies and recent advances in this area,to facilitate smooth and informed implementation,and to highlight future research directions.

Finite-Time Thermodynamic Simulation of Circulating Direct Condensation Heat Recovery on Chillers

A time series model is used in this paper to describe the progress of circulating direct condensation heat recovery of the compound condensing process (CCP) which is made of two water cooling condensing processes in series for a centrifugal chiller in the paper. A finite-time thermodynamics method is used to set up the time series simulation model. As a result, an upper bound of recoverable condensation heat for the compound condensing process is obtained which is in good agreement with experimental result. And the result is valuable and useful to optimization design of condensing heat recovery.

Analysis of coordinate time series of DORIS stations on Eurasian plate and the plate motion based on SSA and FFT

This study focuses on analyzing the time series of DORIS beacon stations and plate motion of the Eurasian plate by applying Singular Spectrum Analysis(SSA)and Fast Fourier Transform(FFT).First,the rend terms and periodic signals are accurately separated by SSA,then,the periodic seasonal signals are detected using SSA,and finally,the main components of the time series are reconstructed successfully.The test results show that the nonlinear trends and seasonal signals of DORIS stations are detected successfully.The periods of the seasonal signals detected are year,half-year,and 59 days,etc.The contribution rates and slopes in E,N,and U directions of the trend items of each beacon station after reconstruction are obtained by least-square fitting.The velocities of these stations are compared with those provided by the GEODVEL2010 model,and it is found that they are in good agreement except the DIOB,MANB,and PDMB stations.Based on the DORIS coordinate time series,the velocity field on the Eurasian plate is constructed,and the test shows that the Eurasian plate moves eastward as a whole with an average velocity of 24.19±0.11 mm/y in the horizontal direction,and the average velocity of it is1.74±0.07 mm/y in the vertical direction.

Eucalyptus carbon stock estimation in subtropical regions with the modeling strategy of sample plots–airborne LiDAR–Landsat time series data

Updating eucalyptus carbon stock data in a timely manner is essential for better understanding and quantifying its effects on ecological and hydrological processes.At present,there are no suitable methods to accurately estimate the eucalyptus carbon stock in a large area.This research aimed to explore the transferability of the eucalyptus carbon stock estimation model at temporal and spatial scales and assess modeling performance through the strategy of combining sample plots,airborne LiDAR and Landsat time series data in subtropical regions of China.Specifically,eucalyptus carbon stock estimates in typical sites were obtained by applying the developed models with the combination of airborne LiDAR and field measurement data;the eucalyptus plantation ages were estimated using the random localization segmentation approach from Landsat time series data;and regional models were developed by linking LiDAR-derived eucalyptus carbon stock and vegetation age(e.g.,months or years).To examine the models’robustness,the developed models at the regional scale were transferred to estimate carbon stocks at the spatial and temporal scales,and the modeling results were evaluated using validation samples accordingly.The results showed that carbon stock can be successfully estimated using the age-based models(both age variables in months and years as predictor variables),but the month-based models produced better estimates with a root mean square error(RMSE)of 6.51 t⋅ha1 for Yunxiao County,Fujian Province,and 6.33 t⋅ha1 for Gaofeng Forest Farm,Guangxi Zhuang Autonomous Region.Particularly,the month-based models were superior for estimating the carbon stocks of young eucalyptus plantations of less than two years.The model transferability analyses showed that the month-based models had higher transferability than the year-based models at the temporal scale,indicating their possibility for analysis of carbon stock change.However,both the month-based and year-based models expressed relatively poor transferability at a spatial scale.This study provides new insights for cost-effective monitoring of carbon stock change in intensively managed plantation forests.

A new decomposition model of sea level variability for the sea level anomaly time series prediction

Rising sea level is of great significance to coastal societies;predicting sea level extent in coastal regions is critical.When carrying out predictions,the subsequences obtained using decomposition methods may exhibit a certain regularity and therefore can provide multidimensional information that can be used to improve prediction models.Traditional decomposition methods such as seasonal and trend decomposition using Loess(STL)focus mostly on the fluctuating trend of time series and ignore its impact on prediction.Methods in the signal decomposition domain,such as variational mode decomposition(VMD),have no physical significance.In response to the above problems,a new decomposition method for sea level anomaly time series prediction(DMSLAP)is proposed.With this method,the trend term in a time series can be isolated and the effects of abnormal sea level change behaviors can be attenuated.We decompose multiperiod characteristics using this method while maintaining the smoothness of the analyzed series.Satellite altimetry data from 1993 to 2020 are used in experiments conducted in the study area.The results are then compared with predictions obtained using existing decomposition methods such as the STL and VMD methods and time varying filtering based on empirical mode decomposition(TVF-EMD).The performance of DMSLAP combined with a prediction method resulted in optimal sea level anomaly(SLA)predictions,with a minimum root mean square error(RMSE)of 1.40 cm and a maximum determination coefficient(R^(2))of 0.93 during 2020.The DMSLAP method was more accurate when predicting 1-year data and 3-year data.The TVF-EMD and DMSLAP methods had comparable accuracies,and the periodic term decomposed by the DMSLAP method was more in line with the actual law than that derived using the TVF-EMD method.Thus,DMSLAP can decompose SLA time series better than existing methods and is an effective tool for obtaining short-term SLA prediction.

Research on Short-Term Load Forecasting of Distribution Stations Based on the Clustering Improvement Fuzzy Time Series Algorithm

An improved fuzzy time series algorithmbased on clustering is designed in this paper.The algorithm is successfully applied to short-term load forecasting in the distribution stations.Firstly,the K-means clustering method is used to cluster the data,and the midpoint of two adjacent clustering centers is taken as the dividing point of domain division.On this basis,the data is fuzzed to form a fuzzy time series.Secondly,a high-order fuzzy relation with multiple antecedents is established according to the main measurement indexes of power load,which is used to predict the short-term trend change of load in the distribution stations.Matlab/Simulink simulation results show that the load forecasting errors of the typical fuzzy time series on the time scale of one day and one week are[−50,20]and[−50,30],while the load forecasting errors of the improved fuzzy time series on the time scale of one day and one week are[−20,15]and[−20,25].It shows that the fuzzy time series algorithm improved by clustering improves the prediction accuracy and can effectively predict the short-term load trend of distribution stations.

Examine the Reliability of Econometrics Software: An Empirical Comparison of Time Series Modelling

Researchers must understand that naively relying on the reliability of statistical software packages may result in suboptimal, biased, or erroneous results, which affects applied economic theory and the conclusions and policy recommendations drawn from it. To create confidence in a result, several software packages should be applied to the same estimation problem. This study examines the results of three software packages (EViews, R, and Stata) in the analysis of time-series econometric data. The time-series data analysis which presents the determinants of macroeconomic growth of Sri Lanka from 1978 to 2020 has been used. The study focuses on testing for stationarity, cointegration, and significant relationships among the variables. The Augmented Dickey-Fuller and Phillips Perron tests were employed in this study to test for stationarity, while the Johansen cointegration test was utilized to test for cointegration. The study employs the vector error correction model to assess the short-run and long-term dynamics of the variables in an attempt to determine the relationship between them. Finally, the Granger Causality test is employed in order to examine the linear causation between the concerned variables. The study revealed that the results produced by three software packages for the same dataset and the same lag order vary significantly. This implies that time series econometrics results are sensitive to the software that is used by the researchers while providing different policy implications even for the same dataset. The present study highlights the necessity of further analysis to investigate the impact of software packages in time series analysis of economic scenarios.

Periodic signal extraction of GNSS height time series based on adaptive singular spectrum analysis

Singular spectrum analysis is widely used in geodetic time series analysis.However,when extracting time-varying periodic signals from a large number of Global Navigation Satellite System(GNSS)time series,the selection of appropriate embedding window size and principal components makes this method cumbersome and inefficient.To improve the efficiency and accuracy of singular spectrum analysis,this paper proposes an adaptive singular spectrum analysis method by combining spectrum analysis with a new trace matrix.The running time and correlation analysis indicate that the proposed method can adaptively set the embedding window size to extract the time-varying periodic signals from GNSS time series,and the extraction efficiency of a single time series is six times that of singular spectrum analysis.The method is also accurate and more suitable for time-varying periodic signal analysis of global GNSS sites.

Phenology of different types of vegetation and their response to climate change in the Qilian Mountains,China

The Qilian Mountains(QM)possess a delicate vegetation ecosystem,amplifying the evident response of vegetation phenology to climate change.The relationship between changes in vegetation growth and climate remains complex.To this end,we used MODIS NDVI data to extract the phenological parameters of the vegetation including meadow(MDW),grassland(GSD),and alpine vegetation(ALV))in the QM from 2002 to 2021.Then,we employed path analysis to reveal the direct and indirect impacts of seasonal climate change on vegetation phenology.Additionally,we decomposed the vegetation phenology in a time series using the trigonometric seasonality,Box-Cox transformation,ARMA errors,and Trend Seasonal components model(TBATS).The findings showed a distinct pattern in the vegetation phenology of the QM,characterized by a progressive shift towards an earlier start of the growing season(SOS),a delayed end of the growing season(EOS),and an extended length of the growing season(LOS).The growth cycle of MDW,GSD,and ALV in the QM species is clearly defined.The SOS for MDW and GSD occurred earlier,mainly between late April and August,while the SOS for ALVs occurred between mid-May and mid-August,a one-month delay compared to the other vegetation.The EOS in MDW and GSD were concentrated between late August and April and early September and early January,respectively.Vegetation phenology exhibits distinct responses to seasonal temperature and precipitation patterns.The advancement and delay of SOS were mainly influenced by the direct effect of spring temperatures and precipitation,which affected 19.59%and 22.17%of the study area,respectively.The advancement and delay of EOS were mainly influenced by the direct effect of fall temperatures and precipitation,which affected 30.18%and 21.17%of the area,respectively.On the contrary,the direct effects of temperature and precipitation in summer and winter on vegetation phenology seem less noticeable and were mainly influenced by indirect effects.The indirect effect of winter precipitation is the main factor affecting the advance or delay of SOS,and the area proportions were 16.29%and 23.42%,respectively.The indirect effects of fall temperatures and precipitation were the main factors affecting the delay and advancement of EOS,respectively,with an area share of 15.80%and 21.60%.This study provides valuable insight into the relationship between vegetation phenology and climate change,which can be of great practical value for the ecological protection of the Qinghai-Tibetan Plateau as well as for the development of GSD ecological animal husbandry in the QM alpine pastoral area.

A Measurement Study of the Ethereum Underlying P2P Network

This work carried out a measurement study of the Ethereum Peer-to-Peer(P2P)network to gain a better understanding of the underlying nodes.Ethereum was applied because it pioneered distributed applications,smart contracts,and Web3.Moreover,its application layer language“Solidity”is widely used in smart contracts across different public and private blockchains.To this end,we wrote a new Ethereum client based on Geth to collect Ethereum node information.Moreover,various web scrapers have been written to collect nodes’historical data fromthe Internet Archive and the Wayback Machine project.The collected data has been compared with two other services that harvest the number of Ethereumnodes.Ourmethod has collectedmore than 30% more than the other services.The data trained a neural network model regarding time series to predict the number of online nodes in the future.Our findings show that there are less than 20% of the same nodes daily,indicating thatmost nodes in the network change frequently.It poses a question of the stability of the network.Furthermore,historical data shows that the top ten countries with Ethereum clients have not changed since 2016.The popular operating system of the underlying nodes has shifted from Windows to Linux over time,increasing node security.The results have also shown that the number of Middle East and North Africa(MENA)Ethereum nodes is neglected compared with nodes recorded from other regions.It opens the door for developing new mechanisms to encourage users from these regions to contribute to this technology.Finally,the model has been trained and demonstrated an accuracy of 92% in predicting the future number of nodes in the Ethereum network.

Using Interrupted Time Series Design to Analyze Changes in Hand, Foot, and Mouth Disease Incidence during the Declining Incidence Periods of 2008-2010 in China

Objective To identify patterns of hand, foot and mouth disease （HFMD） incidence in China during declining incidence periods of 2008, 2009, and 2010. Methods Reported HFMD cases over a period of 25 months were extracted from the National Disease Reporting System （NDRS） and analyzed. An interrupted time series （ITS） technique was used to detect changes in HFMD incidence rates in terms of level and slope between declining incidence periods of the three years. Results Over 3.58 million HFMD cases younger than 5 years were reported to the NDRS between May 1, 2008, and May 31, 2011. Males comprised 63.4% of the cases. ITS analyses demonstrated a significant increase in incidence rate level （P〈0.0001） when comparing the current period with the previous period. There were significant changes in declining slopes when comparing 2010 to 2009, and 2010 to 2008 （all P〈O.O05）, but not 2009 to 2008. Conclusion Incremental changes in incidence rate level during the declining incidence periods of 2009 and 2010 can potentially be attributed to a few factors. The more steeply declining slope in 2010 compared with previous years could be ascribed to the implementation of more effective interventions and preventive strategies in 2010. Further investigation is required to examine this possibility.

Forecasting the number of zoonotic cutaneous leishmaniasis cases in south of Fars province, Iran using seasonal ARIMA time series method

Objective: To predict the trend of cutaneous leishmaniasis and assess the relationship between the disease trend and weather variables in south of Fars province using Seasonal Autoregressive Integrated Moving Average(SARIMA) model,Methods: The trend of cutaneous leishmaniasis was predicted using Mini tab software and SARIMA model,Besides,information about the disease and weather conditions was collected monthly based on time series design during January 2010 to March 2016,Moreover,various SARIMA models were assessed and the best one was selected,Then,the model's fitness was evaluated based on normality of the residuals' distribution,correspondence between the fitted and real amounts,and calculation of Akaike Information Criteria(AIC) and Bayesian Information Criteria(BIC),Results: The study results indicated that SARIMA model(4,1,4)(0,1,0)(12) in general and SARIMA model(4,1,4)(0,1,1)(12) in below and above 15 years age groups could appropriately predict the disease trend in the study area,Moreover,temperature with a three-month delay(lag3) increased the disease trend,rainfall with a four-month delay(lag4) decreased the disease trend,and rainfall with a nine-month delay(lag9) increased the disease trend,Conclusions: Based on the results,leishmaniasis follows a descending trend in the study area in case drought condition continues,SARIMA models can suitably measure the disease trend,and the disease follows a seasonal trend.

Impacts of Reference Time Series on the Homogenization of Radiosonde Temperature

Using radiosonde temperatures of 92 selected stations in China,the uncertainties in homogenization processes caused by different reference series,including nighttime temperature,the NCEP （National Centers for Environmental Prediction） and ERA-40 （European Centre for Medium-Range Weather Forecasts） forecasting background,are examined via a two-phase regression approach.Although the results showed limited consistency in the temporal and spatial distribution of identified break points （BPs） in the context of metadata events of instrument model change and correction method,significant uncertainties still existed in BP identification,adjustment,and impact on the estimated trend.Reanalysis reference series generally led to more BP identification in homogenization.However,those differences were parts of global climatic shifts,which may have confused the BP calculations.Discontinuities also existed in the reanalysis series due to changes in the satellite input.The adjustment values deduced from the reanalysis series ranged widely and were larger than those from the nighttime series and,therefore,impacted the estimated temperature trend.

Regular nonlinear response of the driven Duffng oscillator to chaotic time series

Nonlinear response of the driven Duffing oscillator to periodic or quasi-periodic signals has been well studied. In this paper, we investigate the nonlinear response of the driven Duffing oscillator to non-periodic, more specifically, chaotic time series. Through numerical simulations, we find that the driven Duffing oscillator can also show regular nonlinear response to the chaotic time series with different degree of chaos as generated by the same chaotic series generating model, and there exists a relationship between the state of the driven Duffing oscillator and the chaoticity of the input signal of the driven Duffing oscillator. One real-world and two artificial chaotic time series are used to verify the new feature of Duffing oscillator. A potential application of the new feature of Duffing oscillator is also indicated.

STUDY ON THE PREDICTION METHOD OF LOW-DIMENSION TIME SERIES THAT ARISE FROM THE INTRINSIC NONLINEAR DYNAMICS

The prediction methods and its applications of the nonlinear dynamic systems determined from chaotic time series of low-dimension are discussed mainly. Based on the work of the foreign researchers, the chaotic time series in the phase space adopting one kind of nonlinear chaotic model were reconstructed. At first, the model parameters were estimated by using the improved least square method. Then as the precision was satisfied, the optimization method was used to estimate these parameters. At the end by using the obtained chaotic model, the future data of the chaotic time series in the phase space was predicted. Some representative experimental examples were analyzed to testify the models and the algorithms developed in this paper. ne results show that if the algorithms developed here are adopted, the parameters of the corresponding chaotic model will be easily calculated well and true. Predictions of chaotic series in phase space make the traditional methods change from outer iteration to interpolations. And if the optimal model rank is chosen, the prediction precision will increase notably. Long term superior predictability of nonlinear chaotic models is proved to be irrational and unreasonable.

Analysis of Change Point in Surface Temperature Time Series Using Cumulative Sum Chart and Bootstrapping for Asansol Weather Observation Station, West Bengal, India

This paper aims to detect the short-term as well as long-term change point in the surface air temperature time series for Asansol weather observation station, West Bengal, India. Temperature data for the period from 1941 to 2010 of the said weather observatory have been collected from Indian Meteorological Department, Kolkata. Variations and trends of annual mean temperature, annual mean maximum temperature and annual minimum temperature time series were examined. The cumulative sum charts (CUSUM) and bootstrapping were used for the detection of abrupt changes in the time series data set. Statistically significant abrupt changes and trends have been detected. The major change point in the annual mean temperatures occurred around 1986 (0.57°C) at the period of 25 years in the long-term regional scale. On the other side, the annual mean maximum and annual mean minimum temperatures have distinct change points at level 1. There are abrupt changes in the year 1961 (Confidence interval 1961, 1963) for the annual mean maximum and 1994 (Confidence interval 1993, 1996) for the annual mean minimum temperatures at a confidence level of 100% and 98%, respectively. Before the change, the annual mean maximum and annual mean minimum temperatures were 30.90°C and 23.99°C, respectively, while after the change, the temperatures became 33.93°C and 24.84°C, respectively. Over the entire period of consideration (1941-2010), 11 forward and backward changes were found in total. Out of 11, there are 3 changes (1961, 1986 and 2001) in annual mean temperatures, 4 changes (1957, 1961, 1980 and 1994) in annual mean maximum temperatures, and rest 4 changes (1968, 1981, 1994 and 2001) are associated with annual mean minimum temperature data set.

The improved local linear prediction of chaotic time series

Based on the Bayesian information criterion, this paper proposes the improved local linear prediction method to predict chaotic time series. This method uses spatial correlation and temporal correlation simultaneously. Simulation results show that the improved local linear prediction method can effectively make multi-step and one-step prediction of chaotic time series and the multi-step prediction performance and one-step prediction accuracy of the improved local linear prediction method are superior to those of the traditional local linear prediction method.

Generalized unscented Kalman filtering based radial basis function neural network for the prediction of ground radioactivity time series with missing data

On the assumption that random interruptions in the observation process are modeled by a sequence of independent Bernoulli random variables, we firstly generalize two kinds of nonlinear filtering methods with random interruption failures in the observation based on the extended Kalman filtering （EKF） and the unscented Kalman filtering （UKF）, which were shortened as GEKF and CUKF in this paper, respectively. Then the nonlinear filtering model is established by using the radial basis function neural network （RBFNN） prototypes and the network weights as state equation and the output of RBFNN to present the observation equation. Finally, we take the filtering problem under missing observed data as a special case of nonlinear filtering with random intermittent failures by setting each missing data to be zero without needing to pre-estimate the missing data, and use the GEKF-based RBFNN and the GUKF-based RBFNN to predict the ground radioactivity time series with missing data. Experimental results demonstrate that the prediction results of GUKF-based RBFNN accord well with the real ground radioactivity time series while the prediction results of GEKF-based RBFNN are divergent.

Comparison study of typical algorithms for reconstructing time series from the recurrence plot of dynamical systems

The three most widely used methods for reconstructing the underlying time series via the recurrence plots （RPs） of a dynamical system are compared with each other in this paper. We aim to reconstruct a toy series, a periodical series, a random series, and a chaotic series to compare the effectiveness of the most widely used typical methods in terms of signal correlation analysis. The application of the most effective algorithm to the typical chaotic Lorenz system verifies the correctness of such an effective algorithm. It is verified that, based on the unthresholded RPs, one can reconstruct the original attractor by choosing different RP thresholds based on the Hirata algorithm. It is shown that, in real applications, it is possible to reconstruct the underlying dynamics by using quite little information from observations of real dynamical systems. Moreover, rules of the threshold chosen in the algorithm are also suggested.

A New Multidimensional Time Series Forecasting Method Based on the EOF Iteration Scheme

In this paper a new .mnultidimensional time series forecasting scheme based on the empirical orthogonal function (EOF) stepwise iteration process is introduced. The scheme is tested in a series of forecast experiments of Nino3 SST anomalies and Tahiti-Darwin SO index. The results show that the scheme is feasible and ENSO predictable.