CNN-LSTM based incremental attention mechanism enabled phase-space reconstruction for chaotic time series prediction

To improve the prediction accuracy of chaotic time series and reconstruct a more reasonable phase space structure of the prediction network,we propose a convolutional neural network-long short-term memory(CNN-LSTM)prediction model based on the incremental attention mechanism.Firstly,a traversal search is conducted through the traversal layer for finite parameters in the phase space.Then,an incremental attention layer is utilized for parameter judgment based on the dimension weight criteria(DWC).The phase space parameters that best meet DWC are selected and fed into the input layer.Finally,the constructed CNN-LSTM network extracts spatio-temporal features and provides the final prediction results.The model is verified using Logistic,Lorenz,and sunspot chaotic time series,and the performance is compared from the two dimensions of prediction accuracy and network phase space structure.Additionally,the CNN-LSTM network based on incremental attention is compared with long short-term memory(LSTM),convolutional neural network(CNN),recurrent neural network(RNN),and support vector regression(SVR)for prediction accuracy.The experiment results indicate that the proposed composite network model possesses enhanced capability in extracting temporal features and achieves higher prediction accuracy.Also,the algorithm to estimate the phase space parameter is compared with the traditional CAO,false nearest neighbor,and C-C,three typical methods for determining the chaotic phase space parameters.The experiments reveal that the phase space parameter estimation algorithm based on the incremental attention mechanism is superior in prediction accuracy compared with the traditional phase space reconstruction method in five networks,including CNN-LSTM,LSTM,CNN,RNN,and SVR.

Chaotic time series multi-step direct prediction with partial least squares regression

Considering chaotic time series multi-step prediction, multi-step direct prediction model based on partial least squares （PLS） is proposed in this article, where PLS, the method for predicting a set of dependent variables forming a large set of predictors, is used to model the dynamic evolution between the space points and the corresponding future points. The model can eliminate error accumulation with the common single-step local model algorithm~ and refrain from the high multi-collinearity problem in the reconstructed state space with the increase of embedding dimension. Simulation predictions are done on the Mackey-Glass chaotic time series with the model. The satisfying prediction accuracy is obtained and the model efficiency verified. In the experiments, the number of extracted components in PLS is set with cross-validation procedure.

New prediction of chaotic time series based on local Lyapunov exponent

A new method of predicting chaotic time series is presented based on a local Lyapunov exponent, by quantitatively measuring the exponential rate of separation or attraction of two infinitely close trajectories in state space. After recon- structing state space from one-dimensional chaotic time series, neighboring multiple-state vectors of the predicting point are selected to deduce the prediction formula by using the definition of the locaI Lyapunov exponent. Numerical simulations are carded out to test its effectiveness and verify its higher precision over two older methods. The effects of the number of referential state vectors and added noise on forecasting accuracy are also studied numerically.

Multi-step-prediction of chaotic time series based on co-evolutionary recurrent neural network

This paper proposes a co-evolutionary recurrent neural network （CERNN） for the multi-step-prediction of chaotic time series, it estimates the proper parameters of phase space reconstruction and optimizes the structure of recurrent neural networks by coevolutionary strategy. The searching space was separated into two subspaces and the individuals are trained in a parallel computational procedure. It can dynamically combine the embedding method with the capability of recurrent neural network to incorporate past experience due to internal recurrence. The effectiveness of CERNN is evaluated by using three benchmark chaotic time series data sets： the Lorenz series, Mackey-Glass series and real-world sun spot series. The simulation results show that CERNN improves the performances of multi-step-prediction of chaotic time series.

Regular nonlinear response of the driven Duffng oscillator to chaotic time series

Nonlinear response of the driven Duffing oscillator to periodic or quasi-periodic signals has been well studied. In this paper, we investigate the nonlinear response of the driven Duffing oscillator to non-periodic, more specifically, chaotic time series. Through numerical simulations, we find that the driven Duffing oscillator can also show regular nonlinear response to the chaotic time series with different degree of chaos as generated by the same chaotic series generating model, and there exists a relationship between the state of the driven Duffing oscillator and the chaoticity of the input signal of the driven Duffing oscillator. One real-world and two artificial chaotic time series are used to verify the new feature of Duffing oscillator. A potential application of the new feature of Duffing oscillator is also indicated.

Neural Volterra filter for chaotic time series prediction

A new second-order neural Volterra filter （SONVF） with conjugate gradient （CG） algorithm is proposed to predict chaotic time series based on phase space delay-coordinate reconstruction of chaotic dynamics system in this paper, where the neuron activation functions are introduced to constraint Volterra series terms for improving the nonlinear approximation of second-order Volterra filter （SOVF）. The SONVF with CG algorithm improves the accuracy of prediction without increasing the computation complexity. Meanwhile, the difficulty of neuron number determination does not exist here. Experimental results show that the proposed filter can predict chaotic time series effectively, and one-step and multi-step prediction performances are obviously superior to those of SOVF, which demonstrate that the proposed SONVF is feasible and effective.

Chaotic time series prediction using fuzzy sigmoid kernel-based support vector machines

Support vector machines （SVM） have been widely used in chaotic time series predictions in recent years. In order to enhance the prediction efficiency of this method and implement it in hardware, the sigmoid kernel in SVM is drawn in a more natural way by using the fuzzy logic method proposed in this paper. This method provides easy hardware implementation and straightforward interpretability. Experiments on two typical chaotic time series predictions have been carried out and the obtained results show that the average CPU time can be reduced significantly at the cost of a small decrease in prediction accuracy, which is favourable for the hardware implementation for chaotic time series prediction.

The improved local linear prediction of chaotic time series

Based on the Bayesian information criterion, this paper proposes the improved local linear prediction method to predict chaotic time series. This method uses spatial correlation and temporal correlation simultaneously. Simulation results show that the improved local linear prediction method can effectively make multi-step and one-step prediction of chaotic time series and the multi-step prediction performance and one-step prediction accuracy of the improved local linear prediction method are superior to those of the traditional local linear prediction method.

PREDICTION TECHNIQUES OF CHAOTIC TIME SERIES AND ITS APPLICATIONS AT LOW NOISE LEVEL

The paper not only studies the noise reduction methods of chaotic time series with noise and its reconstruction techniques, but also discusses prediction techniques of chaotic time series and its applications based on chaotic data noise reduction. In the paper, we first decompose the phase space of chaotic time series to range space and null noise space. Secondly we restructure original chaotic time series in range space. Lastly on the basis of the above, we establish order of the nonlinear model and make use of the nonlinear model to predict some research. The result indicates that the nonlinear model has very strong ability of approximation function, and Chaos predict method has certain tutorial significance to the practical problems.

Stabilization of Chaotic Time Series by Proportional Pulse in the System Variable Based on Genetic Algorithm

The PPSV (Proportional Pulse in the System Variable) algorithm is a convenient method for the stabilization of the chaotic time series. It does not require any previous knowledge of the system. The PPSV method also has a shortcoming, that is, the determination off. is a procedure by trial and error, since it lacks of optimization. In order to overcome the blindness, GA (Genetic Algorithm), a search algorithm based on the mechanics of natural selection and natural genetics, is used to optimize the λi The new method is named as GAPPSV algorithm. The simulation results show that GAPPSV algorithm is very efficient because the control process is short and the steady-state error is small.

Multimodality Prediction of Chaotic Time Series with Sparse Hard-Cut EM Learning of the Gaussian Process Mixture Model

The contribution of this work is twofold： （1） a multimodality prediction method of chaotic time series with the Gaussian process mixture （GPM） model is proposed, which employs a divide and conquer strategy. It automatically divides the chaotic time series into multiple modalities with different extrinsic patterns and intrinsic characteristics, and thus can more precisely fit the chaotic time series. （2） An effective sparse hard-cut expec- tation maximization （SHC-EM） learning algorithm for the GPM model is proposed to improve the prediction performance. SHO-EM replaces a large learning sample set with fewer pseudo inputs, accelerating model learning based on these pseudo inputs. Experiments on Lorenz and Chua time series demonstrate that the proposed method yields not only accurate multimodality prediction, but also the prediction confidence interval SHC-EM outperforms the traditional variational 1earning in terms of both prediction accuracy and speed. In addition, SHC-EM is more robust and insusceptible to noise than variational learning.

Complex Networks from Chaotic Time Series on Riemannian Manifold

Complex networks are important paradigms for analyzing the complex systems as they allow understanding the structural properties of systems composed of different interacting entities. In this work we propose a reliable method for constructing complex networks from chaotic time series. We first estimate the covariance matrices, then a geodesic-based distance between the covariance matrices is introduced. Consequently the network can be constructed on a Riemannian manifold where the nodes and edges correspond to the covariance matrix and geodesic-based distance, respectively. The proposed method provides us with an intrinsic geometry viewpoint to understand the time series.

Prediction and analysis of chaotic time series on the basis of support vector

Based on discussion on the theories of support vector machines （SVM）, an one-step prediction model for time series prediction is presented, wherein the chaos theory is incorporated. Chaotic character of the time series is taken into account in the prediction procedure; parameters of reconstruction-detay and embedding-dimension for phase-space reconstruction are calculated in light of mutual-information and false-nearest-neighbor method, respectively. Precision and functionality have been demonstrated by the experimental results on the basis of the prediction of Lorenz chaotic time series.

A method to improve the precision of chaotic time series prediction by using a non-trajectory

Due to the error in the measured value of the initial state and the sensitive dependence on initial conditions of chaotic dynamical systems, the error of chaotic time series prediction increases with the prediction step. This paper provides a method to improve the prediction precision by adjusting the predicted value in the course of iteration according to the evolution information of small intervals on the left and right sides of the predicted value. The adjusted predicted result is a non-trajectory which can provide a better prediction performance than the usual result based on the trajectory. Numerical simulations of two typical chaotic maps demonstrate its effectiveness. When the prediction step gets relatively larger, the effect is more pronounced.

KLT-based local linear prediction of chaotic time series

In the reconstructed phase space, based on the Karhunen-Loeve transformation （KLT）, the new local linear prediction method is proposed to predict chaotic time series. ＆ noise-free chaotic time series and a noise added chaotic time series are analyzed. The simulation results show that the KLT-based local linear prediction method can effectively make one-step and multi-step prediction for chaotic time series, and the one-step and multi-step prediction accuracies of the KLT-based local linear prediction method are superior to that of the traditional local linear prediction.

Research on Optimize Prediction Model and Algorithm about Chaotic Time Series

We put forward a chaotic estimating model, by using the parameter of the chaotic system, sensitivity of the parameter to inching and control the disturbance of the system, and estimated the parameter of the model by using the best update option. In the end, we forecast the intending series value in its mutually space. The example shows that it can increase the precision in the estimated process by selecting the best model steps. It not only conquer the abuse of using detention inlay technology alone, but also decrease blindness of using forecast error to decide the input model directly, and the result of it is better than the method of statistics and other series means. Key words chaotic time series - parameter identification - optimal prediction model - improved change ruler method CLC number TP 273 Foundation item: Supported by the National Natural Science Foundation of China (60373062)Biography: JIANG Wei-jin (1964-), male, Professor, research direction: intelligent compute and the theory methods of distributed data processing in complex system, and the theory of software.

AN ANALYTIC AND APPLICATION TO STATE SPACE RECONSTRUCTION ABOUT CHAOTIC TIME SERIES

The state space, reconstruction is the major important quantitative index for describing non-linear chaotic time series. Based on the work of many scholars, such as: AT. H. Packard, F. Takens, M. Casdagli, J. F. Gibson, CHEN Yu-shu et al, the state space was reconstructed using the method of Legendre coordinate. Several different scaling regimes for lag time tau were identified. The influence for state space reconstruction of lag time tau was discussed. The result tells us that is a good practical method for state space reconstruction.

Determination of Kolmogorov Entropy of Chaotic Attractor Included in One-Dimensional Time Series of Meteorological Data

The 1970-1985 day to day averaged pressure dataset of Shanghai and the extension method in phase space are used to calculate the correlation dimension D and the second-order Renyi entropy K2 of the approximation of Kolmogorov's entropy, the fractional dimension D = 7.7-7.9 and the positive value K2 - 0.1 are obtained. This shows that the attractor for the short-term weather evolution in the monsoon region of China exhibits a chaotic motion. The estimate of K2 yields a predictable time scale of about ten days. This result is in agreement with that obtained earlier by the dynamic-statistical approach.The effects of the lag time i on the estimate of D and K2 are investigated. The results show that D and K2 are convergent with respect to i. The day to day averaged pressure series used in this paper are treated for the extensive phase space with T = 5, the coordinate components are independent of each other; therefore, the dynamical character quantities of the system are stable and reliable.

Combined Method of Chaotic Theory and Neural Networks for Water Quality Prediction

Chaos theory was introduced for water quality, prediction, and the model of water quality prediction was established by combining phase space reconstruction theory and BP neural network forecasting method. Through the phase space reconstruction, the one-dimensional water quality time series were mapped to be multi-dimensional sequence, which enriched the spatial information of water quality change and expanded mapping region of training samples of BP neural network. Established model of combining chaos theory and BP neural network were applied to forecast turbidity time series of a certain reservoir. Contrast to BP neural network method, the relative error and the mean squared error of the combined method had all varying degrees of lower. Results indicated the neural network model with chaos theory had the higher prediction accuracy, at the same time, it had better fault-tolerant capability and generalization performance .

PARAMETERS DETERMINATION METHOD OF PHASE-SPACE RECONSTRUCTION BASED ON DIFFERENTIAL ENTROPY RATIO AND RBF NEURAL NETWORK

Phase space reconstruction is the first step of recognizing the chaotic time series.On the basis of differential entropy ratio method,the embedding dimension opt m and time delay t are optimal for the state space reconstruction could be determined.But they are not the optimal parameters accepted for prediction.This study proposes an improved method based on the differential entropy ratio and Radial Basis Function(RBF)neural network to estimate the embedding dimension m and the time delay t,which have both optimal characteristics of the state space reconstruction and the prediction.Simulating experiments of Lorenz system and Doffing system show that the original phase space could be reconstructed from the time series effectively,and both the prediction accuracy and prediction length are improved greatly.