Traffic Control Based on Integrated Kalman Filtering and Adaptive Quantized Q-Learning Framework for Internet of Vehicles

Intelligent traffic control requires accurate estimation of the road states and incorporation of adaptive or dynamically adjusted intelligent algorithms for making the decision.In this article,these issues are handled by proposing a novel framework for traffic control using vehicular communications and Internet of Things data.The framework integrates Kalman filtering and Q-learning.Unlike smoothing Kalman filtering,our data fusion Kalman filter incorporates a process-aware model which makes it superior in terms of the prediction error.Unlike traditional Q-learning,our Q-learning algorithm enables adaptive state quantization by changing the threshold of separating low traffic from high traffic on the road according to the maximum number of vehicles in the junction roads.For evaluation,the model has been simulated on a single intersection consisting of four roads:east,west,north,and south.A comparison of the developed adaptive quantized Q-learning(AQQL)framework with state-of-the-art and greedy approaches shows the superiority of AQQL with an improvement percentage in terms of the released number of vehicles of AQQL is 5%over the greedy approach and 340%over the state-of-the-art approach.Hence,AQQL provides an effective traffic control that can be applied in today’s intelligent traffic system.

WSN Mobile Target Tracking Based on Improved Snake-Extended Kalman Filtering Algorithm

A wireless sensor network mobile target tracking algorithm(ISO-EKF)based on improved snake optimization algorithm(ISO)is proposed to address the difficulty of estimating initial values when using extended Kalman filtering to solve the state of nonlinear mobile target tracking.First,the steps of extended Kalman filtering(EKF)are introduced.Second,the ISO is used to adjust the parameters of the EKF in real time to adapt to the current motion state of the mobile target.Finally,the effectiveness of the algorithm is demonstrated through filtering and tracking using the constant velocity circular motion model(CM).Under the specified conditions,the position and velocity mean square error curves are compared among the snake optimizer(SO)-EKF algorithm,EKF algorithm,and the proposed algorithm.The comparison shows that the proposed algorithm reduces the root mean square error of position by 52%and 41%compared to the SOEKF algorithm and EKF algorithm,respectively.

Prediction of landslide block movement based on Kalman filtering data assimilation method

Compared with the study of single point motion of landslides,studying landslide block movement based on data from multiple monitoring points is of great significance for improving the accurate identification of landslide deformation.Based on the study of landslide block,this paper regarded the landslide block as a rigid body in particle swarm optimization algorithm.The monitoring data were organized to achieve the optimal state of landslide block,and the 6-degree of freedom pose of the landslide block was calculated after the regularization.Based on the characteristics of data from multiple monitoring points of landslide blocks,a prediction equation for the motion state of landslide blocks was established.By using Kalman filtering data assimilation method,the parameters of prediction equation for landslide block motion state were adjusted to achieve the optimal prediction.This paper took the Baishuihe landslide in the Three Gorges reservoir area as the research object.Based on the block segmentation of the landslide,the monitoring data of the Baishuihe landslide block were organized,6-degree of freedom pose of block B was calculated,and the Kalman filtering data assimilation method was used to predict the landslide block movement.The research results showed that the proposed prediction method of the landslide movement state has good prediction accuracy and meets the expected goal.This paper provides a new research method and thinking angle to study the motion state of landslide block.

Nonlinear Bayesian Estimation： From Kalman Filtering to a Broader Horizon

This article presents an up-to-date tutorial review of nonlinear Bayesian estimation. State estimation for nonlinear systems has been a challenge encountered in a wide range of engineering fields, attracting decades of research effort. To date,one of the most promising and popular approaches is to view and address the problem from a Bayesian probabilistic perspective,which enables estimation of the unknown state variables by tracking their probabilistic distribution or statistics(e.g., mean and covariance) conditioned on a system's measurement data.This article offers a systematic introduction to the Bayesian state estimation framework and reviews various Kalman filtering(KF)techniques, progressively from the standard KF for linear systems to extended KF, unscented KF and ensemble KF for nonlinear systems. It also overviews other prominent or emerging Bayesian estimation methods including Gaussian filtering, Gaussian-sum filtering, particle filtering and moving horizon estimation and extends the discussion of state estimation to more complicated problems such as simultaneous state and parameter/input estimation.

Research on Kalman Filtering Algorithmfor Deformation Information Series ofSimilar Single-Difference Model

Using similar single-difference methodology(SSDM) to solve the deformation values of the monitoring points, there is unstability of the deformation information series, at sometimes.In order to overcome this shortcoming, Kalman filtering algorithm for this series is established,and its correctness and validity are verified with the test data obtained on the movable platform in plane. The results show that Kalman filtering can improve the correctness, reliability and stability of the deformation information series.

Extended Kalman filtering-based channel estimation for space-time coded MIMO-OFDM systems

A space-time coded multiple-input multiple-output orthogonal frequency-division multiplexing （MIMO-OFDM） system is considered as a solution to the future wideband wireless communication system. This paper proposes an extended Kalman filtering-based （EKF-based） channel estimation method for space-time coded MIMO-OFDM systems. The proposed method can exploit pilot symbols and an extended Kalman filter to estimate channel without any prior knowledge of channel statistics. In comparison with the least square （LS） and the least mean square （LMS） methods, the EKF-based approach has a better performance in theory. Computer simulations demonstrate the proposed method outperforms the LS and LMS methods. Therefore it can offer draznatic system performance improvement at a modest cost of computational complexity.

Kalman Filtering for Delayed Singular Systems with Multiplicative Noise

Kalman filtering problem for singular systems is dealt with, where the measurements consist of instantaneous measurements and delayed ones, and the plant includes multiplicative noise. By utilizing standard singular value decomposition, the restricted equivalent delayed system is presented, and the Kalman filters for the restricted equivalent system are given by using the well-known re-organization of innovation analysis lemma. The optimal Kalman filter for the original system is given based on the above Kalman filter by recursive Riccati equations, and a numerical example is presented to show the validity and efficiency of the proposed approach, where the comparison between the filter and predictor is also given.

Adaptive Federal Kalman Filtering for SINS/GPS Integrated System

A new adaptive federal Kalman filter for a strapdown integrated navigation system/global positioning system (SINS/GPS) is given. The developed federal Kalman filter is based on the trace operation of parameters estimation's error covariance matrix and the spectral radius of update measurement noise variance-covariance matrix for the proper choice of the filter weight and hence the filter gain factors. Theoretical analysis and results from simulation in which the SINS/GPS was compared to conventional Kalman filter are presented. Results show that the algorithm of this adaptive federal Kalman filter is simpler than that of the conventional one. Furthermore, it outperforms the conventional Kalman filter when the system is undertaken measurement malfunctions because of its possession of adaptive ability. This filter can be used in the vehicle integrated navigation system.

Suboptimal distributed Kalman filtering fusion with feedback

In order to improve the accuracy of fusion algorithm, feedback is introduced into Kalman filtering fusion. Fusion center broadcasts its latest estimated states to the local sensors, which can improve the performance of local tracking error through reducing the oovariance of each local error, and only needs calculating the trace of error variance matrices without calculating the inverse of error variance matrices. Simulation results show that it can reduce the ecmputational complexity and the oovariance of error, and it is oonvenient for engineering applications.

Robust Remaining Useful Life Estimation Based on an Improved Unscented Kalman Filtering Method

In the Prognostics and Health Management(PHM),remaining useful life(RUL)is very important and utilized to ensure the reliability and safety of the operation of complex mechanical systems.Recently,unscented Kalman filtering(UKF)has been applied widely in the RUL estimation.For a degradation system,the relationship between its monitored measurements and its degradation states is assumed to be nonlinear in the conventional UKF.However,in some special degradation systems,their monitored measurements have a linear relation with their degradation states.For these special problems,it may bring estimation errors to use the UKF method directly.Besides,many uncertain factors can result in the fluctuations of the estimated results,which may have a bad influence on the RUL estimation method.As a result,a robust RUL estimation approach is proposed in this paper to reduce the errors and randomness of estimation results for this kind of degradation problems.Firstly,an improved unscented Kalman filtering is established utilizing the Kalman filtering(KF)method and a linear adaptive strategy.The linear adaptive strategy is used to adjust its noise term adaptively.Then,the robust RUL estimation is realized by the improved UKF.At last,three problems are investigated to demonstrate the effectiveness of the proposed method.

Second-Order Kalman Filtering Application to Fading Channels Supported by Real Data

The lack of effective techniques for estimation of shadow power in fading mobile wireless communication channels motivated the use of Kalman Filtering as an effective alternative. In this paper, linear second-order state space Kalman Filtering is further investigated and tested for applicability. This is important to optimize estimates of received power signals to improve control of handoffs. Simulation models were used extensively in the initial stage of this research to validate the proposed theory. Recently, we managed to further confirm validation of the concept through experiments supported by data from real scenarios. Our results have shown that the linear second-order state space Kalman Filter (KF) can be more accurate in predicting local shadow power profiles than the first-order Kalman Filter, even in channels with imposed non-Gaussian measurement noise.

Generalized reliability measures of Kalman filtering for precise point positioning

To deal with the adverse influence of model failures on Kalman filtering （KF） estimation, it is necessary to investigate the generalized reliability theory, including the model failure detection and identification method as well as the separability and reliability theories. Although the generalized reliability theory for the least square has been discussed for many decades, the generalized reliability theory of KF is not widely discussed. Compared with the least square, KF includes not only the measurement model, but also the dynamic model. In KF, the predicted value of the state parameters from the dynamic model is considered as pseudomeasurements and combined with the observed measurements to compose the form of the least square. According to the reliability of the least square, the generalized reliability of KF is derived. Then, the dynamic model failure of precise point positioning is simulated to demonstrate the usage of the generalized reliability theory. The results show that the adverse influence of the dynamic model failure is more severe than that of the measurement model. Moreover, it is recommended that the model failure identification should always be used even if the overall model test passes. It is shown that the derived generalized reliability measures are suitable for the generalized KF estimation.

Noise reduction of acoustic Doppler velocimeter data based on Kalman filtering and autoregressive moving average models

Oceanic turbulence measurements made by an acoustic Doppler velocimeter(ADV)suffer from noise that potentially affects the estimates of turbulence statistics.This study examines the abilities of Kalman filtering and autoregressive moving average models to eliminate noise in ADV velocity datasets of laboratory experiments and offshore observations.Results show that the two methods have similar performance in ADV de-noising,and both effectively reduce noise in ADV velocities,even in cases of high noise.They eliminate the noise floor at high frequencies of the velocity spectra,leading to a longer range that effectively fits the Kolmogorov-5/3 slope at midrange frequencies.After de-noising adopting the two methods,the values of the mean velocity are almost unchanged,while the root-mean-square horizontal velocities and thus turbulent kinetic energy decrease appreciably in these experiments.The Reynolds stress is also affected by high noise levels,and de-noising thus reduces uncertainties in estimating the Reynolds stress.

An On-Line Modeling Based Kalman Filtering Process for Time-Interval-Variable Sequences with Application to Astronomic Surveying

The problem of variable sampling time interval which appears in application of Kalman Filtering is analyzed and the corresponding filtering process with or without present transition matrix is suggested, then an application experiment for astronomical surveying is introduced. In this process, the known stochastically variable sampling time intervals play the roles as deterministic input sequences of the state-space description, and the corresponding matrix and (if needed) state transition matrix can be established by performing real-time and structure-linear system identification.

Enhanced multi-baseline unscented Kalman filtering phase unwrapping algorithm

This paper presents an enhanced multi-baseline phase unwrapping algorithm by combining an unscented Kalman filter with an enhanced joint phase gradient estimator based on the amended matrix pencil model, and an optimal path-following strategy based on phase quality estimate function. The enhanced joint phase gradient estimator can accurately and effectively extract the phase gradient information of wrapped pixels from noisy interferograms, which greatly increases the performances of the proposed method. The optimal path-following strategy ensures that the proposed algorithm simultaneously performs noise suppression and phase unwrapping along the pixels with high-reliance to the pixels with low-reliance. Accordingly, the proposed algorithm can be predicted to obtain better results, with respect to some other algorithms, as will be demonstrated by the results obtained from synthetic data.

Reduced-order Kalman filtering for state constrained linear systems

This paper aims at solving the state filtering problem for linear systems with state constraints. Three classes of typical state constraints, i.e., linear equality, quadratic equality and inequality, are discussed. By using the linear relationships among different state variables, a reduced-order Kalman filter is derived for the system with linear equality constraints. Afterwards, such a solution is applied to the cases of the quadratic equality constraint and inequality constraints and the two constrained state filtering problems are transformed into two relative constrained optimization problems. Then they are solved by the Lagrangian multiplier and linear matrix inequality techniques, respectively. Finally, two simple tracking examples are provided to illustrate the effectiveness of the reduced-order filters.

Two-step measurement update for extended Kalman filtering

The nonlinear filtering for a class of discrete-time stochastic dynamic systems whose measurement equations contain linear (or universal linearizable) components and nonlinear components which are mutually statistical independent is investigated. A two-step measurement update is proposed for the filtering of the systems. The first-step update is a linear (or universal linearization) measurement correction which introduces an intermediate estimate, while the second-step nonlinear linearization update produces the final posterior estimate based on the first-step estimate. Since the first measurement correction is a linear or universal linearization update, it provides an accurate linearization reference point for the second nonlinear measurement update. Two simulation examples show superiority of the new estimation method.

New Kalman Filtering Algorithm for Narrowband Interference Suppression in Spread Spectrum Systems

A new Kalman filtering algorithm based on estimation of spread spectrum signal before suppression of narrowband interference （NBI） in spread spectrum systems, using the dependence of autoregressive （AR） interference, is presented compared with performance of the ACM nonlinear filtering algorithm, simulation results show that the proposed algorithm has preferable performance, there is about 5 dB SNR improvement in average.

Decentralized algorithm of Kalman filtering

Presents an algorithm which can be used to achieve complete decentralization of Kalman filter algorithm amongst sensing nodes of a multi sensor system, and points out the algorithm can be used for position estimation in Robot Soccer because it does not require any form of central processing facility or centralized communications medium, and illustrates with a simulation example that it is very effective.

Links between Kalman Filtering and Data Assimilation with Generalized Least Squares

Kalman filtering (KF) is a popular form of data assimilation, especially in real-time applications. It combines observations with an equation that describes the dynamic evolution of a system to produce an estimate of its present-time state. Although KF does not use future information in producing an estimate of the state vector, later reanalysis of the archival data set can produce an improved estimate, in which all data, past, present and future, contribute. We examine the case in which the reanalysis is performed using generalized least squares (GLS), and establish the relationship between the real-time Kalman estimate and the GLS reanalysis. We show that the KF solution at a given time is equal to the GLS solution that one would obtain if data excluded future times. Furthermore, we show that the recursive procedure in KF is exactly equivalent to the solution of the GLS problem via Thomas’ algorithm for solving the block-tridiagonal matrix that arises in the reanalysis problem. This connection suggests that GLS reanalysis is better considered the final step of a single process, rather than a “different method” arbitrarily being applied, post factor. The connection also allows the concept of resolution, so important in other areas of inverse theory, to be applied to KF formulations. In an exemplary thermal diffusion problem, model resolution is found to be somewhat localized in both time and space, but with an extremely rough averaging kernel.