Maneuvering target tracking of UAV based on MN-DDPG and transfer learning

Tracking maneuvering target in real time autonomously and accurately in an uncertain environment is one of the challenging missions for unmanned aerial vehicles(UAVs).In this paper,aiming to address the control problem of maneuvering target tracking and obstacle avoidance,an online path planning approach for UAV is developed based on deep reinforcement learning.Through end-to-end learning powered by neural networks,the proposed approach can achieve the perception of the environment and continuous motion output control.This proposed approach includes:(1)A deep deterministic policy gradient(DDPG)-based control framework to provide learning and autonomous decision-making capability for UAVs;(2)An improved method named MN-DDPG for introducing a type of mixed noises to assist UAV with exploring stochastic strategies for online optimal planning;and(3)An algorithm of taskdecomposition and pre-training for efficient transfer learning to improve the generalization capability of UAV’s control model built based on MN-DDPG.The experimental simulation results have verified that the proposed approach can achieve good self-adaptive adjustment of UAV’s flight attitude in the tasks of maneuvering target tracking with a significant improvement in generalization capability and training efficiency of UAV tracking controller in uncertain environments.

A Fuzzy Adaptive Algorithm Based on“Current”Statistical Model for Maneuvering Target Tracking

The basic"current"statistical model and adaptive Kalman filter algorithm can not track a weakly maneuvering target precisely,though it has good estimate accuracy for strongly maneuvering target.In order to solve this problem,a novel nonlinear fuzzy membership function was presented to adjust the upper and lower limit of target acceleration adaptively,and then the validity of the new algorithm for feeblish maneuvering target was proved in theory.At last,the computer simulation experiments indicated that the new algorithm has a great advantage over the basic"current"statistical model and adaptive algorithm.

Maneuvering target tracking algorithm based on CDKF in observation bootstrapping strategy

The selection and optimization of model filters affect the precision of motion pattern identification and state estimation in maneuvering target tracking directly.Aiming at improving performance of model filters,a novel maneuvering target tracking algorithm based on central difference Kalman filter in observation bootstrapping strategy is proposed.The framework of interactive multiple model(IMM) is used to realize identification of motion pattern,and a central difference Kalman filter(CDKF) is selected as the model filter of IMM.Considering the advantage of multi-sensor fusion method in improving the stability and reliability of observation information,the hardware cost of the observation system for multiple sensors is adopted,meanwhile,according to the data assimilation technique in Ensemble Kalman filter(En KF),a bootstrapping observation set is constructed by integrating the latest observation and the prior information of observation noise.On that basis,these bootstrapping observations are reasonably used to optimize the filtering performance of CDKF by means of weight fusion way.The object of new algorithm is to improve the tracking precision of observed target by the multi-sensor fusion method without increasing the number of physical sensors.The theoretical analysis and experimental results show the feasibility and efficiency of the proposed algorithm.

Ant colony optimization for bearings-only maneuvering target tracking in sensors network

In this paper, the problem of bearings-only maneuvering target tracking in sensors network is investigated. Two objectives are proposed and optimized by the ant colony optimization （ACO）, then two kinds of node searching strategies of the ACO algorithm are presented. On the basis of the nodes determined by the ACO algorithm, the interacting multiple models extended Kalman filter （IMMEKF） for the multi-sensor bearings-only maneuvering target tracking is introduced. Simulation results indicate that the proposed ACO algorithm performs better than the Closest Nodes method. Furthermore, the Strategy 2 of the two given strategies is preferred in terms of the requirement of real time.

Tracking maneuvering target based on neural fuzzy network with incremental neural leaning

The scheme for tracking maneuvering target based on neural fuzzy network with incremental neural learning is proposed. When tracked target maneuver occurs, the scheme can detect maneuver immediately and estimate the maneuver value accurately , then the tracking filter can be compensated correctly and duly by the estimated maneuver value. When environment changes, neural fuzzy network with incremental neural learning （INL-SONFIN） can find its optimal structure and parameters automatically to adopt to changed environment. So, it always produce estimated output very close to the true maneuver value that leads to good tracking performance and avoids misstracking. Simulation results show that the performance is superior to the traditional schemes and the scheme can fit changed dynamic environment to track maneuvering target accurately and duly.

Application of Adaptive Reduced Sigma Points Unscented Kalman Filter to the Tracking of Maneuvering Target

Based on the principle of statistical linear regression, a set of n ＋ 2 sigma points instead of 2n ＋ 1 sigma points used in the unscented Kalman filter （UKF）, is constructed to approximate the system state. And filter accuracy is second order. Real-time of modified UKF is improved. In order to describe accurately the maneuvering target, the ＂current＂ statistical model is used. And the equation of acceleration error covariance is modified at every sample time of the filter. The modified adaptive UKF is presented for estimating the position, velocity and acceleration of maneuvering target. Monte Carlo simulations show the modified adaptive UKF acquires good performance for tracking position of maneuvering target. The modified adaptive UKF has better computational efficiency than UKF.

ALGORITHMS FOR TRACKING MANEUVERING TARGET WITH PHASED ARRAY RADAR

Several typical algorithms for tracking maneuvering target with phased array radar are studied in this paper. The constant gain filter with multiple models is analyzed. A typical method for adaptively controlling the sampling interval is modified. The performance of the single model and multiple model estimator with uniform and variable sampling interval are evaluated and compared. It is shown by the simulation results that it is necessary to apply the adaptive sampling policy based on the multiple model method when the maneuvering targets are tracked by the phased array radar since saving radar resources is more important. The adaptive algorithms of variable sampling interval are better than the algorithms of variable model. The adaptive policy to determine the sampling interval based on multiple model are superior than those based on the single model filter, because IMM estimator can adapt to the maneuver more quickly and the prediction covariance of IMM is the more sensitive and more reliable index than residual to determine the sampling interval. With IMM based method, lower sampling interval is required for a certain accuracy.

Consistent Extended Kalman Filter Design for Maneuvering Target Tracking and Its Application on Hand Position Tracking

This paper propees the consistent extended Kalman flter(CEKF)for the maneuvering target tracking(MTT)with nonlinear uncertain dynamics,and applies it on hand poition tracking.The general modlel of the MTT system i presented with unmodleled dynamics in terms of nonlinear unknown function of states.The CEKF is propoeed to ensure that the bounds of the estimation error's covariance matrix are av ailable through the flter algorithm.As a result,the creponding accuracy of the flter approach can be achieved online.Furthermore,a CEKF-baaed MTT algorithm is constructed via the tumning aw of the critical parameter matrix QE Finally,the efectiveness of CEKF i verified by MTT numerical simulations and hand tacking expeiments under dilferent maneuvens.Specifcally,two indices are employed to compare the CEKF with extended Kalman filter(EKF):the mean square errors(MSEa)and the bounded percentage,ie the percentage of the rang w bere the estimation error is encboed by the bound calculated by algorithms.All MSEs of CEKF are smaller than thoee of EKF,where the worst MSEa of CEKF and EKF are0.14 and 418 in the simulation,a8 well 80.11 and 059 in the expeiments,respectively;all bounded percentages of CEKF are larger than thoee of EKF,where the wonst average bounded percentages of CEKF and EKF ame 87.86%and 14.58%,8 well as 97.41%and 41.79%in the experiments,reapectively.

DESIGN OF DISTURBANCE DECOUPLED FILTER AND ITSAPPLICATION TO MANEUVERING TARGETS TRACKING

A novel disturbance decoupled filter (DDF) design scheme is presented. Firstly, the system with unknown input is translated into an equivalent system without unknown imputs by a simple algebraic transformation. Then, a new DDF design scheme, which is very simple, is proposed via innovations theorem. At last, the application of DDF to Maneuvering Targets Tracking is simulated and the simulation results show that DDF is suitable for high maneuvering cases.

Multiple model efficient particle filter based track-before-detect for maneuvering weak targets

It is a tough problem to jointly detect and track a weak target, and it becomes even more challenging when the target is maneuvering. The above problem is formulated by using the Bayesian theory and a multiple model(MM) based filter is proposed. The filter presented uses the MM method to accommodate the multiple motions that a maneuvering target may travel under by adding a random variable representing the motion model to the target state. To strengthen the efficiency performance of the filter,the target existence variable is separated from the target state and the existence probability is calculated in a more efficient way. To examine the performance of the MM based approach, a typical track-before-detect(TBD) scenario with a maneuvering target is used for simulations. The simulation results indicate that the MM based filter proposed has a good performance in joint detecting and tracking of a weak and maneuvering target, and it is more efficient than the general MM method.

Maneuvering target state estimation based on separate model-ing of target trajectory shape and dynamic characteristics

The state estimation of a maneuvering target,of which the trajectory shape is independent on dynamic characteristics,is studied.The conventional motion models in Cartesian coordinates imply that the trajectory of a target is completely determined by its dynamic characteristics.However,this is not true in the applications of road-target,sea-route-target or flight route-target tracking,where target trajectory shape is uncoupled with target velocity properties.In this paper,a new estimation algorithm based on separate modeling of target trajectory shape and dynamic characteristics is proposed.The trajectory of a target over a sliding window is described by a linear function of the arc length.To determine the unknown target trajectory,an augmented system is derived by denoting the unknown coefficients of the function as states in mileage coordinates.At every estimation cycle except the first one,the interaction(mixing)stage of the proposed algorithm starts from the latest estimated base state and a recalculated parameter vector,which is determined by the least squares(LS).Numerical experiments are conducted to assess the performance of the proposed algorithm.Simulation results show that the proposed algorithm can achieve better performance than the conventional coupled model-based algorithms in the presence of target maneuvers.

Adaptive Maneuvering Frequency Method of Current Statistical Model

Current statistical model(CSM) has a good performance in maneuvering target tracking. However, the fixed maneuvering frequency will deteriorate the tracking results, such as a serious dynamic delay, a slowly converging speedy and a limited precision when using Kalman filter(KF) algorithm. In this study, a new current statistical model and a new Kalman filter are proposed to improve the performance of maneuvering target tracking. The new model which employs innovation dominated subjection function to adaptively adjust maneuvering frequency has a better performance in step maneuvering target tracking, while a fluctuant phenomenon appears. As far as this problem is concerned, a new adaptive fading Kalman filter is proposed as well. In the new Kalman filter, the prediction values are amended in time by setting judgment and amendment rules,so that tracking precision and fluctuant phenomenon of the new current statistical model are improved. The results of simulation indicate the effectiveness of the new algorithm and the practical guiding significance.

Adaptive tracking algorithm based on 3D variable turn model

Satisfactory results cannot be obtained when three-dimensional (3D) targets with complex maneuvering characteristics are tracked by the commonly used two-dimensional coordinated turn (2DCT) model. To address the problem of 3D target tracking with strong maneuverability, on the basis of the modified three-dimensional variable turn (3DVT) model, an adaptive tracking algorithm is proposed by combining with the cubature Kalman filter (CKF) in this paper. Through ideology of real-time identification, the parameters of the model are changed to adjust the state transition matrix and the state noise covariance matrix. Therefore, states of the target are matched in real-time to achieve the purpose of adaptive tracking. Finally, four simulations are analyzed in different settings by the Monte Carlo method. All results show that the proposed algorithm can update parameters of the model and identify motion characteristics in real-time when targets tracking also has a better tracking accuracy.

Airborne Target State Estimator

A Target State Estimator (TSE) for airborne radar system is proposed in this paper. It is very important for fire control system to obtain accurate estimation of the maneuvering target and the TSE becomes a key link in the integrated Flight/Fire Control (IFFC) system. By adopting the Cartesian coordinates and pseudomeasurements ,the result ed TSE has it s advantages in computation.In addition, by employing accurate range and range-rate redundant filter, the range direction estimations obtained in Cartesian filter are greatly improved. The TSE shows its satisfaCtory performance in the Monte Carlo simulation of the IFFC system.

A New Smoothing Approach with Diverse Fixed-lags Based on Target Motion Model

Recently, lots of smoothing techniques have been presented for maneuvering target tracking. Interacting multiple model-probabilistic data association （IMM-PDA） fixed-lag smoothing algorithm provides an efficient solution to track a maneuvering target in a cluttered environment. Whereas, the smoothing lag of each model in a model set is a fixed constant in traditional algorithms. A new approach is developed in this paper. Although this method is still based on IMM-PDA approach to a state augmented system, it adopts different smoothing lag according to diverse degrees of complexity of each model. As a result, the application is more flexible and the computational load is reduced greatly. Some simulations were conducted to track a highly maneuvering target in a cluttered environment using two sensors. The results illustrate the superiority of the proposed algorithm over comparative schemes, both in accuracy of track estimation and the computational load.

用于非线性跟踪问题的一种新的粒子滤波器(英文)

A new particle filter is presented for nonlinear tracking problems. Inpractice, maneuvering target-tracking systems are usually nonlinear and incompletely observed, andthe main difficulty of maneuvering target-tracking problem lies in the fact that the maneuverabilityat every step is of high uncertainties. Here a new smoothing particle filter algorithm is proposed,which combines the particle filter to tackle the non-linear and non-Gaussian peculiarities of theproblem, together with smoothing of the PDF of system modes and thus settles the estimate problem ofthe target maneuverability. The simulation comparison with the auxiliary particle filters showsthat the approach has superiority and yields performance improvements in solving nonlinear trackingproblems.

Multiple-model Bayesian filtering with random finite set observation

The finite set statistics provides a mathematically rig- orous single target Bayesian filter （STBF） for tracking a target that generates multiple measurements in a cluttered environment. However, the target maneuvers may lead to the degraded track- ing performance and even track loss when using the STBF. The multiple-model technique has been generally considered as the mainstream approach to maneuvering the target tracking. Moti- vated by the above observations, we propose the multiple-model extension of the original STBF, called MM-STBF, to accommodate the possible target maneuvering behavior. Since the derived MM- STBF involve multiple integrals with no closed form in general, a sequential Monte Carlo implementation （for generic models） and a Gaussian mixture implementation （for linear Gaussian models） are presented. Simulation results show that the proposed MM-STBF outperforms the STBF in terms of root mean squared errors of dynamic state estimates.

INTERACTING MULTIPLE MODEL ALGORITHM BASED ON JOINT LIKELIHOOD ESTIMATION

A novel approach is proposed for the estimation of likelihood on Interacting Multiple-Model(IMM) filter.In this approach,the actual innovation,based on a mismatched model,can be formulated as sum of the theoretical innovation based on a matched model and the distance between matched and mismatched models,whose probability distributions are known.The joint likelihood of innovation sequence can be estimated by convolution of the two known probability density functions.The like-lihood of tracking models can be calculated by conditional probability formula.Compared with the conventional likelihood estimation method,the proposed method improves the estimation accuracy of likelihood and robustness of IMM,especially when maneuver occurs.

SCKF-STF-CN:a universal nonlinear filter for maneuver target tracking

Square-root cubature Kalman filter (SCKF) is more effective for nonlinear state estimation than an unscented Kalman filter.In this paper,we study the design of nonlinear filters based on SCKF for the system with one step noise correlation and abrupt state change.First,we give the SCKF that deals with the one step correlation between process and measurement noises,SCKF-CN in short.Second,we introduce the idea of a strong tracking filter to construct the adaptive square-root factor of the prediction error covariance with a fading factor,which makes SCKF-CN obtain outstanding tracking performance to the system with target maneuver or abrupt state change.Accordingly,the tracking performance of SCKF is greatly improved.A universal nonlinear estimator is proposed,which can not only deal with the conventional nonlinear filter problem with high dimensionality and correlated noises,but also achieve an excellent strong tracking performance towards the abrupt change of target state.Three simulation examples with a bearings-only tracking system are illustrated to verify the efficiency of the proposed algorithms.

Systematic error real-time registration based onmodified input estimation

In order to estimate the systematic error in the processof maneuvering target adaptive tracking, a new method is proposed.The proposed method is a linear tracking scheme basedon a modified input estimation approach. A special augmentationin the state space model is considered, in which both the systematicerror and the unknown input vector are attached to thestate vector. Then, an augmented state model and a measurementmodel are established in the case of systematic error, andthe corresponding filter formulas are also given. In the proposedscheme, the original state, the acceleration and the systematicerror vector can be estimated simultaneously. This method can notonly solve the maneuvering target adaptive tracking problem in thecase of systematic error, but also give the system error value inreal time. Simulation results show that the proposed tracking algorithmoperates in both the non-maneuvering and the maneuveringmodes, and the original state, the acceleration and the systematicerror vector can be estimated simultaneously.