In this study,we provide an overview of recent advances in multisensor multitarget tracking based on the random finite set(RFS)approach.The fusion that plays a fundamental role in multisensor filtering is classified i...In this study,we provide an overview of recent advances in multisensor multitarget tracking based on the random finite set(RFS)approach.The fusion that plays a fundamental role in multisensor filtering is classified into data-level multitarget measurement fusion and estimate-level multitarget density fusion,which share and fuse local measurements and posterior densities between sensors,respectively.Important properties of each fusion rule including the optimality and sub-optimality are presented.In particulax,two robust multitarget density-averaging approaches,arithmetic-and geometric-average fusion,are addressed in detail for various RFSs.Relevant research topics and remaining challenges are highlighted.展开更多
We demonstrate a heuristic approach for optimizing the posterior density of the data association tracking algorithm via the random finite set(RFS)theory.Specifically,we propose an adjusted version of the joint probabi...We demonstrate a heuristic approach for optimizing the posterior density of the data association tracking algorithm via the random finite set(RFS)theory.Specifically,we propose an adjusted version of the joint probabilistic data association(JPDA)filter,known as the nearest-neighbor set JPDA(NNSJPDA).The target labels in all possible data association events are switched using a novel nearest-neighbor method based on the Kullback-Leibler divergence,with the goal of improving the accuracy of the marginalization.Next,the distribution of the target-label vector is considered.The transition matrix of the target-label vector can be obtained after the switching of the posterior density.This transition matrix varies with time,causing the propagation of the distribution of the target-label vector to follow a non-homogeneous Markov chain.We show that the chain is inherently doubly stochastic and deduce corresponding theorems.Through examples and simulations,the effectiveness of NNSJPDA is verified.The results can be easily generalized to other data association approaches under the same RFS framework.展开更多
<div style="text-align:justify;"> In recent years, multi-target tracking technology based on Gaussian Mixture- Probability Hypothesis Density (GM-PHD) filtering has become a hot field of information fu...<div style="text-align:justify;"> In recent years, multi-target tracking technology based on Gaussian Mixture- Probability Hypothesis Density (GM-PHD) filtering has become a hot field of information fusion research. This article outlines the generation and development of multi-target tracking methods based on GM-PHD filtering, and the principle and implementation method of GM-PHD filtering are explained, and the application status based on GM-PHD filtering is summarized, and the key issues of the development of GM-PHD filtering technology are analyzed. </div>展开更多
This paper presents a multi-Bernoulli filter for tracking the direction of arrival(DOAs)of time-varying number of targets using sensor array.Our method operates directly on the measurements of sensor array and does no...This paper presents a multi-Bernoulli filter for tracking the direction of arrival(DOAs)of time-varying number of targets using sensor array.Our method operates directly on the measurements of sensor array and does not require any detection.Firstly,more information is reserved and compared with the after-detection measurements using a finite set of detected points.It can significantly improve the tracking performance,especially in low signal-to-noise ratio.Secondly,it inherits the advantages of the multi-Bernoulli approximation which models each of the targets individually.This allows more accurate multi-target state estimation,especially when targets cross.The proposed filter does not need clustering step and simulation results showcase the improved performance of the proposed filter.展开更多
With the great development of Multi-Target Tracking(MTT)technologies,many MTT algorithms have been proposed with their own advantages and disadvantages.Due to the fact that requirements to MTT algorithms vary from the...With the great development of Multi-Target Tracking(MTT)technologies,many MTT algorithms have been proposed with their own advantages and disadvantages.Due to the fact that requirements to MTT algorithms vary from the application scenarios,performance evaluation is significant to select an appropriate MTT algorithm for the specific application scenario.In this paper,we propose a performance evaluation method on the sets of trajectories with temporal dimension specifics to compare the estimated trajectories with the true trajectories.The proposed method evaluates the estimate results of an MTT algorithm in terms of tracking accuracy,continuity and clarity.Furthermore,its computation is based on a multi-dimensional assignment problem,which is formulated as a computable form using linear programming.To enhance the influence of recent estimated states of the trajectories in the evaluation,an attention function is used to reweight the trajectory errors at different time steps.Finally,simulation results show that the proposed performance evaluation method is able to evaluate many aspects of the MTT algorithms.These evaluations are worthy for selecting suitable MTT algorithms in different application scenarios.展开更多
The coalescence and missed detection are two key challenges in Multi-Target Tracking(MTT).To balance the tracking accuracy and real-time performance,the existing Random Finite Set(RFS)based filters are generally diffi...The coalescence and missed detection are two key challenges in Multi-Target Tracking(MTT).To balance the tracking accuracy and real-time performance,the existing Random Finite Set(RFS)based filters are generally difficult to handle the above problems simultaneously,such as the Track-Oriented marginal Multi-Bernoulli/Poisson(TOMB/P)and Measurement-Oriented marginal Multi-Bernoulli/Poisson(MOMB/P)filters.Based on the Arithmetic Average(AA)fusion rule,this paper proposes a novel fusion framework for the Poisson Multi-Bernoulli(PMB)filter,which integrates both the advantages of the TOMB/P filter in dealing with missed detection and the advantages of the MOMB/P filter in dealing with coalescence.In order to fuse the different PMB distributions,the Bernoulli components in different Multi-Bernoulli(MB)distributions are associated with each other by Kullback-Leibler Divergence(KLD)minimization.Moreover,an adaptive AA fusion rule is designed on the basis of the exponential fusion weights,which utilizes the TOMB/P and MOMB/P updates to solve these difficulties in MTT.Finally,by comparing with the TOMB/P and MOMB/P filters,the performance of the proposed filter in terms of accuracy and efficiency is demonstrated in three challenging scenarios.展开更多
In the classical form,the Poisson Multi-Bernoulli Mixture(PMBM)filter uses a PMBM density to describe target birth,surviving,and death,which does not model the appearance of spawned targets.Although such a model can h...In the classical form,the Poisson Multi-Bernoulli Mixture(PMBM)filter uses a PMBM density to describe target birth,surviving,and death,which does not model the appearance of spawned targets.Although such a model can handle target birth,surviving,and death well,its performance may degrade when target spawning arises.The reason for this is that the original PMBM filter treats the spawned targets as birth targets,ignoring the surviving targets’information.In this paper,we propose a Kullback–Leibler Divergence(KLD)minimization based derivation for the PMBM prediction step,including target spawning,in which the spawned targets are modeled using a Poisson Point Process(PPP).Furthermore,to improve the computational efficiency,three approximations are used to implement the proposed algorithm,such as the Variational MultiBernoulli(VMB)filter,the Measurement-Oriented marginal MeMBer/Poisson(MOMB/P)filter,and the Track-Oriented marginal MeMBer/Poisson(TOMB/P)filter.Finally,simulation results demonstrate the validity of the proposed filter by using the spawning model in these three approximations.展开更多
Real driving scenarios,due to occlusions and disturbances,provide disordered and noisy measurements,which makes the task of multi-object tracking quite challenging.Conventional approach is to find deterministic data a...Real driving scenarios,due to occlusions and disturbances,provide disordered and noisy measurements,which makes the task of multi-object tracking quite challenging.Conventional approach is to find deterministic data association;however,it has unstable performance in high clutter density.This paper proposes a novel probabilistic tracklet-enhanced multiple object tracker(PTMOT),which integrates Poisson multi-Bernoulli mixture(PMBM)filter with confidence of tracklets.The proposed method is able to realize efficient and robust probabilistic association for 3D multi-object tracking(MOT)and improve the PMBM filter’s continuity by smoothing single target hypothesis with global hypothesis.It consists of two key parts.First,the PMBM tracker based on sets of tracklets is implemented to realize probabilistic fusion of disordered measure-ments.Second,the confidence of tracklets is smoothed through a smoothing-while-filtering approach.Extensive MOT tests on nuScenes tracking dataset demonstrate that the proposed method achieves superior performance in different modalities.展开更多
基金Project supported by the Key Laboratory Foundation of National Defence Technology,China(No.61424010306)the Joint Fund of Equipment Development and Aerospace Science and Technology,China(No.6141B0624050101)the National Natural Science Foundation of China(Nos.61901489 and 62071389)。
文摘In this study,we provide an overview of recent advances in multisensor multitarget tracking based on the random finite set(RFS)approach.The fusion that plays a fundamental role in multisensor filtering is classified into data-level multitarget measurement fusion and estimate-level multitarget density fusion,which share and fuse local measurements and posterior densities between sensors,respectively.Important properties of each fusion rule including the optimality and sub-optimality are presented.In particulax,two robust multitarget density-averaging approaches,arithmetic-and geometric-average fusion,are addressed in detail for various RFSs.Relevant research topics and remaining challenges are highlighted.
基金Project supported by the National Key Research and Development Program of China(No.2017YFB1402102)the National Natural Science Foundation of China(Nos.61907028 and 11872036)+2 种基金the Natural Science Foundation of Shaanxi Province,China(Nos.2020JQ-423,2019JQ-574,and 2019ZDLSF07-01)the Fundamental Research Funds for the Central Universities,China(No.GK201903103)the China Postdoctoral Science Foundation(No.2018M640950)。
文摘We demonstrate a heuristic approach for optimizing the posterior density of the data association tracking algorithm via the random finite set(RFS)theory.Specifically,we propose an adjusted version of the joint probabilistic data association(JPDA)filter,known as the nearest-neighbor set JPDA(NNSJPDA).The target labels in all possible data association events are switched using a novel nearest-neighbor method based on the Kullback-Leibler divergence,with the goal of improving the accuracy of the marginalization.Next,the distribution of the target-label vector is considered.The transition matrix of the target-label vector can be obtained after the switching of the posterior density.This transition matrix varies with time,causing the propagation of the distribution of the target-label vector to follow a non-homogeneous Markov chain.We show that the chain is inherently doubly stochastic and deduce corresponding theorems.Through examples and simulations,the effectiveness of NNSJPDA is verified.The results can be easily generalized to other data association approaches under the same RFS framework.
文摘<div style="text-align:justify;"> In recent years, multi-target tracking technology based on Gaussian Mixture- Probability Hypothesis Density (GM-PHD) filtering has become a hot field of information fusion research. This article outlines the generation and development of multi-target tracking methods based on GM-PHD filtering, and the principle and implementation method of GM-PHD filtering are explained, and the application status based on GM-PHD filtering is summarized, and the key issues of the development of GM-PHD filtering technology are analyzed. </div>
文摘This paper presents a multi-Bernoulli filter for tracking the direction of arrival(DOAs)of time-varying number of targets using sensor array.Our method operates directly on the measurements of sensor array and does not require any detection.Firstly,more information is reserved and compared with the after-detection measurements using a finite set of detected points.It can significantly improve the tracking performance,especially in low signal-to-noise ratio.Secondly,it inherits the advantages of the multi-Bernoulli approximation which models each of the targets individually.This allows more accurate multi-target state estimation,especially when targets cross.The proposed filter does not need clustering step and simulation results showcase the improved performance of the proposed filter.
基金supported by the National Natural Science Foundation of China(No.62276204,No.62306222)the Natural Science Basic Research Program of Shaanxi,China(No.2023-JC-QN-0710)。
文摘With the great development of Multi-Target Tracking(MTT)technologies,many MTT algorithms have been proposed with their own advantages and disadvantages.Due to the fact that requirements to MTT algorithms vary from the application scenarios,performance evaluation is significant to select an appropriate MTT algorithm for the specific application scenario.In this paper,we propose a performance evaluation method on the sets of trajectories with temporal dimension specifics to compare the estimated trajectories with the true trajectories.The proposed method evaluates the estimate results of an MTT algorithm in terms of tracking accuracy,continuity and clarity.Furthermore,its computation is based on a multi-dimensional assignment problem,which is formulated as a computable form using linear programming.To enhance the influence of recent estimated states of the trajectories in the evaluation,an attention function is used to reweight the trajectory errors at different time steps.Finally,simulation results show that the proposed performance evaluation method is able to evaluate many aspects of the MTT algorithms.These evaluations are worthy for selecting suitable MTT algorithms in different application scenarios.
基金supported by the National Natural Science Foundation of China(No.61871301)。
文摘The coalescence and missed detection are two key challenges in Multi-Target Tracking(MTT).To balance the tracking accuracy and real-time performance,the existing Random Finite Set(RFS)based filters are generally difficult to handle the above problems simultaneously,such as the Track-Oriented marginal Multi-Bernoulli/Poisson(TOMB/P)and Measurement-Oriented marginal Multi-Bernoulli/Poisson(MOMB/P)filters.Based on the Arithmetic Average(AA)fusion rule,this paper proposes a novel fusion framework for the Poisson Multi-Bernoulli(PMB)filter,which integrates both the advantages of the TOMB/P filter in dealing with missed detection and the advantages of the MOMB/P filter in dealing with coalescence.In order to fuse the different PMB distributions,the Bernoulli components in different Multi-Bernoulli(MB)distributions are associated with each other by Kullback-Leibler Divergence(KLD)minimization.Moreover,an adaptive AA fusion rule is designed on the basis of the exponential fusion weights,which utilizes the TOMB/P and MOMB/P updates to solve these difficulties in MTT.Finally,by comparing with the TOMB/P and MOMB/P filters,the performance of the proposed filter in terms of accuracy and efficiency is demonstrated in three challenging scenarios.
基金supported by the National Natural Science Foundation of China(No.61871301)。
文摘In the classical form,the Poisson Multi-Bernoulli Mixture(PMBM)filter uses a PMBM density to describe target birth,surviving,and death,which does not model the appearance of spawned targets.Although such a model can handle target birth,surviving,and death well,its performance may degrade when target spawning arises.The reason for this is that the original PMBM filter treats the spawned targets as birth targets,ignoring the surviving targets’information.In this paper,we propose a Kullback–Leibler Divergence(KLD)minimization based derivation for the PMBM prediction step,including target spawning,in which the spawned targets are modeled using a Poisson Point Process(PPP).Furthermore,to improve the computational efficiency,three approximations are used to implement the proposed algorithm,such as the Variational MultiBernoulli(VMB)filter,the Measurement-Oriented marginal MeMBer/Poisson(MOMB/P)filter,and the Track-Oriented marginal MeMBer/Poisson(TOMB/P)filter.Finally,simulation results demonstrate the validity of the proposed filter by using the spawning model in these three approximations.
基金supported by International Science and Technology Cooperation Program of China(2019YFE0100200)in part by National Natural Science Foundation of China(61903220)National Natural Science Foundation of China(U1864203).
文摘Real driving scenarios,due to occlusions and disturbances,provide disordered and noisy measurements,which makes the task of multi-object tracking quite challenging.Conventional approach is to find deterministic data association;however,it has unstable performance in high clutter density.This paper proposes a novel probabilistic tracklet-enhanced multiple object tracker(PTMOT),which integrates Poisson multi-Bernoulli mixture(PMBM)filter with confidence of tracklets.The proposed method is able to realize efficient and robust probabilistic association for 3D multi-object tracking(MOT)and improve the PMBM filter’s continuity by smoothing single target hypothesis with global hypothesis.It consists of two key parts.First,the PMBM tracker based on sets of tracklets is implemented to realize probabilistic fusion of disordered measure-ments.Second,the confidence of tracklets is smoothed through a smoothing-while-filtering approach.Extensive MOT tests on nuScenes tracking dataset demonstrate that the proposed method achieves superior performance in different modalities.