In this study,a novel approach based on the U-Net deep neural network for image segmentation is leveraged for real-time extraction of tracklets from optical acquisitions.As in all machine learning(ML)applications,a se...In this study,a novel approach based on the U-Net deep neural network for image segmentation is leveraged for real-time extraction of tracklets from optical acquisitions.As in all machine learning(ML)applications,a series of steps is required for a working pipeline:dataset creation,preprocessing,training,testing,and post-processing to refine the trained network output.Online websites usually lack ready-to-use datasets;thus,an in-house application artificially generates 360 labeled images.Particularly,this software tool produces synthetic night-sky shots of transiting objects over a specified location and the corresponding labels:dual-tone pictures with black backgrounds and white tracklets.Second,both images and labels are downscaled in resolution and normalized to accelerate the training phase.To assess the network performance,a set of both synthetic and real images was inputted.After the preprocessing phase,real images were fine-tuned for vignette reduction and background brightness uniformity.Additionally,they are down-converted to eight bits.Once the network outputs labels,post-processing identifies the centroid right ascension and declination of the object.The average processing time per real image is less than 1.2 s;bright tracklets are easily detected with a mean centroid angular error of 0.25 deg in 75%of test cases with a 2 deg field-of-view telescope.These results prove that an ML-based method can be considered a valid choice when dealing with trail reconstruction,leading to acceptable accuracy for a fast image processing pipeline.展开更多
Real driving scenarios,due to occlusions and disturbances,provide disordered and noisy measurements,which makes the task of multi-object tracking quite challenging.Conventional approach is to find deterministic data a...Real driving scenarios,due to occlusions and disturbances,provide disordered and noisy measurements,which makes the task of multi-object tracking quite challenging.Conventional approach is to find deterministic data association;however,it has unstable performance in high clutter density.This paper proposes a novel probabilistic tracklet-enhanced multiple object tracker(PTMOT),which integrates Poisson multi-Bernoulli mixture(PMBM)filter with confidence of tracklets.The proposed method is able to realize efficient and robust probabilistic association for 3D multi-object tracking(MOT)and improve the PMBM filter’s continuity by smoothing single target hypothesis with global hypothesis.It consists of two key parts.First,the PMBM tracker based on sets of tracklets is implemented to realize probabilistic fusion of disordered measure-ments.Second,the confidence of tracklets is smoothed through a smoothing-while-filtering approach.Extensive MOT tests on nuScenes tracking dataset demonstrate that the proposed method achieves superior performance in different modalities.展开更多
检测跟踪(Tracking by detection)是近年来多目标跟踪领域的一个主要研究方向。遵循检测跟踪框架,提出一种基于分层关联的全局性的数据关联算法。首先利用目标检测器在整个视频上检测目标,得到检测响应;然后利用广义最小团图在视频片段...检测跟踪(Tracking by detection)是近年来多目标跟踪领域的一个主要研究方向。遵循检测跟踪框架,提出一种基于分层关联的全局性的数据关联算法。首先利用目标检测器在整个视频上检测目标,得到检测响应;然后利用广义最小团图在视频片段中对检测响应进行数据关联,得到轨迹片段;最后再在整个视频中对轨迹片段进行分层关联,得到最终的轨迹。在公共数据集上的测试结果表明,该算法能够有效地对多个目标进行数据关联,具有较强的处理遮挡能力。展开更多
Crowded scene analysis is currently a hot and challenging topic in computer vision field. The ability to analyze motion patterns from videos is a difficult, but critical part of this problem. In this paper, we propose...Crowded scene analysis is currently a hot and challenging topic in computer vision field. The ability to analyze motion patterns from videos is a difficult, but critical part of this problem. In this paper, we propose a novel approach for the analysis of motion patterns by clustering the tracklets using an unsupervised hierarchical clustering algorithm, where the similarity between tracklets is measured by the Longest Common Subsequences. The tracklets are obtained by tracking dense points under three effective rules, therefore enabling it to capture the motion patterns in crowded scenes. The analysis of motion patterns is implemented in a completely unsupervised way, and the tracklets are clustered automatically through hierarchical clustering algorithm based on a graphic model. To validate the performance of our approach, we conducted experimental evaluations on two datasets. The results reveal the precise distributions of motion patterns in current crowded videos and demonstrate the effectiveness of our approach.展开更多
Multi-object tracking is a vital problem as many applications require better tracking approaches.Although learning-based detectors are becoming extremely powerful,there are few tracking methods designed to work with t...Multi-object tracking is a vital problem as many applications require better tracking approaches.Although learning-based detectors are becoming extremely powerful,there are few tracking methods designed to work with them in real time.We explored an efficient flexible online vehicle tracking-by-detection framework suitable for real-virtual mapping systems,which combines a non-recursive temporal window search with delayed output and produces stable trajectories despite noisy detection responses.Its computation speed meets the real-time requirements,whereas its performance is comparable with that of state-of-the-art online trackers on the DETRAC dataset.The trajectories from our approach also contain the target class and color information important for virtual vehicle motion reconstruction.展开更多
文摘In this study,a novel approach based on the U-Net deep neural network for image segmentation is leveraged for real-time extraction of tracklets from optical acquisitions.As in all machine learning(ML)applications,a series of steps is required for a working pipeline:dataset creation,preprocessing,training,testing,and post-processing to refine the trained network output.Online websites usually lack ready-to-use datasets;thus,an in-house application artificially generates 360 labeled images.Particularly,this software tool produces synthetic night-sky shots of transiting objects over a specified location and the corresponding labels:dual-tone pictures with black backgrounds and white tracklets.Second,both images and labels are downscaled in resolution and normalized to accelerate the training phase.To assess the network performance,a set of both synthetic and real images was inputted.After the preprocessing phase,real images were fine-tuned for vignette reduction and background brightness uniformity.Additionally,they are down-converted to eight bits.Once the network outputs labels,post-processing identifies the centroid right ascension and declination of the object.The average processing time per real image is less than 1.2 s;bright tracklets are easily detected with a mean centroid angular error of 0.25 deg in 75%of test cases with a 2 deg field-of-view telescope.These results prove that an ML-based method can be considered a valid choice when dealing with trail reconstruction,leading to acceptable accuracy for a fast image processing pipeline.
基金supported by International Science and Technology Cooperation Program of China(2019YFE0100200)in part by National Natural Science Foundation of China(61903220)National Natural Science Foundation of China(U1864203).
文摘Real driving scenarios,due to occlusions and disturbances,provide disordered and noisy measurements,which makes the task of multi-object tracking quite challenging.Conventional approach is to find deterministic data association;however,it has unstable performance in high clutter density.This paper proposes a novel probabilistic tracklet-enhanced multiple object tracker(PTMOT),which integrates Poisson multi-Bernoulli mixture(PMBM)filter with confidence of tracklets.The proposed method is able to realize efficient and robust probabilistic association for 3D multi-object tracking(MOT)and improve the PMBM filter’s continuity by smoothing single target hypothesis with global hypothesis.It consists of two key parts.First,the PMBM tracker based on sets of tracklets is implemented to realize probabilistic fusion of disordered measure-ments.Second,the confidence of tracklets is smoothed through a smoothing-while-filtering approach.Extensive MOT tests on nuScenes tracking dataset demonstrate that the proposed method achieves superior performance in different modalities.
文摘检测跟踪(Tracking by detection)是近年来多目标跟踪领域的一个主要研究方向。遵循检测跟踪框架,提出一种基于分层关联的全局性的数据关联算法。首先利用目标检测器在整个视频上检测目标,得到检测响应;然后利用广义最小团图在视频片段中对检测响应进行数据关联,得到轨迹片段;最后再在整个视频中对轨迹片段进行分层关联,得到最终的轨迹。在公共数据集上的测试结果表明,该算法能够有效地对多个目标进行数据关联,具有较强的处理遮挡能力。
基金supported in part by National Basic Research Program of China (973 Program) under Grant No. 2011CB302203the National Natural Science Foundation of China under Grant No. 61273285
文摘Crowded scene analysis is currently a hot and challenging topic in computer vision field. The ability to analyze motion patterns from videos is a difficult, but critical part of this problem. In this paper, we propose a novel approach for the analysis of motion patterns by clustering the tracklets using an unsupervised hierarchical clustering algorithm, where the similarity between tracklets is measured by the Longest Common Subsequences. The tracklets are obtained by tracking dense points under three effective rules, therefore enabling it to capture the motion patterns in crowded scenes. The analysis of motion patterns is implemented in a completely unsupervised way, and the tracklets are clustered automatically through hierarchical clustering algorithm based on a graphic model. To validate the performance of our approach, we conducted experimental evaluations on two datasets. The results reveal the precise distributions of motion patterns in current crowded videos and demonstrate the effectiveness of our approach.
文摘Multi-object tracking is a vital problem as many applications require better tracking approaches.Although learning-based detectors are becoming extremely powerful,there are few tracking methods designed to work with them in real time.We explored an efficient flexible online vehicle tracking-by-detection framework suitable for real-virtual mapping systems,which combines a non-recursive temporal window search with delayed output and produces stable trajectories despite noisy detection responses.Its computation speed meets the real-time requirements,whereas its performance is comparable with that of state-of-the-art online trackers on the DETRAC dataset.The trajectories from our approach also contain the target class and color information important for virtual vehicle motion reconstruction.
