Robust Space-Time Adaptive Track-Before-Detect Algorithm Based on Persymmetry and Symmetric Spectrum

Underwater monopulse space-time adaptive track-before-detect method,which combines space-time adaptive detector(STAD)and the track-before-detect algorithm based on dynamic programming(DP-TBD),denoted as STAD-DP-TBD,can effectively detect low-speed weak targets.However,due to the complexity and variability of the underwater environment,it is difficult to obtain sufficient secondary data,resulting in a serious decline in the detection and tracking performance,and leading to poor robustness of the algorithm.In this paper,based on the adaptive matched filter(AMF)test and the RAO test,underwater monopulse AMF-DP-TBD algorithm and RAO-DP-TBD algorithm which incorporate persymmetry and symmetric spectrum,denoted as PSAMF-DP-TBD and PS-RAO-DP-TBD,are proposed and compared with the AMF-DP-TBD algorithm and RAO-DP-TBD algorithm based on persymmetry array,denoted as P-AMF-DP-TBD and P-RAO-DP-TBD.The simulation results show that the four methods can work normally with sufficient secondary data and slightly insufficient secondary data,but when the secondary data is severely insufficient,the P-AMF-DP-TBD and P-RAO-DP-TBD algorithms has failed while the PSAMF-DP-TBD and PS-RAO-DP-TBD algorithms still have good detection and tracking capabilities.

End-to-End Joint Multi-Object Detection and Tracking for Intelligent Transportation Systems

Environment perception is one of the most critical technology of intelligent transportation systems(ITS).Motion interaction between multiple vehicles in ITS makes it important to perform multi-object tracking(MOT).However,most existing MOT algorithms follow the tracking-by-detection framework,which separates detection and tracking into two independent segments and limit the global efciency.Recently,a few algorithms have combined feature extraction into one network;however,the tracking portion continues to rely on data association,and requires com‑plex post-processing for life cycle management.Those methods do not combine detection and tracking efciently.This paper presents a novel network to realize joint multi-object detection and tracking in an end-to-end manner for ITS,named as global correlation network(GCNet).Unlike most object detection methods,GCNet introduces a global correlation layer for regression of absolute size and coordinates of bounding boxes,instead of ofsetting predictions.The pipeline of detection and tracking in GCNet is conceptually simple,and does not require compli‑cated tracking strategies such as non-maximum suppression and data association.GCNet was evaluated on a multivehicle tracking dataset,UA-DETRAC,demonstrating promising performance compared to state-of-the-art detectors and trackers.

Semantic Segmentation and YOLO Detector over Aerial Vehicle Images

Intelligent vehicle tracking and detection are crucial tasks in the realm of highway management.However,vehicles come in a range of sizes,which is challenging to detect,affecting the traffic monitoring system’s overall accuracy.Deep learning is considered to be an efficient method for object detection in vision-based systems.In this paper,we proposed a vision-based vehicle detection and tracking system based on a You Look Only Once version 5(YOLOv5)detector combined with a segmentation technique.The model consists of six steps.In the first step,all the extracted traffic sequence images are subjected to pre-processing to remove noise and enhance the contrast level of the images.These pre-processed images are segmented by labelling each pixel to extract the uniform regions to aid the detection phase.A single-stage detector YOLOv5 is used to detect and locate vehicles in images.Each detection was exposed to Speeded Up Robust Feature(SURF)feature extraction to track multiple vehicles.Based on this,a unique number is assigned to each vehicle to easily locate them in the succeeding image frames by extracting them using the feature-matching technique.Further,we implemented a Kalman filter to track multiple vehicles.In the end,the vehicle path is estimated by using the centroid points of the rectangular bounding box predicted by the tracking algorithm.The experimental results and comparison reveal that our proposed vehicle detection and tracking system outperformed other state-of-the-art systems.The proposed implemented system provided 94.1%detection precision for Roundabout and 96.1%detection precision for Vehicle Aerial Imaging from Drone(VAID)datasets,respectively.

Towards Collaborative Robotics in Top View Surveillance:A Framework for Multiple Object Tracking by Detection Using Deep Learning

Collaborative Robotics is one of the high-interest research topics in the area of academia and industry.It has been progressively utilized in numerous applications,particularly in intelligent surveillance systems.It allows the deployment of smart cameras or optical sensors with computer vision techniques,which may serve in several object detection and tracking tasks.These tasks have been considered challenging and high-level perceptual problems,frequently dominated by relative information about the environment,where main concerns such as occlusion,illumination,background,object deformation,and object class variations are commonplace.In order to show the importance of top view surveillance,a collaborative robotics framework has been presented.It can assist in the detection and tracking of multiple objects in top view surveillance.The framework consists of a smart robotic camera embedded with the visual processing unit.The existing pre-trained deep learning models named SSD and YOLO has been adopted for object detection and localization.The detection models are further combined with different tracking algorithms,including GOTURN,MEDIANFLOW,TLD,KCF,MIL,and BOOSTING.These algorithms,along with detection models,help to track and predict the trajectories of detected objects.The pre-trained models are employed;therefore,the generalization performance is also investigated through testing the models on various sequences of top view data set.The detection models achieved maximum True Detection Rate 93%to 90%with a maximum 0.6%False Detection Rate.The tracking results of different algorithms are nearly identical,with tracking accuracy ranging from 90%to 94%.Furthermore,a discussion has been carried out on output results along with future guidelines.

Passive target tracking with intermittent measurement based on random finite set

In the tracking problem for the maritime radiation source by a passive sensor,there are three main difficulties,i.e.,the poor observability of the radiation source,the detection uncertainty(false and missed detections)and the uncertainty of the target appearing/disappearing in the field of view.These difficulties can make the establishment or maintenance of the radiation source target track invalid.By incorporating the elevation information of the passive sensor into the automatic bearings-only tracking(BOT)and consolidating these uncertainties under the framework of random finite set(RFS),a novel approach for tracking maritime radiation source target with intermittent measurement was proposed.Under the RFS framework,the target state was represented as a set that can take on either an empty set or a singleton; meanwhile,the measurement uncertainty was modeled as a Bernoulli random finite set.Moreover,the elevation information of the sensor platform was introduced to ensure observability of passive measurements and obtain the unique target localization.Simulation experiments verify the validity of the proposed approach for tracking maritime radiation source and demonstrate the superiority of the proposed approach in comparison with the traditional integrated probabilistic data association(IPDA)method.The tracking performance under different conditions,particularly involving different existence probabilities and different appearance durations of the target,indicates that the method to solve our problem is robust and effective.

Simultaneous Multi-vehicle Detection and Tracking Framework with Pavement Constraints Based on Machine Learning and Particle Filter Algorithm

Due to the large variations of environment with ever-changing background and vehicles with different shapes, colors and appearances, to implement a real-time on-board vehicle recognition system with high adaptability, efficiency and robustness in complicated environments, remains challenging. This paper introduces a simultaneous detection and tracking framework for robust on-board vehicle recognition based on monocular vision technology. The framework utilizes a novel layered machine learning and particle filter to build a multi-vehicle detection and tracking system. In the vehicle detection stage, a layered machine learning method is presented, which combines coarse-search and fine-search to obtain the target using the AdaBoost-based training algorithm. The pavement segmentation method based on characteristic similarity is proposed to estimate the most likely pavement area. Efficiency and accuracy are enhanced by restricting vehicle detection within the downsized area of pavement. In vehicle tracking stage, a multi-objective tracking algorithm based on target state management and particle filter is proposed. The proposed system is evaluated by roadway video captured in a variety of traffics, illumination, and weather conditions. The evaluating results show that, under conditions of proper illumination and clear vehicle appearance, the proposed system achieves 91.2% detection rate and 2.6% false detection rate. Experiments compared to typical algorithms show that, the presented algorithm reduces the false detection rate nearly by half at the cost of decreasing 2.7%–8.6% detection rate. This paper proposes a multi-vehicle detection and tracking system, which is promising for implementation in an on-board vehicle recognition system with high precision, strong robustness and low computational cost.

Surrounding Objects Detection and Tracking for Autonomous Driving Using LiDAR and Radar Fusion

Radar and LiDAR are two environmental sensors commonly used in autonomous vehicles,Lidars are accurate in determining objects’positions but significantly less accurate as Radars on measuring their velocities.However,Radars relative to Lidars are more accurate on measuring objects velocities but less accurate on determining their positions as they have a lower spatial resolution.In order to compensate for the low detection accuracy,incomplete target attributes and poor environmental adaptability of single sensors such as Radar and LiDAR,in this paper,an effective method for high-precision detection and tracking of surrounding targets of autonomous vehicles.By employing the Unscented Kalman Filter,Radar and LiDAR information is effectively fused to achieve high-precision detection of the position and speed information of targets around the autonomous vehicle.Finally,the real vehicle test under various driving environment scenarios is carried out.The experimental results show that the proposed sensor fusion method can effectively detect and track the vehicle peripheral targets with high accuracy.Compared with a single sensor,it has obvious advantages and can improve the intelligence level of autonomous cars.

Motion Tracking with Fast Adaptive Background Subtraction

To extract and tr ack moving objects is usually one of the most important tasks of intelligent video surveillance systems. This paper presents a fast and adaptive background subtraction algorithm and the motion tracking process using this algorithm. The algorithm uses only luminance components of sampled image sequence pixels and models every pixel in a statistical model. The algorithm is characterized by its ability of real time detecting sudden lighting changes, and extracting and tracking motion objects faster. It is shown that our algorithm can be realized with lower time and space complexity and adjustable object detection error rate with comparison to other background subtraction algorithms. Making use of the algorithm, an indoor monitoring system is also worked out and the motion tracking process is presented in this paper. Experimental results testify the algorithm's good performances when used in an indoor monitoring system.

A robust system for real-time pedestrian detection and tracking

A real-time pedestrian detection and tracking system using a single video camera was developed to monitor pedestrians. This system contained six modules: video flow capture, pre-processing, movement detection, shadow removal, tracking, and object classification. The Gaussian mixture model was utilized to extract the moving object from an image sequence segmented by the mean-shift technique in the pre-processing module. Shadow removal was used to alleviate the negative impact of the shadow to the detected objects. A model-free method was adopted to identify pedestrians. The maximum and minimum integration methods were developed to integrate multiple cues into the mean-shift algorithm and the initial tracking iteration with the competent integrated probability distribution map for object tracking. A simple but effective algorithm was proposed to handle full occlusion cases. The system was tested using real traffic videos from different sites. The results of the test confirm that the system is reliable and has an overall accuracy of over 85%.

BACKGROUND RECONSTRUCTION AND OBJECT EXTRACTION BASED ON COLOR AND OBJECT TRACKING

In YCbCr colorspace, a method is proposed to reconstruct the background and extract moving objects based on the Gaussian model of chroma components. Background model is updated according to changes of chroma components. In order to eliminate the disturbance of shadow, a shadow detecting principle is proposed in YCbCr colorspace. A Kalman filter is introduced to estimate objects＇ positions in the image and then the pedestrian is tracked according to its information of shape. Experiments show that the background reconstruction and updating are successful, object extraction and shadow suppression are satisfactory, and real-time and reliable tracking is realized.

Architectural Building Detection and Tracking in Video Sequences Taken by Unmanned Aircraft System （UAS）

An Unmanned Aircraft System （UAS） is an aircraft or ground station that can be either remote controlled manually or is capable of flying autonomously under the guidance of pre-programmed Global Positioning System （GPS） waypoint flight plans or more complex onboard intelligent systems. The UAS aircrafts have recently found extensive applications in military reconnaissance and surveillance, homeland security, precision agriculture, fire monitoring and analysis, and other different kinds of aids needed in disasters. Through surveillance videos captured by a UAS digital imaging payload over the interest areas, the corresponding UAS missions can be conducted. In this paper, the authors present an effective method to detect and extract architectural buildings under rural environment from UAS video sequences. The SIFT points are chosen as image features. The planar homography is adopted as the motion model between different image frames. The proposed algorithm is tested on real UAS video data.

Tracking Human Poses with Head Orientation Estimation

Lots of progress has been made recently on 2 D human pose tracking with tracking-by-detection approaches. However,several challenges still remain in this area which is due to self-occlusions and the confusion between the left and right limbs during tracking. In this work,a head orientation detection step is introduced into the tracking framework to serve as a complementary tool to assist human pose estimation. With the face orientation determined,the system can decide whether the left or right side of the human body is exactly visible and infer the state of the symmetric counterpart. By granting a higher priority for the completely visible side,the system can avoid double counting to a great extent when inferring body poses. The proposed framework is evaluated on the HumanEva dataset. The results show that it largely reduces the occurrence of double counting and distinguishes the left and right sides consistently.

Road boundary estimation to improve vehicle detection and tracking in UAV video

Video processing is one challenge in collecting vehicle trajectories from unmanned aerial vehicle(UAV) and road boundary estimation is one way to improve the video processing algorithms. However, current methods do not work well for low volume road, which is not well-marked and with noises such as vehicle tracks. A fusion-based method termed Dempster-Shafer-based road detection(DSRD) is proposed to address this issue. This method detects road boundary by combining multiple information sources using Dempster-Shafer theory(DST). In order to test the performance of the proposed method, two field experiments were conducted, one of which was on a highway partially covered by snow and another was on a dense traffic highway. The results show that DSRD is robust and accurate, whose detection rates are 100% and 99.8% compared with manual detection results. Then, DSRD is adopted to improve UAV video processing algorithm, and the vehicle detection and tracking rate are improved by 2.7% and 5.5%,respectively. Also, the computation time has decreased by 5% and 8.3% for two experiments, respectively.

Study on Dim Target Detection and Discrimination from Sea Clutter

Dim target detection from sea clutter is one of the difficult topics in ocean remote sensing application. By aiming at the shortcoming of false alarms when using track before detect （TBD） based on dynamic programming, a new discrimination method called statistics of direction histogram （SDH） is proposed, which is based on different features of trajectories between the true target and false one. Moreover, a new series of discrimination schemes of SDH and Local Extreme Value method （LEV） are studied and applied to simulate the actually measured radar data. The results show that the given discrimination is effective to reduce false alarms during dim targets detection.

Improved multi-target radar TBD algorithm

Considering radar detection for multi-target recognition, a track before detect （TBD） algorithm based on Hough transform is adopted for identifying and tracking multi-target radar. By increasing the dimensions of the target characteristic parameters, the target detection and track accuracy is increased. Also, by multilevel filtering processing, the diverging points of the echo signal are condensed, which improves the performance of identifying and tracking multiple targets. Simulation results show that compared with traditional TBD algorithms, the presented algorithm has better performance in the aspects of multi-target tracking, detecting and distinguishing.

Characteristics of cyclone climatology and variability in the Southern Ocean

A new climatology of cyclones in the Southern Ocean is generated by applying an automated cyclone detection and tracking algorithm （developed by Hodges at the Reading University） for an improved and relatively high- resolution European Centre for Medium-Range Weather Forecasts atmospheric reanalysis during 1979-2013. A validation shows that identified cyclone tracks are in good agreement with a available analyzed cyclone product. The climatological characteristics of the Southern Ocean cyclones are then analyzed, including track, number, density, intensity, deepening rate and explosive events. An analysis shows that the number of cyclones in the Southern Ocean has increased for 1979-2013, but only statistically significant in summer. Coincident with the circumpolar trough, a single high-density band of cyclones is observed in 55^-67~S, and cyclone density has generally increased in north of this band for 1979-2013, except summer. The intensity of up to 70% cyclones in the Southern Ocean is less than 980 hPa, and only a few cyclones with pressure less than 920 hPa are detected for 1979-2013. Further analysis shows that a high frequency of explosive cyclones is located in the band of 45^-55~S, and the Atlantic Ocean sector has much higher frequent occurrence of the explosive cyclones than that in the Pacific Ocean sector. Additionally, the relationship between cyclone activities in the Southern Ocean and the Southern Annular Mode is discussed.

The TBD method for dim targets based on multi-level crossover and matching operator

In order to improve the tracking performance in this paper following TBD(Track before Detection) framework multi-level crossover and matching operator is presented.In data association stage the greedy principle is adopted to handle time complexity in DPA and at the same time crossover mathing operator is given to construct candidate trajectory.In addition the corresponding strategy is introduced in preprocessing and postprocessing to remove clutter and suppress false alarm rate.By the experimental comparison and analysis it can be found that the method is more perfer to strengthen the tracking performance of targets with SNR < 2.0 dB.

Seasonal and inter-annual variations of Arctic cyclones and their linkage with Arctic sea ice and atmospheric teleconnections

The seasonal and inter-annual variations of Arctic cyclone are investigated. An automatic cyclone tracking algorithm developed by University of Reading was applied on the basis of European Center for Medium-range Weather Forecasts（ECMWF） ERA-interim mean sea level pressure field with 6 h interval for 34 a period. The maximum number of the Arctic cyclones is counted in winter, and the minimum is in spring not in summer.About 50% of Arctic cyclones in summer generated from south of 70°N, moving into the Arctic. The number of Arctic cyclones has large inter-annual and seasonal variabilities, but no significant linear trend is detected for the period 1979–2012. The spatial distribution and linear trends of the Arctic cyclones track density show that the cyclone activity extent is the widest in summer with significant increasing trend in CRU（central Russia）subregion, and the largest track density is in winter with decreasing trend in the same subregion. The linear regressions between the cyclone track density and large-scale indices for the same period and pre-period sea ice area indices show that Arctic cyclone activities are closely linked to large-scale atmospheric circulations, such as Arctic Oscillation（AO）, North Atlantic Oscillation（NAO） and Pacific-North American Pattern（PNA）. Moreover,the pre-period sea ice area is significantly associated with the cyclone activities in some regions.

Real-time lane departure warning system based on principal component analysis of grayscale distribution and risk evaluation model

A technology for unintended lane departure warning was proposed. As crucial information, lane boundaries were detected based on principal component analysis of grayscale distribution in search bars of given number and then each search bar was tracked using Kalman filter between frames. The lane detection performance was evaluated and demonstrated in ways of receiver operating characteristic, dice similarity coefficient and real-time performance. For lane departure detection, a lane departure risk evaluation model based on lasting time and frequency was effectively executed on the ARM-based platform. Experimental results indicate that the algorithm generates satisfactory lane detection results under different traffic and lighting conditions, and the proposed warning mechanism sends effective warning signals, avoiding most false warning.

AN APPLIED RESEARCH ON APPROACH OF DYADIC WAVELET TRANSFORM FOR REMOTE SENSING IMAGE EDGE DETECTION

In the edge detection of Remote Sensing (RS) image, the useful detail losing and the spurious edge often appear. To solve the problem, the authors uses the dyadic wavelet to detect the edge of surface features by combining the edge detecting with the multi-resolution analyzing of the wavelet transform. Via the dyadic wavelet decomposing, the RS image of a certain appropriate scale is obtained, and the edge data of the plane and the upright directions are respectively figured out, then the gradient vector module of the surface features is worked out. By tracing them, the authors get the edge data of the object, therefore build the RS image which obtains the checked edge. This method can depress the effect of noise and examine exactly the edge data of the object by rule and line. With an experiment of an RS image which obtains an airport, the authors certificate the feasibility of the application of dyadic wavelet in the object edge detection.