Unmanned Aerial Vehicle(UAV)tracking has been possible because of the growth of intelligent information technology in smart cities,making it simple to gather data at any time by dynamically monitoring events,people,th...Unmanned Aerial Vehicle(UAV)tracking has been possible because of the growth of intelligent information technology in smart cities,making it simple to gather data at any time by dynamically monitoring events,people,the environment,and other aspects in the city.The traditional filter creates a model to address the boundary effect and time filter degradation issues in UAV tracking operations.But these methods ignore the loss of data integrity terms since they are overly dependent on numerous explicit previous regularization terms.In light of the aforementioned issues,this work suggests a dual-domain Jensen-Shannon divergence correlation filter(DJSCF)model address the probability-based distance measuring issue in the event of filter degradation.The two-domain weighting matrix and JS divergence constraint are combined to lessen the impact of sample imbalance and distortion.Two new tracking models that are based on the perspectives of the actual probability filter distribution and observation probability filter distribution are proposed to translate the statistical distance in the online tracking model into response fitting.The model is roughly transformed into a linear equality constraint issue in the iterative solution,which is then solved by the alternate direction multiplier method(ADMM).The usefulness and superiority of the suggested strategy have been shown by a vast number of experimental findings.展开更多
Noise is the biggest obstacle that makes the incipient fault diagnosis results of roller bearings uncorrected; a new method for diagnosing incipient fault of roller bearings based on the Wavelet Transform Correlation ...Noise is the biggest obstacle that makes the incipient fault diagnosis results of roller bearings uncorrected; a new method for diagnosing incipient fault of roller bearings based on the Wavelet Transform Correlation Filter and Hilbert Transform was proposed. First, the weak fault information features are picked up from the roller bearings fault vibration signals by use of a de-noising characteristic of the Wavelet Transform Correlation Filter as the preprocessing of the Hilbert Envelope Analysis. Then, in order to get fault features frequency, de-noised wavelet coefficients of high scales which represent high frequency signal were analyzed by Hilbert Envelope Spectrum Analysis. The simulation signals and diagnosing examples analysis results reveal that the proposed method is more effective than the method of direct wavelet coefficients-Hilbert Transform in de-noising and clarifying roller bearing incipient fault.展开更多
In recent visual tracking research,correlation filter(CF)based trackers become popular because of their high speed and considerable accuracy.Previous methods mainly work on the extension of features and the solution o...In recent visual tracking research,correlation filter(CF)based trackers become popular because of their high speed and considerable accuracy.Previous methods mainly work on the extension of features and the solution of the boundary effect to learn a better correlation filter.However,the related studies are insufficient.By exploring the potential of trackers in these two aspects,a novel adaptive padding correlation filter(APCF)with feature group fusion is proposed for robust visual tracking in this paper based on the popular context-aware tracking framework.In the tracker,three feature groups are fused by use of the weighted sum of the normalized response maps,to alleviate the risk of drift caused by the extreme change of single feature.Moreover,to improve the adaptive ability of padding for the filter training of different object shapes,the best padding is selected from the preset pool according to tracking precision over the whole video,where tracking precision is predicted according to the prediction model trained by use of the sequence features of the first several frames.The sequence features include three traditional features and eight newly constructed features.Extensive experiments demonstrate that the proposed tracker is superior to most state-of-the-art correlation filter based trackers and has a stable improvement compared to the basic trackers.展开更多
The field of object tracking has recently made significant progress.Particularly,the performance results in both deep learning and correlation filters,based trackers achieved effective tracking performance.Moreover,th...The field of object tracking has recently made significant progress.Particularly,the performance results in both deep learning and correlation filters,based trackers achieved effective tracking performance.Moreover,there are still some difficulties with object tracking for example illumination and deformation(DEF).The precision and accuracy of tracking algorithms suffer from the effects of such occurrences.For this situation,finding a solution is important.This research proposes a new tracking algorithm to handle this problem.The features are extracted by using Modified LeNet-5,and the precision and accuracy are improved by developing the Real-Time Cross-modality Correlation Filtering method(RCCF).In Modified LeNet-5,the visual tracking performance is improved by adjusting the number and size of the convolution kernels in the pooling and convolution layers.The high-level,middle-level,and handcraft features are extracted from the modified LeNet-5 network.The handcraft features are used to determine the specific location of the target because the handcraft features contain more spatial information regarding the visual object.The LeNet features are more suitable for a target appearance change in object tracking.Extensive experiments were conducted by the Object Tracking Benchmarking(OTB)databases like OTB50 and OTB100.The experimental results reveal that the proposed tracker outperforms other state-of-the-art trackers under different problems.The experimental simulation is carried out in python.The overall success rate and precision of the proposed algorithm are 93.8%and 92.5%.The average running frame rate reaches 42 frames per second,which can meet the real-time requirements.展开更多
Aiming at the problem that a single correlation filter model is sensitive to complex scenes such as background interference and occlusion,a tracking algorithm based on multi-time-space perception and instance-specific...Aiming at the problem that a single correlation filter model is sensitive to complex scenes such as background interference and occlusion,a tracking algorithm based on multi-time-space perception and instance-specific proposals is proposed to optimize the mathematical model of the correlation filter(CF).Firstly,according to the consistency of the changes between the object frames and the filter frames,the mask matrix is introduced into the objective function of the filter,so as to extract the spatio-temporal information of the object with background awareness.Secondly,the object function of multi-feature fusion is constructed for the object location,which is optimized by the Lagrange method and solved by closed iteration.In the process of filter optimization,the constraints term of time-space perception is designed to enhance the learning ability of the CF to optimize the final track-ing results.Finally,when the tracking results fluctuate,the boundary suppres-sion factor is introduced into the instance-specific proposals to reduce the risk of model drift effectively.The accuracy and success rate of the proposed algorithm are verified by simulation analysis on two popular benchmarks,the object tracking benchmark 2015(OTB2015)and the temple color 128(TC-128).Extensive experimental results illustrate that the optimized appearance model of the proposed algorithm is effective.The distance precision rate and overlap success rate of the proposed algorithm are 0.756 and 0.656 on the OTB2015 benchmark,which are better than the results of other competing algorithms.The results of this study can solve the problem of real-time object tracking in the real traffic environment and provide a specific reference for the detection of traffic abnormalities.展开更多
CNN(convolutional neural network)based real time trackers usually do not carry out online network update in order to maintain rapid tracking speed.This inevitably influences the adaptability to changes in object appea...CNN(convolutional neural network)based real time trackers usually do not carry out online network update in order to maintain rapid tracking speed.This inevitably influences the adaptability to changes in object appearance.Correlation filter based trackers can update the model parameters online in real time.In this paper,we present an end-to-end lightweight network architecture,namely Discriminant Correlation Filter Network(DCFNet).A differentiable DCF(discriminant correlation filter)layer is incorporated into a Siamese network architecture in order to learn the convolutional features and the correlation filter simultaneously.The correlation filter can be efficiently updated online.In previous work,we introduced a joint scale-position space to the DCFNet,forming a scale DCFNet which carries out the predictions of object scale and position simultaneously.We combine the scale DCFNet with the convolutional-deconvolutional network,learning both the high-level embedding space representations and the low-level fine-grained representations for images.The adaptability of the fine-grained correlation analysis and the generalization capability of the semantic embedding are complementary for visual tracking.The back-propagation is derived in the Fourier frequency domain throughout the entire work,preserving the efficiency of the DCF.Extensive evaluations on the OTB(Object Tracking Benchmark)and VOT(Visual Object Tracking Challenge)datasets demonstrate that the proposed trackers have fast speeds,while maintaining tracking accuracy.展开更多
In order to improve the tracking performance in this paper following TBD(Track before Detection) framework multi-level crossover and matching operator is presented.In data association stage the greedy principle is ado...In order to improve the tracking performance in this paper following TBD(Track before Detection) framework multi-level crossover and matching operator is presented.In data association stage the greedy principle is adopted to handle time complexity in DPA and at the same time crossover mathing operator is given to construct candidate trajectory.In addition the corresponding strategy is introduced in preprocessing and postprocessing to remove clutter and suppress false alarm rate.By the experimental comparison and analysis it can be found that the method is more perfer to strengthen the tracking performance of targets with SNR < 2.0 dB.展开更多
This paper proposes a new signal noise level estimation approach by local regions. The estimated noise variance is applied as the threshold for an improved empirical mode decomposition(EMD) based signal denoising me...This paper proposes a new signal noise level estimation approach by local regions. The estimated noise variance is applied as the threshold for an improved empirical mode decomposition(EMD) based signal denoising method. The proposed estimation method can effectively extract the candidate regions for the noise level estimation by measuring the correlation coefficient between noisy signal and a Gaussian filtered signal. For the improved EMD based method, the situation of decomposed intrinsic mode function(IMFs) which contains noise and signal simultaneously are taken into account. Experimental results from two simulated signals and an X-ray pulsar signal demonstrate that the proposed method can achieve better performance than the conventional EMD and wavelet transform(WT) based denoising methods.展开更多
To solve the problem of low robustness of trackers under significant appearance changes in complex background,a novel moving target tracking method based on hierarchical deep features weighted fusion and correlation f...To solve the problem of low robustness of trackers under significant appearance changes in complex background,a novel moving target tracking method based on hierarchical deep features weighted fusion and correlation filter is proposed.Firstly,multi-layer features are extracted by a deep model pre-trained on massive object recognition datasets.The linearly separable features of Relu3-1,Relu4-1 and Relu5-4 layers from VGG-Net-19 are especially suitable for target tracking.Then,correlation filters over hierarchical convolutional features are learned to generate their correlation response maps.Finally,a novel approach of weight adjustment is presented to fuse response maps.The maximum value of the final response map is just the location of the target.Extensive experiments on the object tracking benchmark datasets demonstrate the high robustness and recognition precision compared with several state-of-the-art trackers under the different conditions.展开更多
Based on time correlation characteristic, width correlation characteristic and frequency correlation characteristic of detecting pulses, several methods are introduced to control random or periodic noise whose width i...Based on time correlation characteristic, width correlation characteristic and frequency correlation characteristic of detecting pulses, several methods are introduced to control random or periodic noise whose width is narrower than 1 ms or wider than 3 ms in Frequency Selection Detecting Radar System. The software flow chart and the results of the experiment are also given.展开更多
The downlink frame structure for beyond 3G mobile communication systems is presented. Beyond 3G systems utilize the OFDM technique. However, a problem encountered in OFDM is that channel dispersion destroys orthogonal...The downlink frame structure for beyond 3G mobile communication systems is presented. Beyond 3G systems utilize the OFDM technique. However, a problem encountered in OFDM is that channel dispersion destroys orthogonality between carriers, caushag inter-symbol interference. It is also sensitive to high peak to mean power ratio (PAPR). Therefore it spends much time on obtaining frequency, time, and frame synchronization. This paper proposes to add a frame synchronization channel in the time domain to overcome the shortcoming of OFDM. As transmitter diversity improves the system performance, beyond 3G systems employ space-time block coded (STBC). Fast cell search algorithm including slot synchronization, frame synchronization and cell ID identification is then discussed, which is based on the frame synchronization channel in transmitter diversity systems. Detection and false alarm probabilities in AWGN and Rayleigh channels are analyzed, and the mean acquisition time is obtained. Computer simulations are conducted to evaluate the performance of the cell search algorithm under different channel conditions.展开更多
Aiming to the problem of pedestrian tracking with frequent or long-term occlusion in complex scenes,an anti-occlusion pedestrian tracking algorithm based on location prediction and deep feature rematch is proposed.Fir...Aiming to the problem of pedestrian tracking with frequent or long-term occlusion in complex scenes,an anti-occlusion pedestrian tracking algorithm based on location prediction and deep feature rematch is proposed.Firstly,the occlusion judgment is realized by extracting and utilizing deep feature of pedestrian’s appearance,and then the scale adaptive kernelized correlation filter is introduced to implement pedestrian tracking without occlusion.Secondly,Karman filter is introduced to predict the location of occluded pedestrian position.Finally,the deep feature is used to the rematch of pedestrian in the reappearance process.Simulation experiment and analysis show that the proposed algorithm can effectively detect and rematch pedestrian under the condition of frequent or long-term occlusion.展开更多
One of the essential techniques for using underwater robots to fish sea cucumbers is that the robots must track sea cucumbers using computer vision technology.Tracking underwater targets is a challenging task due to s...One of the essential techniques for using underwater robots to fish sea cucumbers is that the robots must track sea cucumbers using computer vision technology.Tracking underwater targets is a challenging task due to suspension,water absorption,and light scattering.This study proposed a simple but effective algorithm for sea cucumber tracking based on Kernelized Correlation Filters(KCF)framework.This method tracked the head and tail of the sea cucumber respectively and calculated the scale change according to the distance between the head and tail.The KCF method was improved on three strategies.First of all,the target was searched at the predicted position to improve accuracy.Secondly,an adaptive learning rate updating method based on the detection score of each frame was proposed.Finally,the adaptive size of the histogram of the oriented gradient(HOG)feature was used to balance the accuracy and efficiency.Experimental results showed that the algorithm had good tracking performance.展开更多
Tracking the movement of droplets in digital microfluidics is essential to improve its control stability and obtain dynamic information for its applications such as point-of-care testing,environment monitoring and che...Tracking the movement of droplets in digital microfluidics is essential to improve its control stability and obtain dynamic information for its applications such as point-of-care testing,environment monitoring and chemical synthesis.Herein,an intelligent,accurate and fast droplet tracking method based on machine vision is developed for applications of digital microfluidics.To continuously recognize the transparent droplets in real-time and avoid the interferes from background patterns or inhomogeneous illumination,we introduced the correlation filter tracker,enabling online learning of the multi-features of the droplets in Fourier domain.Results show the proposed droplet tracking method could accurately locate the droplets.We also demonstrated the capacity of the proposed method for estimation of the droplet velocity as faster as 20 mm/s,and its application in online monitoring the Griess reaction for both colorimetric assay of nitrite and study of reaction kinetics.展开更多
Discriminative correlation filters(DCF)are efficient in visual tracking and have advanced the field significantly.However,the symmetry of correlation(or convolution)operator results in computational problems and does ...Discriminative correlation filters(DCF)are efficient in visual tracking and have advanced the field significantly.However,the symmetry of correlation(or convolution)operator results in computational problems and does harm to the generalized translation equivariance.The former problem has been approached in many ways,whereas the latter one has not been well recognized.In this paper,we analyze the problems with the symmetry of circular convolution and propose an asymmetric one,which as a generalization of the former has a weak generalized translation equivariance property.With this operator,we propose a tracker called the asymmetric discriminative correlation filter(ADCF),which is more sensitive to translations of targets.Its asymmetry allows the filter and the samples to have different sizes.This flexibility makes the computational complexity of ADCF more controllable in the sense that the number of filter parameters will not grow with the sample size.Moreover,the normal matrix of ADCF is a block matrix with each block being a two-level block Toeplitz matrix.With this well-structured normal matrix,we design an algorithm for multiplying an N×N two-level block Toeplitz matrix by a vector with time complexity O(N log N)and space complexity O(N),instead of O(N^2).Unlike DCF-based trackers,introducing spatial or temporal regularization does not increase the essential computational complexity of ADCF.Comparative experiments are performed on a synthetic dataset and four benchmarks,including OTB-2013,OTB-2015,VOT-2016,and Temple-Color,and the results show that our method achieves state-of-the-art visual tracking performance.展开更多
It is seriously interfered by ship noise when analyzing and extracting broadband spark sound source signal. In the energy concentrated domain which is below 5 kHz, the traditional scale correlation filtering algorithm...It is seriously interfered by ship noise when analyzing and extracting broadband spark sound source signal. In the energy concentrated domain which is below 5 kHz, the traditional scale correlation filtering algorithm, which is based on adjacent-scale correlation, has limited anti-interference ability due to the low signal-to-noise ratio (SNR) and similar Lipschitz exponent characteristic of each other. However, because different frequency bands of the broadband electric spark signal have different noise interferences, the filtering algorithm based on adjacent-scale correlation is adapted to high SNR and small-scale high-frequency wavelet coefficients filtering; the filtering algorithm based on cross-scale correlation is adapted to low SNR and large-scale low-frequency wavelet coefficients filtering, and the threshold coefficient selection method had been corrected in the algorithm. It is shown that the filtering algorithm has a good filtering effect and extracts the broadband spark sound source signal effectively; it is applicable to broadband underwater acoustic signM processing in the presence of narrow-band strong interference background noise.展开更多
We propose a novel method of slice image reconstruction with controllable spatial filtering by using the correlation of periodic delta-function arrays (PDFAs) with elemental images in computational integral imaging....We propose a novel method of slice image reconstruction with controllable spatial filtering by using the correlation of periodic delta-function arrays (PDFAs) with elemental images in computational integral imaging. The multiple PDFAs, whose spatial periods correspond to object's depths with the elemental image array (EIA), can generate a set of spatially filtered EIAs for multiple object depths compared with the conventional method for the depth of a single object. We analyze a controllable spatial filtering effect by the proposed method. To show the feasibility of the proposed method, we carry out preliminary experiments for multiple objects and present the results.展开更多
A robust and eficient feature matching method is necessary for visual navigation in asteroid-landing missions.Based on the visual navigation framework and motion characteristics of asteroids,a robust and efficient tem...A robust and eficient feature matching method is necessary for visual navigation in asteroid-landing missions.Based on the visual navigation framework and motion characteristics of asteroids,a robust and efficient template feature matching method is proposed to adapt to feature distortion and scale change cases for visual navigation of asteroids.The proposed method is primarily based on a motion-constrained discriminative correlation filter(DCF).The prior information provided by the motion constraints between sequence images is used to provide a predicted search region for template feature matching.Additionally,some specific template feature samples are generated using the motion constraints for correlation filter learning,which is beneficial for training a scale and feature distortion adaptive correlation filter for accurate feature matching.Moreover,average peak-to-correlation energy(APCE)and jointly consistent measurements(JCMs)were used to eliminate false matching.Images captured by the Touch And Go Camera System(TAGCAMS)of the Bennu asteroid were used to evaluate the performance of the proposed method.In particular,both the robustness and accuracy of region matching and template center matching are evaluated.The qualitative and quantitative results illustrate the advancement of the proposed method in adapting to feature distortions and large-scale changes during spacecraft landing.展开更多
In the process of tracking the target of the pig,with the change of the size of the tracking target in the video image,the estimated tracking target scale cannot be adaptively updated in real-time,resulting in the low...In the process of tracking the target of the pig,with the change of the size of the tracking target in the video image,the estimated tracking target scale cannot be adaptively updated in real-time,resulting in the low accuracy of the tracking target.In this study,a multi-channel color feature adaptive fusion algorithm was proposed,and the target scale of the pig was updated in real-time by utilizing the contour information of the target pig.Experiments show that the proposed algorithm had a distance precision of 89.7%and an overlap precision of 87.5%,and the average running speed of this algorithm was 50.1 fps.The robustness of the proposed algorithm in tracking target deformation and scale variation were significantly improved,which satisfies the accuracy and real-time requirements of pig target tracking.展开更多
Almost all conventional open-loop particle image velocimetry(PIV) methods employ fixed-interval-time optical imaging technology and the time-consuming cross-correlation-based PIV measurement algorithm to calculate the...Almost all conventional open-loop particle image velocimetry(PIV) methods employ fixed-interval-time optical imaging technology and the time-consuming cross-correlation-based PIV measurement algorithm to calculate the velocity field.In this study,a novel real-time adaptive particle image velocity(RTA-PIV) method is proposed to accurately measure the instantaneous velocity field of an unsteady flow field.In the proposed closed-loop RTA-PIV method,a new correlation-filter-based PIV measurement algorithm is introduced to calculate the velocity field in real time.Then,a Kalman predictor model is established to predict the velocity of the next time instant and a suitable interval time can be determined.To adaptively adjust the interval time for capturing two particle images,a new high-speed frame-straddling vision system is developed for the proposed RTA-PIV method.To fully analyze the performance of the RTA-PIV method,we conducted a series of numerical experiments on ground-truth image pairs and on real-world image sequences.展开更多
基金supported by the National Natural Science Foundation of China under Grant 62072256Natural Science Foundation of Nanjing University of Posts and Telecommunications(Grant Nos.NY221057,NY220003).
文摘Unmanned Aerial Vehicle(UAV)tracking has been possible because of the growth of intelligent information technology in smart cities,making it simple to gather data at any time by dynamically monitoring events,people,the environment,and other aspects in the city.The traditional filter creates a model to address the boundary effect and time filter degradation issues in UAV tracking operations.But these methods ignore the loss of data integrity terms since they are overly dependent on numerous explicit previous regularization terms.In light of the aforementioned issues,this work suggests a dual-domain Jensen-Shannon divergence correlation filter(DJSCF)model address the probability-based distance measuring issue in the event of filter degradation.The two-domain weighting matrix and JS divergence constraint are combined to lessen the impact of sample imbalance and distortion.Two new tracking models that are based on the perspectives of the actual probability filter distribution and observation probability filter distribution are proposed to translate the statistical distance in the online tracking model into response fitting.The model is roughly transformed into a linear equality constraint issue in the iterative solution,which is then solved by the alternate direction multiplier method(ADMM).The usefulness and superiority of the suggested strategy have been shown by a vast number of experimental findings.
文摘Noise is the biggest obstacle that makes the incipient fault diagnosis results of roller bearings uncorrected; a new method for diagnosing incipient fault of roller bearings based on the Wavelet Transform Correlation Filter and Hilbert Transform was proposed. First, the weak fault information features are picked up from the roller bearings fault vibration signals by use of a de-noising characteristic of the Wavelet Transform Correlation Filter as the preprocessing of the Hilbert Envelope Analysis. Then, in order to get fault features frequency, de-noised wavelet coefficients of high scales which represent high frequency signal were analyzed by Hilbert Envelope Spectrum Analysis. The simulation signals and diagnosing examples analysis results reveal that the proposed method is more effective than the method of direct wavelet coefficients-Hilbert Transform in de-noising and clarifying roller bearing incipient fault.
基金supported by the National KeyResearch and Development Program of China(2018AAA0103203)the National Natural Science Foundation of China(62073036,62076031)the Beijing Natural Science Foundation(4202071)。
文摘In recent visual tracking research,correlation filter(CF)based trackers become popular because of their high speed and considerable accuracy.Previous methods mainly work on the extension of features and the solution of the boundary effect to learn a better correlation filter.However,the related studies are insufficient.By exploring the potential of trackers in these two aspects,a novel adaptive padding correlation filter(APCF)with feature group fusion is proposed for robust visual tracking in this paper based on the popular context-aware tracking framework.In the tracker,three feature groups are fused by use of the weighted sum of the normalized response maps,to alleviate the risk of drift caused by the extreme change of single feature.Moreover,to improve the adaptive ability of padding for the filter training of different object shapes,the best padding is selected from the preset pool according to tracking precision over the whole video,where tracking precision is predicted according to the prediction model trained by use of the sequence features of the first several frames.The sequence features include three traditional features and eight newly constructed features.Extensive experiments demonstrate that the proposed tracker is superior to most state-of-the-art correlation filter based trackers and has a stable improvement compared to the basic trackers.
文摘The field of object tracking has recently made significant progress.Particularly,the performance results in both deep learning and correlation filters,based trackers achieved effective tracking performance.Moreover,there are still some difficulties with object tracking for example illumination and deformation(DEF).The precision and accuracy of tracking algorithms suffer from the effects of such occurrences.For this situation,finding a solution is important.This research proposes a new tracking algorithm to handle this problem.The features are extracted by using Modified LeNet-5,and the precision and accuracy are improved by developing the Real-Time Cross-modality Correlation Filtering method(RCCF).In Modified LeNet-5,the visual tracking performance is improved by adjusting the number and size of the convolution kernels in the pooling and convolution layers.The high-level,middle-level,and handcraft features are extracted from the modified LeNet-5 network.The handcraft features are used to determine the specific location of the target because the handcraft features contain more spatial information regarding the visual object.The LeNet features are more suitable for a target appearance change in object tracking.Extensive experiments were conducted by the Object Tracking Benchmarking(OTB)databases like OTB50 and OTB100.The experimental results reveal that the proposed tracker outperforms other state-of-the-art trackers under different problems.The experimental simulation is carried out in python.The overall success rate and precision of the proposed algorithm are 93.8%and 92.5%.The average running frame rate reaches 42 frames per second,which can meet the real-time requirements.
基金funded by the Basic Science Major Foundation(Natural Science)of the Jiangsu Higher Education Institutions of China(Grant:22KJA520012)the Xuzhou Science and Technology Plan Project(Grant:KC21303,KC22305)the sixth“333 project”of Jiangsu Province.
文摘Aiming at the problem that a single correlation filter model is sensitive to complex scenes such as background interference and occlusion,a tracking algorithm based on multi-time-space perception and instance-specific proposals is proposed to optimize the mathematical model of the correlation filter(CF).Firstly,according to the consistency of the changes between the object frames and the filter frames,the mask matrix is introduced into the objective function of the filter,so as to extract the spatio-temporal information of the object with background awareness.Secondly,the object function of multi-feature fusion is constructed for the object location,which is optimized by the Lagrange method and solved by closed iteration.In the process of filter optimization,the constraints term of time-space perception is designed to enhance the learning ability of the CF to optimize the final track-ing results.Finally,when the tracking results fluctuate,the boundary suppres-sion factor is introduced into the instance-specific proposals to reduce the risk of model drift effectively.The accuracy and success rate of the proposed algorithm are verified by simulation analysis on two popular benchmarks,the object tracking benchmark 2015(OTB2015)and the temple color 128(TC-128).Extensive experimental results illustrate that the optimized appearance model of the proposed algorithm is effective.The distance precision rate and overlap success rate of the proposed algorithm are 0.756 and 0.656 on the OTB2015 benchmark,which are better than the results of other competing algorithms.The results of this study can solve the problem of real-time object tracking in the real traffic environment and provide a specific reference for the detection of traffic abnormalities.
基金supported by the National Key Research and Development Program of China under Grant Nos.2020AAA0105802 and 2020AAA0105800the National Natural Science Foundation of China under Grant Nos.62036011,62192782,61721004,and U2033210the Beijing Natural Science Foundation under Grant No.L223003.
文摘CNN(convolutional neural network)based real time trackers usually do not carry out online network update in order to maintain rapid tracking speed.This inevitably influences the adaptability to changes in object appearance.Correlation filter based trackers can update the model parameters online in real time.In this paper,we present an end-to-end lightweight network architecture,namely Discriminant Correlation Filter Network(DCFNet).A differentiable DCF(discriminant correlation filter)layer is incorporated into a Siamese network architecture in order to learn the convolutional features and the correlation filter simultaneously.The correlation filter can be efficiently updated online.In previous work,we introduced a joint scale-position space to the DCFNet,forming a scale DCFNet which carries out the predictions of object scale and position simultaneously.We combine the scale DCFNet with the convolutional-deconvolutional network,learning both the high-level embedding space representations and the low-level fine-grained representations for images.The adaptability of the fine-grained correlation analysis and the generalization capability of the semantic embedding are complementary for visual tracking.The back-propagation is derived in the Fourier frequency domain throughout the entire work,preserving the efficiency of the DCF.Extensive evaluations on the OTB(Object Tracking Benchmark)and VOT(Visual Object Tracking Challenge)datasets demonstrate that the proposed trackers have fast speeds,while maintaining tracking accuracy.
基金Sponsored by the Young Talent Program of Fujian Province (Grant No.2007F3097)
文摘In order to improve the tracking performance in this paper following TBD(Track before Detection) framework multi-level crossover and matching operator is presented.In data association stage the greedy principle is adopted to handle time complexity in DPA and at the same time crossover mathing operator is given to construct candidate trajectory.In addition the corresponding strategy is introduced in preprocessing and postprocessing to remove clutter and suppress false alarm rate.By the experimental comparison and analysis it can be found that the method is more perfer to strengthen the tracking performance of targets with SNR < 2.0 dB.
基金supported by the China Aerospace Science and Technology Corporation’s Aerospace Science and Technology Innovation Fund Project(casc2013086)CAST Innovation Fund Project(cast2012028)
文摘This paper proposes a new signal noise level estimation approach by local regions. The estimated noise variance is applied as the threshold for an improved empirical mode decomposition(EMD) based signal denoising method. The proposed estimation method can effectively extract the candidate regions for the noise level estimation by measuring the correlation coefficient between noisy signal and a Gaussian filtered signal. For the improved EMD based method, the situation of decomposed intrinsic mode function(IMFs) which contains noise and signal simultaneously are taken into account. Experimental results from two simulated signals and an X-ray pulsar signal demonstrate that the proposed method can achieve better performance than the conventional EMD and wavelet transform(WT) based denoising methods.
文摘To solve the problem of low robustness of trackers under significant appearance changes in complex background,a novel moving target tracking method based on hierarchical deep features weighted fusion and correlation filter is proposed.Firstly,multi-layer features are extracted by a deep model pre-trained on massive object recognition datasets.The linearly separable features of Relu3-1,Relu4-1 and Relu5-4 layers from VGG-Net-19 are especially suitable for target tracking.Then,correlation filters over hierarchical convolutional features are learned to generate their correlation response maps.Finally,a novel approach of weight adjustment is presented to fuse response maps.The maximum value of the final response map is just the location of the target.Extensive experiments on the object tracking benchmark datasets demonstrate the high robustness and recognition precision compared with several state-of-the-art trackers under the different conditions.
基金Supported by the 86 3High Technology Project of China( 86 3-8180 2 )
文摘Based on time correlation characteristic, width correlation characteristic and frequency correlation characteristic of detecting pulses, several methods are introduced to control random or periodic noise whose width is narrower than 1 ms or wider than 3 ms in Frequency Selection Detecting Radar System. The software flow chart and the results of the experiment are also given.
基金Project supported by National Natural Science Foundation of China(Grant No . 60272079) , and National High-Technology Researchand Development Program(Grant No .863-2003 AA123310)
文摘The downlink frame structure for beyond 3G mobile communication systems is presented. Beyond 3G systems utilize the OFDM technique. However, a problem encountered in OFDM is that channel dispersion destroys orthogonality between carriers, caushag inter-symbol interference. It is also sensitive to high peak to mean power ratio (PAPR). Therefore it spends much time on obtaining frequency, time, and frame synchronization. This paper proposes to add a frame synchronization channel in the time domain to overcome the shortcoming of OFDM. As transmitter diversity improves the system performance, beyond 3G systems employ space-time block coded (STBC). Fast cell search algorithm including slot synchronization, frame synchronization and cell ID identification is then discussed, which is based on the frame synchronization channel in transmitter diversity systems. Detection and false alarm probabilities in AWGN and Rayleigh channels are analyzed, and the mean acquisition time is obtained. Computer simulations are conducted to evaluate the performance of the cell search algorithm under different channel conditions.
基金the National Natural Science Foundation of China(No.61976080,61771006)the Key Project of Henan Province Education Department(No.19A413006).
文摘Aiming to the problem of pedestrian tracking with frequent or long-term occlusion in complex scenes,an anti-occlusion pedestrian tracking algorithm based on location prediction and deep feature rematch is proposed.Firstly,the occlusion judgment is realized by extracting and utilizing deep feature of pedestrian’s appearance,and then the scale adaptive kernelized correlation filter is introduced to implement pedestrian tracking without occlusion.Secondly,Karman filter is introduced to predict the location of occluded pedestrian position.Finally,the deep feature is used to the rematch of pedestrian in the reappearance process.Simulation experiment and analysis show that the proposed algorithm can effectively detect and rematch pedestrian under the condition of frequent or long-term occlusion.
基金This work was financially supported by the Basic Research Project of Higher Education Institutions of Liaoning Province(Grant No.20210126,No.20210135).
文摘One of the essential techniques for using underwater robots to fish sea cucumbers is that the robots must track sea cucumbers using computer vision technology.Tracking underwater targets is a challenging task due to suspension,water absorption,and light scattering.This study proposed a simple but effective algorithm for sea cucumber tracking based on Kernelized Correlation Filters(KCF)framework.This method tracked the head and tail of the sea cucumber respectively and calculated the scale change according to the distance between the head and tail.The KCF method was improved on three strategies.First of all,the target was searched at the predicted position to improve accuracy.Secondly,an adaptive learning rate updating method based on the detection score of each frame was proposed.Finally,the adaptive size of the histogram of the oriented gradient(HOG)feature was used to balance the accuracy and efficiency.Experimental results showed that the algorithm had good tracking performance.
基金the financial support from the National Natural Science Foundation of China(Nos.31701698,81972017)Shanghai Key Laboratory of Forensic Medicine,Academy of Forensic Science(No.KF1910)Shanghai Shenkang Hospital Development Center to promote clinical skills and clinical innovation ability in municipal hospitals of the Three-year Action Plan Project(No.SHDC2020CR3006A).
文摘Tracking the movement of droplets in digital microfluidics is essential to improve its control stability and obtain dynamic information for its applications such as point-of-care testing,environment monitoring and chemical synthesis.Herein,an intelligent,accurate and fast droplet tracking method based on machine vision is developed for applications of digital microfluidics.To continuously recognize the transparent droplets in real-time and avoid the interferes from background patterns or inhomogeneous illumination,we introduced the correlation filter tracker,enabling online learning of the multi-features of the droplets in Fourier domain.Results show the proposed droplet tracking method could accurately locate the droplets.We also demonstrated the capacity of the proposed method for estimation of the droplet velocity as faster as 20 mm/s,and its application in online monitoring the Griess reaction for both colorimetric assay of nitrite and study of reaction kinetics.
基金Project supported by the National Natural Science Foundation of China(No.61773270)the Key Research and Development Project of Sichuan Province,China(No.2019YFG0491)。
文摘Discriminative correlation filters(DCF)are efficient in visual tracking and have advanced the field significantly.However,the symmetry of correlation(or convolution)operator results in computational problems and does harm to the generalized translation equivariance.The former problem has been approached in many ways,whereas the latter one has not been well recognized.In this paper,we analyze the problems with the symmetry of circular convolution and propose an asymmetric one,which as a generalization of the former has a weak generalized translation equivariance property.With this operator,we propose a tracker called the asymmetric discriminative correlation filter(ADCF),which is more sensitive to translations of targets.Its asymmetry allows the filter and the samples to have different sizes.This flexibility makes the computational complexity of ADCF more controllable in the sense that the number of filter parameters will not grow with the sample size.Moreover,the normal matrix of ADCF is a block matrix with each block being a two-level block Toeplitz matrix.With this well-structured normal matrix,we design an algorithm for multiplying an N×N two-level block Toeplitz matrix by a vector with time complexity O(N log N)and space complexity O(N),instead of O(N^2).Unlike DCF-based trackers,introducing spatial or temporal regularization does not increase the essential computational complexity of ADCF.Comparative experiments are performed on a synthetic dataset and four benchmarks,including OTB-2013,OTB-2015,VOT-2016,and Temple-Color,and the results show that our method achieves state-of-the-art visual tracking performance.
基金supported by the Scientific Research Foundation of Third Institute of Oceanography,SOA(NO.2010018)the Public Science and Technology Research Funds Projects of Ocean(NO.201005004,NO.201305038)
文摘It is seriously interfered by ship noise when analyzing and extracting broadband spark sound source signal. In the energy concentrated domain which is below 5 kHz, the traditional scale correlation filtering algorithm, which is based on adjacent-scale correlation, has limited anti-interference ability due to the low signal-to-noise ratio (SNR) and similar Lipschitz exponent characteristic of each other. However, because different frequency bands of the broadband electric spark signal have different noise interferences, the filtering algorithm based on adjacent-scale correlation is adapted to high SNR and small-scale high-frequency wavelet coefficients filtering; the filtering algorithm based on cross-scale correlation is adapted to low SNR and large-scale low-frequency wavelet coefficients filtering, and the threshold coefficient selection method had been corrected in the algorithm. It is shown that the filtering algorithm has a good filtering effect and extracts the broadband spark sound source signal effectively; it is applicable to broadband underwater acoustic signM processing in the presence of narrow-band strong interference background noise.
基金supported by the information technology(IT)research and development program of MKE/KEIT(10041682Development of High-Definition 3D Image Processing Technologies Using Advanced Integral Imaging with Improved Depth Range)
文摘We propose a novel method of slice image reconstruction with controllable spatial filtering by using the correlation of periodic delta-function arrays (PDFAs) with elemental images in computational integral imaging. The multiple PDFAs, whose spatial periods correspond to object's depths with the elemental image array (EIA), can generate a set of spatially filtered EIAs for multiple object depths compared with the conventional method for the depth of a single object. We analyze a controllable spatial filtering effect by the proposed method. To show the feasibility of the proposed method, we carry out preliminary experiments for multiple objects and present the results.
基金funded by the National Natural Science Foundation of China under Grant Nos.41822106 and 42101447the Dawn Scholar of Shanghai Program under Grant No.18SG22+2 种基金the Science and Technology on Aerospace Flight Dynamics Laboratory,China,under Grant No.KGJ6142210110305State Key Laboratory of Disaster Reduction in Civil Engineering under Grant No.SLDRCE19-B-35Fundamental Research Funds for the Central Universities of China.
文摘A robust and eficient feature matching method is necessary for visual navigation in asteroid-landing missions.Based on the visual navigation framework and motion characteristics of asteroids,a robust and efficient template feature matching method is proposed to adapt to feature distortion and scale change cases for visual navigation of asteroids.The proposed method is primarily based on a motion-constrained discriminative correlation filter(DCF).The prior information provided by the motion constraints between sequence images is used to provide a predicted search region for template feature matching.Additionally,some specific template feature samples are generated using the motion constraints for correlation filter learning,which is beneficial for training a scale and feature distortion adaptive correlation filter for accurate feature matching.Moreover,average peak-to-correlation energy(APCE)and jointly consistent measurements(JCMs)were used to eliminate false matching.Images captured by the Touch And Go Camera System(TAGCAMS)of the Bennu asteroid were used to evaluate the performance of the proposed method.In particular,both the robustness and accuracy of region matching and template center matching are evaluated.The qualitative and quantitative results illustrate the advancement of the proposed method in adapting to feature distortions and large-scale changes during spacecraft landing.
基金This work was supported in part by the National Key Research and Development Plan for the 13th Five-Year Plan under Grant 2016YFD0700200This work was supported in part by the National High Technology Research and Development Program of China(2013AA102306).
文摘In the process of tracking the target of the pig,with the change of the size of the tracking target in the video image,the estimated tracking target scale cannot be adaptively updated in real-time,resulting in the low accuracy of the tracking target.In this study,a multi-channel color feature adaptive fusion algorithm was proposed,and the target scale of the pig was updated in real-time by utilizing the contour information of the target pig.Experiments show that the proposed algorithm had a distance precision of 89.7%and an overlap precision of 87.5%,and the average running speed of this algorithm was 50.1 fps.The robustness of the proposed algorithm in tracking target deformation and scale variation were significantly improved,which satisfies the accuracy and real-time requirements of pig target tracking.
基金supported by the National Natural Science Foundation of China(Grant No.51875228)the National Key R&D Program of China(Grant No.2020YFA0405700)the National Defense Science and Technology Innovation Special Zone Project(Grant No.193-A14-202-01-23)。
文摘Almost all conventional open-loop particle image velocimetry(PIV) methods employ fixed-interval-time optical imaging technology and the time-consuming cross-correlation-based PIV measurement algorithm to calculate the velocity field.In this study,a novel real-time adaptive particle image velocity(RTA-PIV) method is proposed to accurately measure the instantaneous velocity field of an unsteady flow field.In the proposed closed-loop RTA-PIV method,a new correlation-filter-based PIV measurement algorithm is introduced to calculate the velocity field in real time.Then,a Kalman predictor model is established to predict the velocity of the next time instant and a suitable interval time can be determined.To adaptively adjust the interval time for capturing two particle images,a new high-speed frame-straddling vision system is developed for the proposed RTA-PIV method.To fully analyze the performance of the RTA-PIV method,we conducted a series of numerical experiments on ground-truth image pairs and on real-world image sequences.