Although compressive measurements save data storage and bandwidth usage, they are difficult to be used directly for target tracking and classification without pixel reconstruction. This is because the Gaussian random ...Although compressive measurements save data storage and bandwidth usage, they are difficult to be used directly for target tracking and classification without pixel reconstruction. This is because the Gaussian random matrix destroys the target location information in the original video frames. This paper summarizes our research effort on target tracking and classification directly in the compressive measurement domain. We focus on one particular type of compressive measurement using pixel subsampling. That is, original pixels in video frames are randomly subsampled. Even in such a special compressive sensing setting, conventional trackers do not work in a satisfactory manner. We propose a deep learning approach that integrates YOLO (You Only Look Once) and ResNet (residual network) for multiple target tracking and classification. YOLO is used for multiple target tracking and ResNet is for target classification. Extensive experiments using short wave infrared (SWIR), mid-wave infrared (MWIR), and long-wave infrared (LWIR) videos demonstrated the efficacy of the proposed approach even though the training data are very scarce.展开更多
Pixel-wise Code Exposure (PCE) camera is one type of compressive sensing camera that has low power consumption and high compression ratio. Moreover, a PCE camera can control individual pixel exposure time that can ena...Pixel-wise Code Exposure (PCE) camera is one type of compressive sensing camera that has low power consumption and high compression ratio. Moreover, a PCE camera can control individual pixel exposure time that can enable high dynamic range. Conventional approaches of using PCE camera involve a time consuming and lossy process to reconstruct the original frames and then use those frames for target tracking and classification. In this paper, we present a deep learning approach that directly performs target tracking and classification in the compressive measurement domain without any frame reconstruction. Our approach has two parts: tracking and classification. The tracking has been done using YOLO (You Only Look Once) and the classification is achieved using Residual Network (ResNet). Extensive experiments using mid-wave infrared (MWIR) and long-wave infrared (LWIR) videos demonstrated the efficacy of our proposed approach.展开更多
For node awakening in wireless multi-sensor networks, an algorithm is put forward for three dimensional tar- get tracking. To monitor target dynamically in three dimensional area by controlling nodes, we constract vir...For node awakening in wireless multi-sensor networks, an algorithm is put forward for three dimensional tar- get tracking. To monitor target dynamically in three dimensional area by controlling nodes, we constract vir- tual force between moving target and the current sense node depending on the virtual potential method, then select the next sense node with information gain function, so that when target randomly move in the specific three dimensional area, the maximum sensing ratio of motion trajectory is get with few nodes. The proposed algorithm is verified from the simulations.展开更多
Users of the digital image correlation method are faced with the problem of poor operability,low repeatability,and lack of standardized specifications for spraying speckles.To solve the problem,the research proposed a...Users of the digital image correlation method are faced with the problem of poor operability,low repeatability,and lack of standardized specifications for spraying speckles.To solve the problem,the research proposed a rock deformation measurement method that obviates the need to spray speckles.A local binary model was established by using the local binary pattern(LBP)operator based on deep texture features on rock surfaces.The resulting LBP digital speckle pattern can substitute artificial speckle patterns and demonstrates high quality and strong applicability.Based on the LBP digital speckle pattern,the target tracking algorithm was employed to achieve non-contact measurement of the dynamic displacements of rocks.The feasibility and effectiveness of the algorithm in practical application were verified by conducting shear tests on granite and siltstone.Test results show that the deformation characteristics in the displacement nephograms are in line with the measured data pertaining to rock fracturing and conform to the basic characteristics of the shear failure of rocks.The deformation measurement method based on surface texture information can realize non-contact displacement measurement of rocks under conditions without speckles:this obviates the influence of the quality of sprayed speckles on the accuracy of the measurement of deformation.展开更多
文摘Although compressive measurements save data storage and bandwidth usage, they are difficult to be used directly for target tracking and classification without pixel reconstruction. This is because the Gaussian random matrix destroys the target location information in the original video frames. This paper summarizes our research effort on target tracking and classification directly in the compressive measurement domain. We focus on one particular type of compressive measurement using pixel subsampling. That is, original pixels in video frames are randomly subsampled. Even in such a special compressive sensing setting, conventional trackers do not work in a satisfactory manner. We propose a deep learning approach that integrates YOLO (You Only Look Once) and ResNet (residual network) for multiple target tracking and classification. YOLO is used for multiple target tracking and ResNet is for target classification. Extensive experiments using short wave infrared (SWIR), mid-wave infrared (MWIR), and long-wave infrared (LWIR) videos demonstrated the efficacy of the proposed approach even though the training data are very scarce.
文摘Pixel-wise Code Exposure (PCE) camera is one type of compressive sensing camera that has low power consumption and high compression ratio. Moreover, a PCE camera can control individual pixel exposure time that can enable high dynamic range. Conventional approaches of using PCE camera involve a time consuming and lossy process to reconstruct the original frames and then use those frames for target tracking and classification. In this paper, we present a deep learning approach that directly performs target tracking and classification in the compressive measurement domain without any frame reconstruction. Our approach has two parts: tracking and classification. The tracking has been done using YOLO (You Only Look Once) and the classification is achieved using Residual Network (ResNet). Extensive experiments using mid-wave infrared (MWIR) and long-wave infrared (LWIR) videos demonstrated the efficacy of our proposed approach.
文摘For node awakening in wireless multi-sensor networks, an algorithm is put forward for three dimensional tar- get tracking. To monitor target dynamically in three dimensional area by controlling nodes, we constract vir- tual force between moving target and the current sense node depending on the virtual potential method, then select the next sense node with information gain function, so that when target randomly move in the specific three dimensional area, the maximum sensing ratio of motion trajectory is get with few nodes. The proposed algorithm is verified from the simulations.
基金supported by the National Natural Science Foundation of China(No.52074123)the Natural Science Foundation of Hebei Province(Nos.E2022209143,E2021209148 and E2021209052).
文摘Users of the digital image correlation method are faced with the problem of poor operability,low repeatability,and lack of standardized specifications for spraying speckles.To solve the problem,the research proposed a rock deformation measurement method that obviates the need to spray speckles.A local binary model was established by using the local binary pattern(LBP)operator based on deep texture features on rock surfaces.The resulting LBP digital speckle pattern can substitute artificial speckle patterns and demonstrates high quality and strong applicability.Based on the LBP digital speckle pattern,the target tracking algorithm was employed to achieve non-contact measurement of the dynamic displacements of rocks.The feasibility and effectiveness of the algorithm in practical application were verified by conducting shear tests on granite and siltstone.Test results show that the deformation characteristics in the displacement nephograms are in line with the measured data pertaining to rock fracturing and conform to the basic characteristics of the shear failure of rocks.The deformation measurement method based on surface texture information can realize non-contact displacement measurement of rocks under conditions without speckles:this obviates the influence of the quality of sprayed speckles on the accuracy of the measurement of deformation.
