This paper focuses on the effective utilization of data augmentation techniques for 3Dlidar point clouds to enhance the performance of neural network models.These point clouds,which represent spatial information throu...This paper focuses on the effective utilization of data augmentation techniques for 3Dlidar point clouds to enhance the performance of neural network models.These point clouds,which represent spatial information through a collection of 3D coordinates,have found wide-ranging applications.Data augmentation has emerged as a potent solution to the challenges posed by limited labeled data and the need to enhance model generalization capabilities.Much of the existing research is devoted to crafting novel data augmentation methods specifically for 3D lidar point clouds.However,there has been a lack of focus on making the most of the numerous existing augmentation techniques.Addressing this deficiency,this research investigates the possibility of combining two fundamental data augmentation strategies.The paper introduces PolarMix andMix3D,two commonly employed augmentation techniques,and presents a new approach,named RandomFusion.Instead of using a fixed or predetermined combination of augmentation methods,RandomFusion randomly chooses one method from a pool of options for each instance or sample.This innovative data augmentation technique randomly augments each point in the point cloud with either PolarMix or Mix3D.The crux of this strategy is the random choice between PolarMix and Mix3Dfor the augmentation of each point within the point cloud data set.The results of the experiments conducted validate the efficacy of the RandomFusion strategy in enhancing the performance of neural network models for 3D lidar point cloud semantic segmentation tasks.This is achieved without compromising computational efficiency.By examining the potential of merging different augmentation techniques,the research contributes significantly to a more comprehensive understanding of how to utilize existing augmentation methods for 3D lidar point clouds.RandomFusion data augmentation technique offers a simple yet effective method to leverage the diversity of augmentation techniques and boost the robustness of models.The insights gained from this research can pave the way for future work aimed at developing more advanced and efficient data augmentation strategies for 3D lidar point cloud analysis.展开更多
Swarm robot systems are an important application of autonomous unmanned surface vehicles on water surfaces.For monitoring natural environments and conducting security activities within a certain range using a surface ...Swarm robot systems are an important application of autonomous unmanned surface vehicles on water surfaces.For monitoring natural environments and conducting security activities within a certain range using a surface vehicle,the swarm robot system is more efficient than the operation of a single object as the former can reduce cost and save time.It is necessary to detect adjacent surface obstacles robustly to operate a cluster of unmanned surface vehicles.For this purpose,a LiDAR(light detection and ranging)sensor is used as it can simultaneously obtain 3D information for all directions,relatively robustly and accurately,irrespective of the surrounding environmental conditions.Although the GPS(global-positioning-system)error range exists,obtaining measurements of the surface-vessel position can still ensure stability during platoon maneuvering.In this study,a three-layer convolutional neural network is applied to classify types of surface vehicles.The aim of this approach is to redefine the sparse 3D point cloud data as 2D image data with a connotative meaning and subsequently utilize this transformed data for object classification purposes.Hence,we have proposed a descriptor that converts the 3D point cloud data into 2D image data.To use this descriptor effectively,it is necessary to perform a clustering operation that separates the point clouds for each object.We developed voxel-based clustering for the point cloud clustering.Furthermore,using the descriptor,3D point cloud data can be converted into a 2D feature image,and the converted 2D image is provided as an input value to the network.We intend to verify the validity of the proposed 3D point cloud feature descriptor by using experimental data in the simulator.Furthermore,we explore the feasibility of real-time object classification within this framework.展开更多
A novel filtering algorithm for Lidar point clouds is presented, which can work well for complex cityscapes. Its main features are filtering based on raw Lidar point clouds without previous triangulation or rasterizat...A novel filtering algorithm for Lidar point clouds is presented, which can work well for complex cityscapes. Its main features are filtering based on raw Lidar point clouds without previous triangulation or rasterization. 3D topological relations among points are used to search edge points at the top of discontinuities, which are key information to recognize the bare earth points and building points. Experiment results show that the proposed algorithm can preserve discontinuous features in the bare earth and has no impact of size and shape of buildings.展开更多
Light Detection And Ranging (LiDAR) is a well-established active remote sensing technology that can provide accurate digital elevation measurements for the terrain and non-ground objects such as vegetations and buildi...Light Detection And Ranging (LiDAR) is a well-established active remote sensing technology that can provide accurate digital elevation measurements for the terrain and non-ground objects such as vegetations and buildings, etc. Non-ground objects need to be removed for creation of a Digital Terrain Model (DTM) which is a continuous surface representing only ground surface points. This study aimed at comparative analysis of three main filtering approaches for stripping off non-ground objects namely;Gaussian low pass filter, focal analysis mean filter and DTM slope-based filter of varying window sizes in creation of a reliable DTM from airborne LiDAR point clouds. A sample of LiDAR data provided by the ISPRS WG III/4 captured at Vaihingen in Germany over a pure residential area has been used in the analysis. Visual analysis has indicated that Gaussian low pass filter has given blurred DTMs of attenuated high-frequency objects and emphasized low-frequency objects while it has achieved improved removal of non-ground object at larger window sizes. Focal analysis mean filter has shown better removal of nonground objects compared to Gaussian low pass filter especially at large window sizes where details of non-ground objects almost have diminished in the DTMs from window sizes of 25 × 25 and greater. DTM slope-based filter has created bare earth models that have been full of gabs at the positions of the non-ground objects where the sizes and numbers of that gabs have increased with increasing the window sizes of filter. Those gaps have been closed through exploitation of the spline interpolation method in order to get continuous surface representing bare earth landscape. Comparative analysis has shown that the minimum elevations of the DTMs increase with increasing the filter widow sizes till 21 × 21 and 31 × 31 for the Gaussian low pass filter and the focal analysis mean filter respectively. On the other hand, the DTM slope-based filter has kept the minimum elevation of the original data, that could be due to noise in the LiDAR data unchanged. Alternatively, the three approaches have produced DTMs of decreasing maximum elevation values and consequently decreasing ranges of elevations due to increases in the filter window sizes. Moreover, the standard deviations of the created DTMs from the three filters have decreased with increasing the filter window sizes however, the decreases have been continuous and steady in the cases of the Gaussian low pass filter and the focal analysis mean filters while in the case of the DTM slope-based filter the standard deviations of the created DTMs have decreased with high rates till window size of 31 × 31 then they have kept unchanged due to more increases in the filter window sizes.展开更多
The missile-borne LiDAR has an essential prospect in precise guidance.However,the instability of the missile has a significant impact on the precision of LIDAR point cloud,thus modeling and analyzing the influencing f...The missile-borne LiDAR has an essential prospect in precise guidance.However,the instability of the missile has a significant impact on the precision of LIDAR point cloud,thus modeling and analyzing the influencing factors of point cloud generation is necessary.In this investigation,the authors modeled the point cloud calculation process of missile-borne linear array scanning LiDAR under ideal conditions and analyzed the effect of position change on the fleld of view(FOV) in the course of platform motion.Subsequently,the authors summarized that the stability concerning the field of view and the target tracking are dependent on three limiting conditions.Finally,the authors derived an error formula and analyzed several typical errors in missile platform flight,including scanner error,POS error,system integration error,and platform vibration error.Based on theo retical analysis and simulation experiments,the model proposed in this papier can provide a theoretical basis for the design of the missile-borne LiDAR system and the selection of related instruments in practice.展开更多
基金funded in part by the Key Project of Nature Science Research for Universities of Anhui Province of China(No.2022AH051720)in part by the Science and Technology Development Fund,Macao SAR(Grant Nos.0093/2022/A2,0076/2022/A2 and 0008/2022/AGJ)in part by the China University Industry-University-Research Collaborative Innovation Fund(No.2021FNA04017).
文摘This paper focuses on the effective utilization of data augmentation techniques for 3Dlidar point clouds to enhance the performance of neural network models.These point clouds,which represent spatial information through a collection of 3D coordinates,have found wide-ranging applications.Data augmentation has emerged as a potent solution to the challenges posed by limited labeled data and the need to enhance model generalization capabilities.Much of the existing research is devoted to crafting novel data augmentation methods specifically for 3D lidar point clouds.However,there has been a lack of focus on making the most of the numerous existing augmentation techniques.Addressing this deficiency,this research investigates the possibility of combining two fundamental data augmentation strategies.The paper introduces PolarMix andMix3D,two commonly employed augmentation techniques,and presents a new approach,named RandomFusion.Instead of using a fixed or predetermined combination of augmentation methods,RandomFusion randomly chooses one method from a pool of options for each instance or sample.This innovative data augmentation technique randomly augments each point in the point cloud with either PolarMix or Mix3D.The crux of this strategy is the random choice between PolarMix and Mix3Dfor the augmentation of each point within the point cloud data set.The results of the experiments conducted validate the efficacy of the RandomFusion strategy in enhancing the performance of neural network models for 3D lidar point cloud semantic segmentation tasks.This is achieved without compromising computational efficiency.By examining the potential of merging different augmentation techniques,the research contributes significantly to a more comprehensive understanding of how to utilize existing augmentation methods for 3D lidar point clouds.RandomFusion data augmentation technique offers a simple yet effective method to leverage the diversity of augmentation techniques and boost the robustness of models.The insights gained from this research can pave the way for future work aimed at developing more advanced and efficient data augmentation strategies for 3D lidar point cloud analysis.
基金supported by the Future Challenge Program through the Agency for Defense Development funded by the Defense Acquisition Program Administration (No.UC200015RD)。
文摘Swarm robot systems are an important application of autonomous unmanned surface vehicles on water surfaces.For monitoring natural environments and conducting security activities within a certain range using a surface vehicle,the swarm robot system is more efficient than the operation of a single object as the former can reduce cost and save time.It is necessary to detect adjacent surface obstacles robustly to operate a cluster of unmanned surface vehicles.For this purpose,a LiDAR(light detection and ranging)sensor is used as it can simultaneously obtain 3D information for all directions,relatively robustly and accurately,irrespective of the surrounding environmental conditions.Although the GPS(global-positioning-system)error range exists,obtaining measurements of the surface-vessel position can still ensure stability during platoon maneuvering.In this study,a three-layer convolutional neural network is applied to classify types of surface vehicles.The aim of this approach is to redefine the sparse 3D point cloud data as 2D image data with a connotative meaning and subsequently utilize this transformed data for object classification purposes.Hence,we have proposed a descriptor that converts the 3D point cloud data into 2D image data.To use this descriptor effectively,it is necessary to perform a clustering operation that separates the point clouds for each object.We developed voxel-based clustering for the point cloud clustering.Furthermore,using the descriptor,3D point cloud data can be converted into a 2D feature image,and the converted 2D image is provided as an input value to the network.We intend to verify the validity of the proposed 3D point cloud feature descriptor by using experimental data in the simulator.Furthermore,we explore the feasibility of real-time object classification within this framework.
基金the National 863 Program of China (No.SQ2006AA12Z108506)
文摘A novel filtering algorithm for Lidar point clouds is presented, which can work well for complex cityscapes. Its main features are filtering based on raw Lidar point clouds without previous triangulation or rasterization. 3D topological relations among points are used to search edge points at the top of discontinuities, which are key information to recognize the bare earth points and building points. Experiment results show that the proposed algorithm can preserve discontinuous features in the bare earth and has no impact of size and shape of buildings.
文摘Light Detection And Ranging (LiDAR) is a well-established active remote sensing technology that can provide accurate digital elevation measurements for the terrain and non-ground objects such as vegetations and buildings, etc. Non-ground objects need to be removed for creation of a Digital Terrain Model (DTM) which is a continuous surface representing only ground surface points. This study aimed at comparative analysis of three main filtering approaches for stripping off non-ground objects namely;Gaussian low pass filter, focal analysis mean filter and DTM slope-based filter of varying window sizes in creation of a reliable DTM from airborne LiDAR point clouds. A sample of LiDAR data provided by the ISPRS WG III/4 captured at Vaihingen in Germany over a pure residential area has been used in the analysis. Visual analysis has indicated that Gaussian low pass filter has given blurred DTMs of attenuated high-frequency objects and emphasized low-frequency objects while it has achieved improved removal of non-ground object at larger window sizes. Focal analysis mean filter has shown better removal of nonground objects compared to Gaussian low pass filter especially at large window sizes where details of non-ground objects almost have diminished in the DTMs from window sizes of 25 × 25 and greater. DTM slope-based filter has created bare earth models that have been full of gabs at the positions of the non-ground objects where the sizes and numbers of that gabs have increased with increasing the window sizes of filter. Those gaps have been closed through exploitation of the spline interpolation method in order to get continuous surface representing bare earth landscape. Comparative analysis has shown that the minimum elevations of the DTMs increase with increasing the filter widow sizes till 21 × 21 and 31 × 31 for the Gaussian low pass filter and the focal analysis mean filter respectively. On the other hand, the DTM slope-based filter has kept the minimum elevation of the original data, that could be due to noise in the LiDAR data unchanged. Alternatively, the three approaches have produced DTMs of decreasing maximum elevation values and consequently decreasing ranges of elevations due to increases in the filter window sizes. Moreover, the standard deviations of the created DTMs from the three filters have decreased with increasing the filter window sizes however, the decreases have been continuous and steady in the cases of the Gaussian low pass filter and the focal analysis mean filters while in the case of the DTM slope-based filter the standard deviations of the created DTMs have decreased with high rates till window size of 31 × 31 then they have kept unchanged due to more increases in the filter window sizes.
基金financially supported by the China National Natural Science Foundation(Grant No.61871389)the Research Plan Project of the National University of Defense Technology(Grant No.ZK18-01-02)the Director Foundation of State Key Laboratory of Pulsed Power Laser Technology(Grant No.SKL2018ZR09)。
文摘The missile-borne LiDAR has an essential prospect in precise guidance.However,the instability of the missile has a significant impact on the precision of LIDAR point cloud,thus modeling and analyzing the influencing factors of point cloud generation is necessary.In this investigation,the authors modeled the point cloud calculation process of missile-borne linear array scanning LiDAR under ideal conditions and analyzed the effect of position change on the fleld of view(FOV) in the course of platform motion.Subsequently,the authors summarized that the stability concerning the field of view and the target tracking are dependent on three limiting conditions.Finally,the authors derived an error formula and analyzed several typical errors in missile platform flight,including scanner error,POS error,system integration error,and platform vibration error.Based on theo retical analysis and simulation experiments,the model proposed in this papier can provide a theoretical basis for the design of the missile-borne LiDAR system and the selection of related instruments in practice.