Aiming at the limitations of the existing railway foreign object detection methods based on two-dimensional(2D)images,such as short detection distance,strong influence of environment and lack of distance information,w...Aiming at the limitations of the existing railway foreign object detection methods based on two-dimensional(2D)images,such as short detection distance,strong influence of environment and lack of distance information,we propose Rail-PillarNet,a three-dimensional(3D)LIDAR(Light Detection and Ranging)railway foreign object detection method based on the improvement of PointPillars.Firstly,the parallel attention pillar encoder(PAPE)is designed to fully extract the features of the pillars and alleviate the problem of local fine-grained information loss in PointPillars pillars encoder.Secondly,a fine backbone network is designed to improve the feature extraction capability of the network by combining the coding characteristics of LIDAR point cloud feature and residual structure.Finally,the initial weight parameters of the model were optimised by the transfer learning training method to further improve accuracy.The experimental results on the OSDaR23 dataset show that the average accuracy of Rail-PillarNet reaches 58.51%,which is higher than most mainstream models,and the number of parameters is 5.49 M.Compared with PointPillars,the accuracy of each target is improved by 10.94%,3.53%,16.96%and 19.90%,respectively,and the number of parameters only increases by 0.64M,which achieves a balance between the number of parameters and accuracy.展开更多
Swarm robot systems are an important application of autonomous unmanned surface vehicles on water surfaces.For monitoring natural environments and conducting security activities within a certain range using a surface ...Swarm robot systems are an important application of autonomous unmanned surface vehicles on water surfaces.For monitoring natural environments and conducting security activities within a certain range using a surface vehicle,the swarm robot system is more efficient than the operation of a single object as the former can reduce cost and save time.It is necessary to detect adjacent surface obstacles robustly to operate a cluster of unmanned surface vehicles.For this purpose,a LiDAR(light detection and ranging)sensor is used as it can simultaneously obtain 3D information for all directions,relatively robustly and accurately,irrespective of the surrounding environmental conditions.Although the GPS(global-positioning-system)error range exists,obtaining measurements of the surface-vessel position can still ensure stability during platoon maneuvering.In this study,a three-layer convolutional neural network is applied to classify types of surface vehicles.The aim of this approach is to redefine the sparse 3D point cloud data as 2D image data with a connotative meaning and subsequently utilize this transformed data for object classification purposes.Hence,we have proposed a descriptor that converts the 3D point cloud data into 2D image data.To use this descriptor effectively,it is necessary to perform a clustering operation that separates the point clouds for each object.We developed voxel-based clustering for the point cloud clustering.Furthermore,using the descriptor,3D point cloud data can be converted into a 2D feature image,and the converted 2D image is provided as an input value to the network.We intend to verify the validity of the proposed 3D point cloud feature descriptor by using experimental data in the simulator.Furthermore,we explore the feasibility of real-time object classification within this framework.展开更多
With the development of sensors,the application of multi-source remote sensing data has been widely concerned.Since hyperspectral image(HSI)contains rich spectral information while light detection and ranging(LiDAR)da...With the development of sensors,the application of multi-source remote sensing data has been widely concerned.Since hyperspectral image(HSI)contains rich spectral information while light detection and ranging(LiDAR)data contains elevation information,joint use of them for ground object classification can yield positive results,especially by building deep networks.Fortu-nately,multi-scale deep networks allow to expand the receptive fields of convolution without causing the computational and training problems associated with simply adding more network layers.In this work,a multi-scale feature fusion network is proposed for the joint classification of HSI and LiDAR data.First,we design a multi-scale spatial feature extraction module with cross-channel connections,by which spatial information of HSI data and elevation information of LiDAR data are extracted and fused.In addition,a multi-scale spectral feature extraction module is employed to extract the multi-scale spectral features of HSI data.Finally,joint multi-scale features are obtained by weighting and concatenation operations and then fed into the classifier.To verify the effective-ness of the proposed network,experiments are carried out on the MUUFL Gulfport and Trento datasets.The experimental results demonstrate that the classification performance of the proposed method is superior to that of other state-of-the-art methods.展开更多
针对现有机载LiDAR(light detection and ranging)点云滤波方法在地形起伏剧烈的林区适用性不足的问题,提出一种多分辨率层次布料模拟滤波方法。首先,通过多尺度形态学开运算选择大量种子地面点;然后,基于种子地面点,使用布料模拟法由...针对现有机载LiDAR(light detection and ranging)点云滤波方法在地形起伏剧烈的林区适用性不足的问题,提出一种多分辨率层次布料模拟滤波方法。首先,通过多尺度形态学开运算选择大量种子地面点;然后,基于种子地面点,使用布料模拟法由低至高逐层构建参考地形,以快速获取高分辨率参考地形;最后,基于点至参考地形的高差区分地面点和非地面点。利用国际摄影测量和遥感学会提供的数据集和参考方法,评估该方法性能。利用在中国、美国多个代表性林区的点云数据,评估该方法的可推广性。结果表明,该方法的Kappa系数和运行时间是83.72%和34.11 s,精度和效率较经典布料模拟滤波方法提高10.49%和52.17%。相比8种参考方法,该方法能够获得更高精度,并且具有稳定的可推广性。展开更多
For time-of-flight(TOF)light detection and ranging(LiDAR),a three-channel high-performance transimpedance amplifier(TIA)with high immunity to input load capacitance is presented.A regulated cascade(RGC)as the input st...For time-of-flight(TOF)light detection and ranging(LiDAR),a three-channel high-performance transimpedance amplifier(TIA)with high immunity to input load capacitance is presented.A regulated cascade(RGC)as the input stage is at the core of the complementary metal oxide semiconductor(CMOS)circuit chip,giving it more immunity to input photodiode detectors.A simple smart output interface acting as a feedback structure,which is rarely found in other designs,reduces the chip size and power consumption simultaneously.The circuit is designed using a 0.5μm CMOS process technology to achieve low cost.The device delivers a 33.87 dB?transimpedance gain at 350 MHz.With a higher input load capacitance,it shows a-3 dB bandwidth of 461 MHz,indicating a better detector tolerance at the front end of the system.Under a 3.3 V supply voltage,the device consumes 5.2 mW,and the total chip area with three channels is 402.8×597.0μm2(including the test pads).展开更多
机载激光雷达(LiDAR)点云电力线提取过程中存在杆塔形状复杂、噪声影响大等问题,导致电力线点云提取精度低,本文提出一种基于点云分块处理、格网划分的曲面拟合滤波、自适应密度聚类算法的电力线点云提取与重建方法。首先,根据电力线走...机载激光雷达(LiDAR)点云电力线提取过程中存在杆塔形状复杂、噪声影响大等问题,导致电力线点云提取精度低,本文提出一种基于点云分块处理、格网划分的曲面拟合滤波、自适应密度聚类算法的电力线点云提取与重建方法。首先,根据电力线走向,对整体点云进行分块处理;其次,在曲面拟合算法的基础上,引入格网划分思想,提出一种改进曲面拟合滤波算法并进行点云滤波;最后,通过给出自适应密度聚类解决方案精确提取电力线点云。借助点云库(PCL)、libLAS库与Visual Studio 2017 C++开发环境实现本文算法,基于实测点云数据对本文方法进行测试与精度评定。结果表明:电力线提取精确率为97.82%、召回率为99.76%、F1值为98.78%,一次便可实现电力线的成功提取,在保证提取精度的同时提升了提取效率,本文研究能够为电力线智能巡检提供良好的工程应用价值。展开更多
Light detection and ranging (LIDAR) based on time of flight (TOF) method is widely used in many fields related to distance measurement. LIDAR generally uses laser diode (LD) to emit the pulsed laser with high peak pow...Light detection and ranging (LIDAR) based on time of flight (TOF) method is widely used in many fields related to distance measurement. LIDAR generally uses laser diode (LD) to emit the pulsed laser with high peak power and short duration to ensure a large distance measurement range and eye safety. To achieve this goal, we propose a pulsed LD drive method producing the drive current with high peak and narrow pulse width. We analyze the key issues and related theories of the drive current generation based on this method and design an LD driver. A model of drive current generation is established and the influence of operating frequency on drive current is discussed. The LD driver is simulated by software and verified by experiments. The working frequency of the driver changes from 20 kHz to 100 kHz and the charging voltage is set at 130 V. The current produced by this driver has a duration of 8.8 ns and a peak of about 35 A, and the peak output optical power of the LD exceeds 75 W.展开更多
使用机载激光雷达(LiDAR)进行数字高程模型(DEM)制作过程中,河流数据缺失,需进行人工编辑,目前处理流程中难以既保证数据精度又保证整体平整美观,本文提出机载LiDAR河流高程拟合方案,通过半自动河流边线提取、河流中心线提取以及中心线...使用机载激光雷达(LiDAR)进行数字高程模型(DEM)制作过程中,河流数据缺失,需进行人工编辑,目前处理流程中难以既保证数据精度又保证整体平整美观,本文提出机载LiDAR河流高程拟合方案,通过半自动河流边线提取、河流中心线提取以及中心线高程拟合一系列技术流程,不仅解决当前复杂的人工编辑问题,还提升了拟合精度,文中详细地阐述河流高程拟合关键算法,并基于Micro station V8开发出应用实例,为机载LiDAR河流高程拟合提供新思路。展开更多
基金supported by a grant from the National Key Research and Development Project(2023YFB4302100)Key Research and Development Project of Jiangxi Province(No.20232ACE01011)Independent Deployment Project of Ganjiang Innovation Research Institute,Chinese Academy of Sciences(E255J001).
文摘Aiming at the limitations of the existing railway foreign object detection methods based on two-dimensional(2D)images,such as short detection distance,strong influence of environment and lack of distance information,we propose Rail-PillarNet,a three-dimensional(3D)LIDAR(Light Detection and Ranging)railway foreign object detection method based on the improvement of PointPillars.Firstly,the parallel attention pillar encoder(PAPE)is designed to fully extract the features of the pillars and alleviate the problem of local fine-grained information loss in PointPillars pillars encoder.Secondly,a fine backbone network is designed to improve the feature extraction capability of the network by combining the coding characteristics of LIDAR point cloud feature and residual structure.Finally,the initial weight parameters of the model were optimised by the transfer learning training method to further improve accuracy.The experimental results on the OSDaR23 dataset show that the average accuracy of Rail-PillarNet reaches 58.51%,which is higher than most mainstream models,and the number of parameters is 5.49 M.Compared with PointPillars,the accuracy of each target is improved by 10.94%,3.53%,16.96%and 19.90%,respectively,and the number of parameters only increases by 0.64M,which achieves a balance between the number of parameters and accuracy.
基金supported by the Future Challenge Program through the Agency for Defense Development funded by the Defense Acquisition Program Administration (No.UC200015RD)。
文摘Swarm robot systems are an important application of autonomous unmanned surface vehicles on water surfaces.For monitoring natural environments and conducting security activities within a certain range using a surface vehicle,the swarm robot system is more efficient than the operation of a single object as the former can reduce cost and save time.It is necessary to detect adjacent surface obstacles robustly to operate a cluster of unmanned surface vehicles.For this purpose,a LiDAR(light detection and ranging)sensor is used as it can simultaneously obtain 3D information for all directions,relatively robustly and accurately,irrespective of the surrounding environmental conditions.Although the GPS(global-positioning-system)error range exists,obtaining measurements of the surface-vessel position can still ensure stability during platoon maneuvering.In this study,a three-layer convolutional neural network is applied to classify types of surface vehicles.The aim of this approach is to redefine the sparse 3D point cloud data as 2D image data with a connotative meaning and subsequently utilize this transformed data for object classification purposes.Hence,we have proposed a descriptor that converts the 3D point cloud data into 2D image data.To use this descriptor effectively,it is necessary to perform a clustering operation that separates the point clouds for each object.We developed voxel-based clustering for the point cloud clustering.Furthermore,using the descriptor,3D point cloud data can be converted into a 2D feature image,and the converted 2D image is provided as an input value to the network.We intend to verify the validity of the proposed 3D point cloud feature descriptor by using experimental data in the simulator.Furthermore,we explore the feasibility of real-time object classification within this framework.
基金supported by the National Key Research and Development Project(No.2020YFC1512000)the General Projects of Key R&D Programs in Shaanxi Province(No.2020GY-060)Xi’an Science&Technology Project(No.2020KJRC 0126)。
文摘With the development of sensors,the application of multi-source remote sensing data has been widely concerned.Since hyperspectral image(HSI)contains rich spectral information while light detection and ranging(LiDAR)data contains elevation information,joint use of them for ground object classification can yield positive results,especially by building deep networks.Fortu-nately,multi-scale deep networks allow to expand the receptive fields of convolution without causing the computational and training problems associated with simply adding more network layers.In this work,a multi-scale feature fusion network is proposed for the joint classification of HSI and LiDAR data.First,we design a multi-scale spatial feature extraction module with cross-channel connections,by which spatial information of HSI data and elevation information of LiDAR data are extracted and fused.In addition,a multi-scale spectral feature extraction module is employed to extract the multi-scale spectral features of HSI data.Finally,joint multi-scale features are obtained by weighting and concatenation operations and then fed into the classifier.To verify the effective-ness of the proposed network,experiments are carried out on the MUUFL Gulfport and Trento datasets.The experimental results demonstrate that the classification performance of the proposed method is superior to that of other state-of-the-art methods.
文摘针对现有机载LiDAR(light detection and ranging)点云滤波方法在地形起伏剧烈的林区适用性不足的问题,提出一种多分辨率层次布料模拟滤波方法。首先,通过多尺度形态学开运算选择大量种子地面点;然后,基于种子地面点,使用布料模拟法由低至高逐层构建参考地形,以快速获取高分辨率参考地形;最后,基于点至参考地形的高差区分地面点和非地面点。利用国际摄影测量和遥感学会提供的数据集和参考方法,评估该方法性能。利用在中国、美国多个代表性林区的点云数据,评估该方法的可推广性。结果表明,该方法的Kappa系数和运行时间是83.72%和34.11 s,精度和效率较经典布料模拟滤波方法提高10.49%和52.17%。相比8种参考方法,该方法能够获得更高精度,并且具有稳定的可推广性。
文摘For time-of-flight(TOF)light detection and ranging(LiDAR),a three-channel high-performance transimpedance amplifier(TIA)with high immunity to input load capacitance is presented.A regulated cascade(RGC)as the input stage is at the core of the complementary metal oxide semiconductor(CMOS)circuit chip,giving it more immunity to input photodiode detectors.A simple smart output interface acting as a feedback structure,which is rarely found in other designs,reduces the chip size and power consumption simultaneously.The circuit is designed using a 0.5μm CMOS process technology to achieve low cost.The device delivers a 33.87 dB?transimpedance gain at 350 MHz.With a higher input load capacitance,it shows a-3 dB bandwidth of 461 MHz,indicating a better detector tolerance at the front end of the system.Under a 3.3 V supply voltage,the device consumes 5.2 mW,and the total chip area with three channels is 402.8×597.0μm2(including the test pads).
文摘机载激光雷达(LiDAR)点云电力线提取过程中存在杆塔形状复杂、噪声影响大等问题,导致电力线点云提取精度低,本文提出一种基于点云分块处理、格网划分的曲面拟合滤波、自适应密度聚类算法的电力线点云提取与重建方法。首先,根据电力线走向,对整体点云进行分块处理;其次,在曲面拟合算法的基础上,引入格网划分思想,提出一种改进曲面拟合滤波算法并进行点云滤波;最后,通过给出自适应密度聚类解决方案精确提取电力线点云。借助点云库(PCL)、libLAS库与Visual Studio 2017 C++开发环境实现本文算法,基于实测点云数据对本文方法进行测试与精度评定。结果表明:电力线提取精确率为97.82%、召回率为99.76%、F1值为98.78%,一次便可实现电力线的成功提取,在保证提取精度的同时提升了提取效率,本文研究能够为电力线智能巡检提供良好的工程应用价值。
基金National Key Research and Development Plan(No.2017YFF0204800)Natural Science Foundation of Tianjin(No.17JCQNJC01100)+3 种基金National Natural Science Foundation of China(Nos.61501319,51775377,61505140)Young Elite Scientists Sponsorship Program by Cast of China(No.2016QNRC001)Open Project of Key Laboratory of Micro Opto-electro Mechanical System Technology(No.MOMST2015-7)Open Project from Photoelectric Information and Instrument-Engineering Research Center of Beijing,Tianjin University,Ministry of Education(No.GD2015007)
文摘Light detection and ranging (LIDAR) based on time of flight (TOF) method is widely used in many fields related to distance measurement. LIDAR generally uses laser diode (LD) to emit the pulsed laser with high peak power and short duration to ensure a large distance measurement range and eye safety. To achieve this goal, we propose a pulsed LD drive method producing the drive current with high peak and narrow pulse width. We analyze the key issues and related theories of the drive current generation based on this method and design an LD driver. A model of drive current generation is established and the influence of operating frequency on drive current is discussed. The LD driver is simulated by software and verified by experiments. The working frequency of the driver changes from 20 kHz to 100 kHz and the charging voltage is set at 130 V. The current produced by this driver has a duration of 8.8 ns and a peak of about 35 A, and the peak output optical power of the LD exceeds 75 W.
文摘使用机载激光雷达(LiDAR)进行数字高程模型(DEM)制作过程中,河流数据缺失,需进行人工编辑,目前处理流程中难以既保证数据精度又保证整体平整美观,本文提出机载LiDAR河流高程拟合方案,通过半自动河流边线提取、河流中心线提取以及中心线高程拟合一系列技术流程,不仅解决当前复杂的人工编辑问题,还提升了拟合精度,文中详细地阐述河流高程拟合关键算法,并基于Micro station V8开发出应用实例,为机载LiDAR河流高程拟合提供新思路。