A LiDAR Point Clouds Dataset of Ships in a Maritime Environment

For the first time, this article introduces a LiDAR Point Clouds Dataset of Ships composed of both collected and simulated data to address the scarcity of LiDAR data in maritime applications. The collected data are acquired using specialized maritime LiDAR sensors in both inland waterways and wide-open ocean environments. The simulated data is generated by placing a ship in the LiDAR coordinate system and scanning it with a redeveloped Blensor that emulates the operation of a LiDAR sensor equipped with various laser beams. Furthermore,we also render point clouds for foggy and rainy weather conditions. To describe a realistic shipping environment, a dynamic tail wave is modeled by iterating the wave elevation of each point in a time series. Finally, networks serving small objects are migrated to ship applications by feeding our dataset. The positive effect of simulated data is described in object detection experiments, and the negative impact of tail waves as noise is verified in single-object tracking experiments. The Dataset is available at https://github.com/zqy411470859/ship_dataset.

A Random Fusion of Mix 3D and Polar Mix to Improve Semantic Segmentation Performance in 3D Lidar Point Cloud

This paper focuses on the effective utilization of data augmentation techniques for 3Dlidar point clouds to enhance the performance of neural network models.These point clouds,which represent spatial information through a collection of 3D coordinates,have found wide-ranging applications.Data augmentation has emerged as a potent solution to the challenges posed by limited labeled data and the need to enhance model generalization capabilities.Much of the existing research is devoted to crafting novel data augmentation methods specifically for 3D lidar point clouds.However,there has been a lack of focus on making the most of the numerous existing augmentation techniques.Addressing this deficiency,this research investigates the possibility of combining two fundamental data augmentation strategies.The paper introduces PolarMix andMix3D,two commonly employed augmentation techniques,and presents a new approach,named RandomFusion.Instead of using a fixed or predetermined combination of augmentation methods,RandomFusion randomly chooses one method from a pool of options for each instance or sample.This innovative data augmentation technique randomly augments each point in the point cloud with either PolarMix or Mix3D.The crux of this strategy is the random choice between PolarMix and Mix3Dfor the augmentation of each point within the point cloud data set.The results of the experiments conducted validate the efficacy of the RandomFusion strategy in enhancing the performance of neural network models for 3D lidar point cloud semantic segmentation tasks.This is achieved without compromising computational efficiency.By examining the potential of merging different augmentation techniques,the research contributes significantly to a more comprehensive understanding of how to utilize existing augmentation methods for 3D lidar point clouds.RandomFusion data augmentation technique offers a simple yet effective method to leverage the diversity of augmentation techniques and boost the robustness of models.The insights gained from this research can pave the way for future work aimed at developing more advanced and efficient data augmentation strategies for 3D lidar point cloud analysis.

Development of vehicle-recognition method on water surfaces using LiDAR data:SPD^(2)(spherically stratified point projection with diameter and distance)

Swarm robot systems are an important application of autonomous unmanned surface vehicles on water surfaces.For monitoring natural environments and conducting security activities within a certain range using a surface vehicle,the swarm robot system is more efficient than the operation of a single object as the former can reduce cost and save time.It is necessary to detect adjacent surface obstacles robustly to operate a cluster of unmanned surface vehicles.For this purpose,a LiDAR(light detection and ranging)sensor is used as it can simultaneously obtain 3D information for all directions,relatively robustly and accurately,irrespective of the surrounding environmental conditions.Although the GPS(global-positioning-system)error range exists,obtaining measurements of the surface-vessel position can still ensure stability during platoon maneuvering.In this study,a three-layer convolutional neural network is applied to classify types of surface vehicles.The aim of this approach is to redefine the sparse 3D point cloud data as 2D image data with a connotative meaning and subsequently utilize this transformed data for object classification purposes.Hence,we have proposed a descriptor that converts the 3D point cloud data into 2D image data.To use this descriptor effectively,it is necessary to perform a clustering operation that separates the point clouds for each object.We developed voxel-based clustering for the point cloud clustering.Furthermore,using the descriptor,3D point cloud data can be converted into a 2D feature image,and the converted 2D image is provided as an input value to the network.We intend to verify the validity of the proposed 3D point cloud feature descriptor by using experimental data in the simulator.Furthermore,we explore the feasibility of real-time object classification within this framework.

Indoor Space Modeling and Parametric Component Construction Based on 3D Laser Point Cloud Data

In order to enhance modeling efficiency and accuracy,we utilized 3D laser point cloud data for indoor space modeling.Point cloud data was obtained with a 3D laser scanner and optimized with Autodesk Recap and Revit software to extract geometric information about the indoor environment.Furthermore,we proposed a method for constructing indoor elements based on parametric components.The research outcomes of this paper will offer new methods and tools for indoor space modeling and design.The approach of indoor space modeling based on 3D laser point cloud data and parametric component construction can enhance modeling efficiency and accuracy,providing architects,interior designers,and decorators with a better working platform and design reference.

基于改进PointNet++的输电线路关键部位点云语义分割研究

输电线路的关键部位包括塔身、导线、绝缘子、避雷线以及引流线,无人机精细化导航的首要任务是构造输电线路的点云地图并从中分割出上述部位。为解决现有算法在输电线路的绝缘子、引流线等精细结构分割时精度低的问题,通过改进PointNet++算法,提出了一种面向输电线路精细结构的点云分割方法。首先,基于无人机机载激光雷达在现场采集的点云数据,构造了输电线路点云分割数据集;其次,通过对比实验,筛选出在本输电线路场景下合理的数据增强方法,并对数据集进行了数据增强;最后,将自注意力机制以及倒置残差结构和PointNet++相结合,设计了输电线路关键部位点云语义分割算法。实验结果表明:该改进PointNet++算法在全场景输电线路现场点云数据作为输入的前提下,首次实现了对引流线、绝缘子等输电线路中精细结构和导线、杆塔塔身以及输电线路无关背景点的同时分割,平均交并比(mean intersection over union,mIoU)达80.79%,所有类别分割的平均F_(1)值(F1 score)达88.99%。

Methodology for Extraction of Tunnel Cross-Sections Using Dense Point Cloud Data

Tunnel deformation monitoring is a crucial task to evaluate tunnel stability during the metro operation period.Terrestrial Laser Scanning(TLS)can collect high density and high accuracy point cloud data in a few minutes as an innovation technique,which provides promising applications in tunnel deformation monitoring.Here,an efficient method for extracting tunnel cross-sections and convergence analysis using dense TLS point cloud data is proposed.First,the tunnel orientation is determined using principal component analysis(PCA)in the Euclidean plane.Two control points are introduced to detect and remove the unsuitable points by using point cloud division and then the ground points are removed by defining an elevation value width of 0.5 m.Next,a z-score method is introduced to detect and remove the outlies.Because the tunnel cross-section’s standard shape is round,the circle fitting is implemented using the least-squares method.Afterward,the convergence analysis is made at the angles of 0°,30°and 150°.The proposed approach’s feasibility is tested on a TLS point cloud of a Nanjing subway tunnel acquired using a FARO X330 laser scanner.The results indicate that the proposed methodology achieves an overall accuracy of 1.34 mm,which is also in agreement with the measurements acquired by a total station instrument.The proposed methodology provides new insights and references for the applications of TLS in tunnel deformation monitoring,which can also be extended to other engineering applications.

ALGORITHM OF PRETREATMENT ON AUTOMOBILE BODY POINT CLOUD

As point cloud of one whole vehicle body has the traits of large geometric dimension, huge data and rigorous reverse precision, one pretreatment algorithm on automobile body point cloud is put forward. The basic idea of the registration algorithm based on the skeleton points is to construct the skeleton points of the whole vehicle model and the mark points of the separate point cloud, to search the mapped relationship between skeleton points and mark points using congruence triangle method and to match the whole vehicle point cloud using the improved iterative closed point （ICP） algorithm. The data reduction algorithm, based on average square root of distance, condenses data by three steps, computing datasets＇ average square root of distance in sampling cube grid, sorting order according to the value computed from the first step, choosing sampling percentage. The accuracy of the two algorithms above is proved by a registration and reduction example of whole vehicle point cloud of a certain light truck.

Accuracy of common stem volume formulae using terrestrial photogrammetric point clouds:a case study with savanna trees in Benin

Recent applications of digital photogrammetry in forestry have highlighted its utility as a viable mensuration technique.However,in tropical regions little research has been done on the accuracy of this approach for stem volume calculation.In this study,the performance of Structure from Motion photogrammetry for estimating individual tree stem volume in relation to traditional approaches was evaluated.We selected 30 trees from five savanna species growing at the periphery of the W National Park in northern Benin and measured their circumferences at different heights using traditional tape and clinometer.Stem volumes of sample trees were estimated from the measured circumferences using nine volumetric formulae for solids of revolution,including cylinder,cone,paraboloid,neiloid and their respective fustrums.Each tree was photographed and stem volume determined using a taper function derived from tri-dimensional stem models.This reference volume was compared with the results of formulaic estimations.Tree stem profiles were further decomposed into different portions,approximately corresponding to the stump,butt logs and logs,and the suitability of each solid of revolution was assessed for simulating the resulting shapes.Stem volumes calculated using the fustrums of paraboloid and neiloid formulae were the closest to reference volumes with a bias and root mean square error of 8.0%and 24.4%,respectively.Stems closely resembled fustrums of a paraboloid and a neiloid.Individual stem portions assumed different solids as follows:fustrums of paraboloid and neiloid were more prevalent from the stump to breast height,while a paraboloid closely matched stem shapes beyond this point.Therefore,a more accurate stem volumetric estimate was attained when stems were considered as a composite of at least three geometric solids.

K-means聚类精简点云驱动PointNet++的行星齿轮故障诊断

复杂装备的三维模型点云数据具有非结构化、无序性、离散性的特点,数据精简策略和深度神经网络模型构建被视为点云数据驱动的机械设备故障诊断关键技术难点。提出了一种K-means聚类(K均值聚类算法)精简点云驱动PointNet++的行星齿轮故障诊断方法。首先,提出了基于K-means的点云数据精简策略实现了在充分保留细节特征的前提下,精简84%的冗余数据;其次,构建了简度、速度、精度的精简效果三维评价指标体系并对精简算法进行评价;最后,构建了能够提取局部特征的PointNet++故障诊断模型。实验结果表明,相比于点云数据直接驱动PointNet++,K-means聚类精简点云驱动PointNet++的行星齿轮故障诊断的准确率提升了6.9%,表明了所提方法的有效性。

复杂场景下多模态点云数据配准技术

针对复杂环境下多模态点云数据获取难,以及对点云数据配准、三维模型构建精度的要求越来越高的情况。本文以南通大剧院实景三维建模为例,当初始点云和校准点云两组多模态融合点云位置差较大时,采用ICP算法进行点云配准易导致局部最优问题,利用所提出的基于控制点辅助约束的最近点迭代(CPA-ICP)算法通过对点云数据进行配准,并与其他3种点云配准算法的试验进行对比,可知该方法的配准精度和配准效率较高,对复杂场景下的多模态点云数据融合有较好的参考意义。

改进的3D-BoNet算法应用于点云实例分割与三维重建

为了更好地利用点云数据重建室内三维模型,本文提出了一种基于3D-BoNet-IAM算法的室内场景三维重建方法。该方法通过改进3D-BoNet算法提高点云数据的实例分割精度。针对点云数据缺失问题,提出了基于平面基元合并优化的拟合平面方法,利用拟合得到的新平面重建建筑表面模型。在S3DIS和ScanNet V2数据集上验证3D-BoNet算法的改进效果。试验结果表明,本文提出的3D-BoNet-IAM算法比原始算法分割精度提高了3.3%;对比本文建模效果与其他建模效果发现,本文方法的建模效果更准确。本文方法能够提高室内点云数据的实例分割精度,同时得到高质量的室内三维模型。

基于自蒸馏框架的点云分类及其鲁棒性研究

与2D图像数据集相比,3D点云数据集的规模较小且表征性较差,容易导致神经网络出现过拟合和泛化能力差的问题。为此,提出一种点云自蒸馏(PointSD)框架,通过对表征形式不同的数据样本进行学习,使网络提取到原始点云数据中的更多特征信息,实现样本之间的知识交互,在不增加额外计算负荷的情况下提升网络的泛化能力,适用于不同规模的分类网络模型。基于该框架提出一种点云抗腐败训练方法TND-PointSD,解决了当前点云训练方法抗腐败能力不足的问题。实验结果表明:在ScanObjectNN数据集上,应用PointSD框架的PointNet++和RepSurf-U 2X基准网络的平均准确率(MA)相比于应用标准训练(ST)方法提高了8.22和4.86个百分点;在ModelNet40-C数据集上,在15种腐败类型上分类网络的平均整体准确率(MOA)均有所提升,证明了TND-PointSD方法能够有效地增强网络模型的腐败鲁棒性。

地面激光扫描点云与无人机影像点云融合应用

通过建立高精度的桥梁三维点云模型,检查桥梁病害情况并拟合绘制出桥梁线形。首先以无人机近景摄影、环绕飞行、井字飞行获取某双线特大桥梁主体与细部纹理数据,然后将不同航线采集的数据在Context Capture软件里面进行三维重建,将桥梁主体与细部影像融合生成完整桥梁点云1。运用Trimble SX12仪器完成对桥梁一体化扫描,获得完整桥梁点云2。提出基于双向KD-tree优化的ICP(Iterative Closest Point)算法对无人机航摄桥梁点云1与地面激光扫描桥梁点云数据2进行配准融合,加密后的桥梁点云用于建立运营铁路双线特大桥精细化三维实景建模。提出基于KD-tree的PCA(Principal Component Analysis)算法完整提取出桥梁吊索点云,运用最小二乘法拟合出桥梁拱轴线线形、RANSAC算法拟合出桥面线形。通过与单一无人机、单一地面激光扫描精度及完整性对比分析,以验证融合建模的有效性。研究结果表明:融合建模的模型水平精度1.71 cm、垂直方向精度1.25 cm,较单一无人机建模精度在水平与竖直方向分别提升16.59%与20.89%;融合建模的完整性为98.17%,纹理效果更加真实,并检查出桥墩存在蜂窝麻面、渗水等病害,拱肋存在涂装锈蚀、破裂等病害。该研究可为桥梁三维点云模型应用研究提供思路参考,具有较好的应用前景。

新能源汽车激光雷达传感器缺失数据填补方法研究

为了增强车辆激光雷达传感器数据采集的全面性,研究新能源汽车激光雷达传感器缺失数据填补方法。利用数据融合的点云采集技术和中值滤波算法,预处理点云数据。采用改进的噪声密度聚类算法构建点云超体素块,建立图模型,并利用图割算法进行全局聚类。结合典型地物特征提取地物信息,并利用全景图像进行密集匹配填补缺失区域,以完成点云数据中空洞区域的填补。实验结果表明,该方法能够有效实现缺失数据的填补,并且填补效果良好。填补后的点云数据与缺失区域原始点云在深度方向上的分布状况几乎一致。

基于边界点估计与稀疏卷积神经网络的三维点云语义分割

针对大规模点云具有稀疏性,传统点云方法提取上下文语义特征不够丰富,并且语义分割结果存在物体边界模糊的问题,提出基于边界点估计与稀疏卷积神经网络的三维点云语义分割算法,主要包括体素分支与点分支.对于体素分支,将原始点云进行体素化后经过稀疏卷积得到上下文语义特征;进行解体素化得到每个点的初始语义标签;将初始语义标签输入到边界点估计模块中得到可能的边界点.对于点分支,使用改进的动态图卷积模块提取点云局部几何特征;依次经过空间注意力模块与通道注意力模块增强局部特征;将点分支得到的局部几何特征与体素分支得到的上下文特征融合,增强点云特征的丰富性.本算法在S3DIS数据集和SemanticKITTI数据集上的语义分割精度分别达到69.5%和62.7%.实验结果表明,本研究算法能够提取到更丰富的点云特征,可以对物体的边界区域进行准确分割,具有较好的三维点云语义分割能力.

基于三维点云的采后香蕉表征褐变定量评估方法

【目的】研究采后香蕉的表征褐变并评估其衰老程度对香蕉保鲜管理至关重要,本研究致力于解决传统人工测量香蕉表征褐变存在的劳动强度大、效率低下的问题。【方法】提出一种基于三维点云的采后香蕉表征褐变过程定量评估方法。首先利用三维扫描仪获取香蕉的三维点云模型,重构出香蕉的几何模型;然后使用欧式聚类对香蕉几何模型进行点云滤波降噪处理;再结合图像阈值分割法与散点轮廓算法(Alpha Shapes)求出香蕉的体积、表面积和黑斑面积;最后利用傅里叶函数对香蕉表面黑斑变化过程进行模拟,确定香蕉表征褐变过程的评估模型。设计本算法与溢水法测量实际香蕉体积、手绘测量面积的对比试验。【结果】拟合香蕉的生长函数,回归直线对观测值的拟合程度R2=0.9816>0.75,验证了算法的有效性。对比试验结果表明,本算法与实际测量值的平均相对误差小于1%,验证了该算法的准确性和可行性。【结论】本研究可为香蕉的保鲜管理提供数据及技术支撑。

MIT测井数据的点云转换及井筒形变诊断

针对多臂井径仪(MIT)采集井筒内壁空间位置参数可视化需求,现提出将其转换为点云数据,再通过对数据模型诊断分析得到井筒的形变类型。建立MIT测井过程可视化模型,通过引入柱面坐标来标定每个测点三维坐标;将每个测点的空间位置信息由极坐标转换为直角坐标,形成点云模型。采用所提方法将SH54井风险段处MIT数据成功转换为点云数据,并对该井470~471 m处的点云模型以类似CT横断扫描诊断的方式进行平铺展开,利用曲线拟合、面积计算得到SH54井在470~471 m处每个横断面的实际轮廓线和实际面积。结果表明:利用该方法生成的点云模型通过图表对比分析,可推断出该井段产生了非对称挤压缩径形变。

无人机LiDAR点云与无人机影像匹配点云分析比较

随着无人机技术的不断发展,无人机数码航测技术和无人机LiDAR技术在测量领域的应用越来越广泛。为分析无人机LiDAR点云和无人机影像匹配点云2种点云的差异,该文通过对西南某铁路一个测区在同一飞行高度的情况下同时进行无人机数码航摄及无人机LiDAR航摄2种方式航摄。对2种不同的摄影方式获取的点云进行比较,分析出2种方法获取点云在形态表现、滤波分类,以及利用2种点云制作DEM高程精度方面的差异,为实际工程航飞方式的选择提供一个参考。

Myvoxel R-CNN:基于体素的三维点云目标检测模型

围绕目前三维点云目标检测中存在的特征提取不充分、困难(Hard)目标检测准确率低、模型泛化能力有待提高等问题,提出了一种新的单模态三维点云目标检测模型Myvoxel R-CNN,该模型由3个主要模块组成,分别是3D主干网络、2D鸟瞰区域建议网络(2D主干网络+区域建议网络(RPN))以及检测头,在3D主干网络中添加了多头自注意力模块和基于稀疏卷积的残差块,增强了3D主干网络的体素特征学习能力,捕获了更多数据和特征内部的相关性.设计了一个由注意力融合模块组成的2D主干网络,增加了原模型对2D特征的关注度.为了进一步增加所提出模型的泛化性,引入了一种新的数据增强方案——随机局部金字塔数据增强方法,以形状感知的方式生成增强对象样本.在KITTI数据集上,本模型对汽车Hard级别的检测精度AP 3D提升了约2.23%,此外简单(Easy)和中等(Moderate)类别分别提高了约0.60%和0.62%,对行人Easy级别的检测精度AP 3D、AP BEV分别提升了约0.62%和0.86%,Hard级别的AP 3D、AP BEV分别提升了约1.45%和1.53%,实验结果表明,Myvoxel R-CNN在KITTI数据集上的表现优于其他方法.

改进的密度聚类精确自适应提取LiDAR电力线点云方法

原有邻域半径r_(Eps)与密度阈值p_(MinPts)两个参数的初始赋值导致电力线点云的提取结果存在不确定性,在密度聚类的基础上增添了点云簇类自适应判别方法,该方法避免人员重复测试初始参数的繁琐过程,采用C++语言完成了对该算法电力线精确提取及电力线拟合程序的开发与测试。结果表明:改进后的密度聚类法在电力线点云提取的损失率仅0.02%,三维重建残差为0.213 m;该方法大幅提高了电力线点云提取的准确性与便捷性,适用于高压电力走廊的电力巡检与三维重建等工作。