Indoor Space Modeling and Parametric Component Construction Based on 3D Laser Point Cloud Data

In order to enhance modeling efficiency and accuracy,we utilized 3D laser point cloud data for indoor space modeling.Point cloud data was obtained with a 3D laser scanner and optimized with Autodesk Recap and Revit software to extract geometric information about the indoor environment.Furthermore,we proposed a method for constructing indoor elements based on parametric components.The research outcomes of this paper will offer new methods and tools for indoor space modeling and design.The approach of indoor space modeling based on 3D laser point cloud data and parametric component construction can enhance modeling efficiency and accuracy,providing architects,interior designers,and decorators with a better working platform and design reference.

Methodology for Extraction of Tunnel Cross-Sections Using Dense Point Cloud Data

Tunnel deformation monitoring is a crucial task to evaluate tunnel stability during the metro operation period.Terrestrial Laser Scanning(TLS)can collect high density and high accuracy point cloud data in a few minutes as an innovation technique,which provides promising applications in tunnel deformation monitoring.Here,an efficient method for extracting tunnel cross-sections and convergence analysis using dense TLS point cloud data is proposed.First,the tunnel orientation is determined using principal component analysis(PCA)in the Euclidean plane.Two control points are introduced to detect and remove the unsuitable points by using point cloud division and then the ground points are removed by defining an elevation value width of 0.5 m.Next,a z-score method is introduced to detect and remove the outlies.Because the tunnel cross-section’s standard shape is round,the circle fitting is implemented using the least-squares method.Afterward,the convergence analysis is made at the angles of 0°,30°and 150°.The proposed approach’s feasibility is tested on a TLS point cloud of a Nanjing subway tunnel acquired using a FARO X330 laser scanner.The results indicate that the proposed methodology achieves an overall accuracy of 1.34 mm,which is also in agreement with the measurements acquired by a total station instrument.The proposed methodology provides new insights and references for the applications of TLS in tunnel deformation monitoring,which can also be extended to other engineering applications.

A LiDAR Point Clouds Dataset of Ships in a Maritime Environment

For the first time, this article introduces a LiDAR Point Clouds Dataset of Ships composed of both collected and simulated data to address the scarcity of LiDAR data in maritime applications. The collected data are acquired using specialized maritime LiDAR sensors in both inland waterways and wide-open ocean environments. The simulated data is generated by placing a ship in the LiDAR coordinate system and scanning it with a redeveloped Blensor that emulates the operation of a LiDAR sensor equipped with various laser beams. Furthermore,we also render point clouds for foggy and rainy weather conditions. To describe a realistic shipping environment, a dynamic tail wave is modeled by iterating the wave elevation of each point in a time series. Finally, networks serving small objects are migrated to ship applications by feeding our dataset. The positive effect of simulated data is described in object detection experiments, and the negative impact of tail waves as noise is verified in single-object tracking experiments. The Dataset is available at https://github.com/zqy411470859/ship_dataset.

Development of vehicle-recognition method on water surfaces using LiDAR data:SPD^(2)(spherically stratified point projection with diameter and distance)

Swarm robot systems are an important application of autonomous unmanned surface vehicles on water surfaces.For monitoring natural environments and conducting security activities within a certain range using a surface vehicle,the swarm robot system is more efficient than the operation of a single object as the former can reduce cost and save time.It is necessary to detect adjacent surface obstacles robustly to operate a cluster of unmanned surface vehicles.For this purpose,a LiDAR(light detection and ranging)sensor is used as it can simultaneously obtain 3D information for all directions,relatively robustly and accurately,irrespective of the surrounding environmental conditions.Although the GPS(global-positioning-system)error range exists,obtaining measurements of the surface-vessel position can still ensure stability during platoon maneuvering.In this study,a three-layer convolutional neural network is applied to classify types of surface vehicles.The aim of this approach is to redefine the sparse 3D point cloud data as 2D image data with a connotative meaning and subsequently utilize this transformed data for object classification purposes.Hence,we have proposed a descriptor that converts the 3D point cloud data into 2D image data.To use this descriptor effectively,it is necessary to perform a clustering operation that separates the point clouds for each object.We developed voxel-based clustering for the point cloud clustering.Furthermore,using the descriptor,3D point cloud data can be converted into a 2D feature image,and the converted 2D image is provided as an input value to the network.We intend to verify the validity of the proposed 3D point cloud feature descriptor by using experimental data in the simulator.Furthermore,we explore the feasibility of real-time object classification within this framework.

A Random Fusion of Mix 3D and Polar Mix to Improve Semantic Segmentation Performance in 3D Lidar Point Cloud

This paper focuses on the effective utilization of data augmentation techniques for 3Dlidar point clouds to enhance the performance of neural network models.These point clouds,which represent spatial information through a collection of 3D coordinates,have found wide-ranging applications.Data augmentation has emerged as a potent solution to the challenges posed by limited labeled data and the need to enhance model generalization capabilities.Much of the existing research is devoted to crafting novel data augmentation methods specifically for 3D lidar point clouds.However,there has been a lack of focus on making the most of the numerous existing augmentation techniques.Addressing this deficiency,this research investigates the possibility of combining two fundamental data augmentation strategies.The paper introduces PolarMix andMix3D,two commonly employed augmentation techniques,and presents a new approach,named RandomFusion.Instead of using a fixed or predetermined combination of augmentation methods,RandomFusion randomly chooses one method from a pool of options for each instance or sample.This innovative data augmentation technique randomly augments each point in the point cloud with either PolarMix or Mix3D.The crux of this strategy is the random choice between PolarMix and Mix3Dfor the augmentation of each point within the point cloud data set.The results of the experiments conducted validate the efficacy of the RandomFusion strategy in enhancing the performance of neural network models for 3D lidar point cloud semantic segmentation tasks.This is achieved without compromising computational efficiency.By examining the potential of merging different augmentation techniques,the research contributes significantly to a more comprehensive understanding of how to utilize existing augmentation methods for 3D lidar point clouds.RandomFusion data augmentation technique offers a simple yet effective method to leverage the diversity of augmentation techniques and boost the robustness of models.The insights gained from this research can pave the way for future work aimed at developing more advanced and efficient data augmentation strategies for 3D lidar point cloud analysis.

Automated Rock Detection and Shape Analysis from Mars Rover Imagery and 3D Point Cloud Data

A new object-oriented method has been developed for the extraction of Mars rocks from Mars rover data. It is based on a combination of Mars rover imagery and 3D point cloud data. First, Navcam or Pancam images taken by the Mars rovers are segmented into homogeneous objects with a mean-shift algorithm. Then, the objects in the segmented images are classified into small rock candidates, rock shadows, and large objects. Rock shadows and large objects are considered as the regions within which large rocks may exist. In these regions, large rock candidates are extracted through ground-plane fitting with the 3D point cloud data. Small and large rock candidates are combined and postprocessed to obtain the final rock extraction results. The shape properties of the rocks （angularity, circularity, width, height, and width-height ratio） have been calculated for subsequent ~eological studies.

Classification of rice seed variety using point cloud data combined with deep learning

Rice variety selection and quality inspection are key links in rice planting.Compared with two-dimensional images,three-dimensional information on rice seeds shows the appearance characteristics of rice seeds more comprehensively and accurately.This study proposed a rice variety classification method using three-dimensional point cloud data of the surface of rice seeds combined with a deep learning network to achieve the rapid and accurate identification of rice varieties.First,a point cloud collection platform was set up with a Raytrix light field camera as the core to collect three-dimensional point cloud data on the surface of rice seeds;then,the collected point cloud was filled,filtered and smoothed;after that,the point cloud segmentation is based on the RANSAC algorithm,and the point cloud downsampling is based on a combination of random sampling algorithm and voxel grid filtering algorithm.Finally,the processed point cloud was input to the improved PointNet network for feature extraction and species classification.The improved PointNet network added a cross-level feature connection structure,made full use of features at different levels,and better extracted the surface structure features of rice seeds.After testing,the improved PointNet model had an average classification accuracy of 89.4%for eight varieties of rice,which was 1.2%higher than that of the PointNet model.The method proposed in this study combined deep learning and point cloud data to achieve the efficient classification of rice varieties.

Classified denoising method for laser point cloud data of stored grain bulk surface based on discrete wavelet threshold

Surfaces of stored grain bulk are often reconstructed from organized point sets with noise by 3-D laser scanner in an online measuring system.As a result,denoising is an essential procedure in processing point cloud data for more accurate surface reconstruction and grain volume calculation.A classified denoising method was presented in this research for noise removal from point cloud data of the grain bulk surface.Based on the distribution characteristics of cloud point data,the noisy points were divided into three types:The first and second types of the noisy points were either sparse points or small point cloud data deviating and suspending from the main point cloud data,which could be deleted directly by a grid method;the third type of the noisy points was mixed with the main body of point cloud data,which were most difficult to distinguish.The point cloud data with those noisy points were projected into a horizontal plane.An image denoising method,discrete wavelet threshold(DWT)method,was applied to delete the third type of the noisy points.Three kinds of denoising methods including average filtering method,median filtering method and DWT method were applied respectively and compared for denoising the point cloud data.Experimental results show that the proposed method remains the most of the details and obtains the lowest average value of RMSE(Root Mean Square Error,0.219)as well as the lowest relative error of grain volume(0.086%)compared with the other two methods.Furthermore,the proposed denoising method could not only achieve the aim of removing noisy points,but also improve self-adaptive ability according to the characteristics of point cloud data of grain bulk surface.The results from this research also indicate that the proposed method is effective for denoising noisy points and provides more accurate data for calculating grain volume.

基于改进PointNet++的输电线路关键部位点云语义分割研究

输电线路的关键部位包括塔身、导线、绝缘子、避雷线以及引流线,无人机精细化导航的首要任务是构造输电线路的点云地图并从中分割出上述部位。为解决现有算法在输电线路的绝缘子、引流线等精细结构分割时精度低的问题,通过改进PointNet++算法,提出了一种面向输电线路精细结构的点云分割方法。首先,基于无人机机载激光雷达在现场采集的点云数据,构造了输电线路点云分割数据集;其次,通过对比实验,筛选出在本输电线路场景下合理的数据增强方法,并对数据集进行了数据增强;最后,将自注意力机制以及倒置残差结构和PointNet++相结合,设计了输电线路关键部位点云语义分割算法。实验结果表明:该改进PointNet++算法在全场景输电线路现场点云数据作为输入的前提下,首次实现了对引流线、绝缘子等输电线路中精细结构和导线、杆塔塔身以及输电线路无关背景点的同时分割,平均交并比(mean intersection over union,mIoU)达80.79%,所有类别分割的平均F_(1)值(F1 score)达88.99%。

Multi-view ladar data registration in obscure environment

Multi-view laser radar （ladar） data registration in obscure environments is an important research field of obscured target detection from air to ground. There are few overlap regions of the observational data in different views because of the occluder, so the multi-view data registration is rather difficult. Through indepth analyses of the typical methods and problems, it is obtained that the sequence registration is more appropriate, but needs to improve the registration accuracy. On this basis, a multi-view data registration algorithm based on aggregating the adjacent frames, which are already registered, is proposed. It increases the overlap region between the pending registration frames by aggregation and further improves the registration accuracy. The experiment results show that the proposed algorithm can effectively register the multi-view ladar data in the obscure environment, and it also has a greater robustness and a higher registration accuracy compared with the sequence registration under the condition of equivalent operating efficiency.

Accuracy of common stem volume formulae using terrestrial photogrammetric point clouds:a case study with savanna trees in Benin

Recent applications of digital photogrammetry in forestry have highlighted its utility as a viable mensuration technique.However,in tropical regions little research has been done on the accuracy of this approach for stem volume calculation.In this study,the performance of Structure from Motion photogrammetry for estimating individual tree stem volume in relation to traditional approaches was evaluated.We selected 30 trees from five savanna species growing at the periphery of the W National Park in northern Benin and measured their circumferences at different heights using traditional tape and clinometer.Stem volumes of sample trees were estimated from the measured circumferences using nine volumetric formulae for solids of revolution,including cylinder,cone,paraboloid,neiloid and their respective fustrums.Each tree was photographed and stem volume determined using a taper function derived from tri-dimensional stem models.This reference volume was compared with the results of formulaic estimations.Tree stem profiles were further decomposed into different portions,approximately corresponding to the stump,butt logs and logs,and the suitability of each solid of revolution was assessed for simulating the resulting shapes.Stem volumes calculated using the fustrums of paraboloid and neiloid formulae were the closest to reference volumes with a bias and root mean square error of 8.0%and 24.4%,respectively.Stems closely resembled fustrums of a paraboloid and a neiloid.Individual stem portions assumed different solids as follows:fustrums of paraboloid and neiloid were more prevalent from the stump to breast height,while a paraboloid closely matched stem shapes beyond this point.Therefore,a more accurate stem volumetric estimate was attained when stems were considered as a composite of at least three geometric solids.

ALGORITHM OF PRETREATMENT ON AUTOMOBILE BODY POINT CLOUD

As point cloud of one whole vehicle body has the traits of large geometric dimension, huge data and rigorous reverse precision, one pretreatment algorithm on automobile body point cloud is put forward. The basic idea of the registration algorithm based on the skeleton points is to construct the skeleton points of the whole vehicle model and the mark points of the separate point cloud, to search the mapped relationship between skeleton points and mark points using congruence triangle method and to match the whole vehicle point cloud using the improved iterative closed point （ICP） algorithm. The data reduction algorithm, based on average square root of distance, condenses data by three steps, computing datasets＇ average square root of distance in sampling cube grid, sorting order according to the value computed from the first step, choosing sampling percentage. The accuracy of the two algorithms above is proved by a registration and reduction example of whole vehicle point cloud of a certain light truck.

基于深度学习的移动机器人语义SLAM方法研究

为了给移动机器人提供细节丰富的三维语义地图,支撑机器人的精准定位,本文提出一种结合RGB-D信息与深度学习结果的机器人语义同步定位与建图方法。改进了ORB-SLAM2算法的框架,提出一种可以构建稠密点云地图的视觉同步定位与建图系统;将深度学习的目标检测算法YOLO v5与视觉同步定位与建图系统融合,反映射为三维点云语义标签,结合点云分割完成数据关联和物体模型更新,并用八叉树的地图形式存储地图信息;基于移动机器人平台,在实验室环境下开展移动机器人三维语义同步定位与建图实验,实验结果验证了本文语义同步定位与建图算法的语义信息映射、点云分割与语义信息匹配以及三维语义地图构建的有效性。

改进的3D-BoNet算法应用于点云实例分割与三维重建

为了更好地利用点云数据重建室内三维模型,本文提出了一种基于3D-BoNet-IAM算法的室内场景三维重建方法。该方法通过改进3D-BoNet算法提高点云数据的实例分割精度。针对点云数据缺失问题,提出了基于平面基元合并优化的拟合平面方法,利用拟合得到的新平面重建建筑表面模型。在S3DIS和ScanNet V2数据集上验证3D-BoNet算法的改进效果。试验结果表明,本文提出的3D-BoNet-IAM算法比原始算法分割精度提高了3.3%;对比本文建模效果与其他建模效果发现,本文方法的建模效果更准确。本文方法能够提高室内点云数据的实例分割精度,同时得到高质量的室内三维模型。

K-means聚类精简点云驱动PointNet++的行星齿轮故障诊断

复杂装备的三维模型点云数据具有非结构化、无序性、离散性的特点,数据精简策略和深度神经网络模型构建被视为点云数据驱动的机械设备故障诊断关键技术难点。提出了一种K-means聚类(K均值聚类算法)精简点云驱动PointNet++的行星齿轮故障诊断方法。首先,提出了基于K-means的点云数据精简策略实现了在充分保留细节特征的前提下,精简84%的冗余数据;其次,构建了简度、速度、精度的精简效果三维评价指标体系并对精简算法进行评价;最后,构建了能够提取局部特征的PointNet++故障诊断模型。实验结果表明,相比于点云数据直接驱动PointNet++,K-means聚类精简点云驱动PointNet++的行星齿轮故障诊断的准确率提升了6.9%,表明了所提方法的有效性。

复杂场景下多模态点云数据配准技术

针对复杂环境下多模态点云数据获取难,以及对点云数据配准、三维模型构建精度的要求越来越高的情况。本文以南通大剧院实景三维建模为例,当初始点云和校准点云两组多模态融合点云位置差较大时,采用ICP算法进行点云配准易导致局部最优问题,利用所提出的基于控制点辅助约束的最近点迭代(CPA-ICP)算法通过对点云数据进行配准,并与其他3种点云配准算法的试验进行对比,可知该方法的配准精度和配准效率较高,对复杂场景下的多模态点云数据融合有较好的参考意义。

基于车载点云的道路三维实景建模方法研究

传统的基础测绘存在组织管理固化、服务模式落后、产品形式单一等问题,在新型基础测绘体系下形成了全要素三维实景模型这一成果。本文探讨基于车载点云进行城市道路三维实景建模方法研究,并以某城市主干路为试验对象,对道路及道路两侧部件点云数据进行矢量化得到道路全要素地形数据,以部件点云数据为参考结合外业调绘尺寸用3ds Max软件制作道路部件模板库,并结合点云数据和矢量数据对各类要素进行单体化,最后将道路模型和部件模型融合。结果表明,基于车载点云数据构建的城市道路全要素实景模型不仅可以保证场景的完整性和真实性,还减少了作业时间和成本,实现了各类模型之间的无缝结合,制作完成的模型精度也能满足项目精度要求。

基于“十字”标志物的红外图像与三维点云融合方法

红外热成像技术广泛应用于多个领域,建立含有空间和温度信息的三维温度场模型具有十分重要的意义,可以将该技术扩展到更多应用领域.为此,本文提出一种异源空间数据融合方法,融合红外图像和三维点云,得到三维温度场模型.针对红外相机与可见光相机成像原理存在差异,难以通过常用标定板进行内参标定的问题,基于红外相机成像特性设计并制作镂空圆孔标定板用于内参标定,所得内参平均重投影误差为0.03像素.针对红外相机与结构光相机的成像原理不同,现有标志物制作复杂、外参精度低的问题,基于不同材料的辐射度差异,设计制作“十字”标志物并将其用于联合标定.为解决同名特征点难以识别的问题,针对红外图像和三维点云分别设计了同名特征点提取方法,配合“十字”标志物进行同名特征点提取.红外图像和三维点云特征点提取方法的检测重复率分别为75%和92%,与传统方法相比两者的检测重复率均有所提升.利用该方法建立纸杯、工件和人脸的三维温度场模型.实验结果表明,使用镂空圆孔标定板能实现红外相机的内参标定,对“十字”标志物采用同名特征点提取方法能完成红外相机与结构光相机的联合标定.最终所得三维温度场模型的平均重投影误差为1.70像素,与现有方法相比模型精度有所提升.

基于边界点估计与稀疏卷积神经网络的三维点云语义分割

针对大规模点云具有稀疏性,传统点云方法提取上下文语义特征不够丰富,并且语义分割结果存在物体边界模糊的问题,提出基于边界点估计与稀疏卷积神经网络的三维点云语义分割算法,主要包括体素分支与点分支.对于体素分支,将原始点云进行体素化后经过稀疏卷积得到上下文语义特征;进行解体素化得到每个点的初始语义标签;将初始语义标签输入到边界点估计模块中得到可能的边界点.对于点分支,使用改进的动态图卷积模块提取点云局部几何特征;依次经过空间注意力模块与通道注意力模块增强局部特征;将点分支得到的局部几何特征与体素分支得到的上下文特征融合,增强点云特征的丰富性.本算法在S3DIS数据集和SemanticKITTI数据集上的语义分割精度分别达到69.5%和62.7%.实验结果表明,本研究算法能够提取到更丰富的点云特征,可以对物体的边界区域进行准确分割,具有较好的三维点云语义分割能力.

基于自蒸馏框架的点云分类及其鲁棒性研究

与2D图像数据集相比,3D点云数据集的规模较小且表征性较差,容易导致神经网络出现过拟合和泛化能力差的问题。为此,提出一种点云自蒸馏(PointSD)框架,通过对表征形式不同的数据样本进行学习,使网络提取到原始点云数据中的更多特征信息,实现样本之间的知识交互,在不增加额外计算负荷的情况下提升网络的泛化能力,适用于不同规模的分类网络模型。基于该框架提出一种点云抗腐败训练方法TND-PointSD,解决了当前点云训练方法抗腐败能力不足的问题。实验结果表明:在ScanObjectNN数据集上,应用PointSD框架的PointNet++和RepSurf-U 2X基准网络的平均准确率(MA)相比于应用标准训练(ST)方法提高了8.22和4.86个百分点;在ModelNet40-C数据集上,在15种腐败类型上分类网络的平均整体准确率(MOA)均有所提升,证明了TND-PointSD方法能够有效地增强网络模型的腐败鲁棒性。