Intelligent extraction of road cracks based on vehicle laser point cloud and panoramic sequence images

In light of the limited efficacy of conventional methods for identifying pavement cracks and the absence of comprehensive depth and location data in two-dimensional photographs,this study presents an intelligent strategy for extracting road cracks.This methodology involves the integration of laser point cloud data obtained from a vehicle-mounted system and a panoramic sequence of images.The study employs a vehicle-mounted LiDAR measurement system to acquire laser point cloud and panoramic sequence image data simultaneously.A convolutional neural network is utilized to extract cracks from the panoramic sequence image.The extracted sequence image is then aligned with the laser point cloud,enabling the assignment of RGB information to the vehicle-mounted three dimensional(3D)point cloud and location information to the two dimensional(2D)panoramic image.Additionally,a threshold value is set based on the crack elevation change to extract the aligned roadway point cloud.The three-dimensional data pertaining to the cracks can be acquired.The experimental findings demonstrate that the use of convolutional neural networks has yielded noteworthy outcomes in the extraction of road cracks.The utilization of point cloud and image alignment techniques enables the extraction of precise location data pertaining to road cracks.This approach exhibits superior accuracy when compared to conventional methods.Moreover,it facilitates rapid and accurate identification and localization of road cracks,thereby playing a crucial role in ensuring road maintenance and traffic safety.Consequently,this technique finds extensive application in the domains of intelligent transportation and urbanization development.The technology exhibits significant promise for use in the domains of intelligent transportation and city development.

Estimating wood quality attributes from dense airborne LiDAR point clouds

Mapping individual tree quality parameters from high-density LiDAR point clouds is an important step towards improved forest inventories.We present a novel machine learning-based workflow that uses individual tree point clouds from drone laser scanning to predict wood quality indicators in standing trees.Unlike object reconstruction methods,our approach is based on simple metrics computed on vertical slices that summarize information on point distances,angles,and geometric attributes of the space between and around the points.Our models use these slice metrics as predictors and achieve high accuracy for predicting the diameter of the largest branch per log (DLBs) and stem diameter at different heights (DS) from survey-grade drone laser scans.We show that our models are also robust and accurate when tested on suboptimal versions of the data generated by reductions in the number of points or emulations of suboptimal single-tree segmentation scenarios.Our approach provides a simple,clear,and scalable solution that can be adapted to different situations both for research and more operational mapping.

Building Facade Point Clouds Segmentation Based on Optimal Dual-Scale Feature Descriptors

To address the current issues of inaccurate segmentation and the limited applicability of segmentation methods for building facades in point clouds, we propose a facade segmentation algorithm based on optimal dual-scale feature descriptors. First, we select the optimal dual-scale descriptors from a range of feature descriptors. Next, we segment the facade according to the threshold value of the chosen optimal dual-scale descriptors. Finally, we use RANSAC (Random Sample Consensus) to fit the segmented surface and optimize the fitting result. Experimental results show that, compared to commonly used facade segmentation algorithms, the proposed method yields more accurate segmentation results, providing a robust data foundation for subsequent 3D model reconstruction of buildings.

A voxel-based fine-scale 3D landscape pattern analysis using laser scanner point clouds

The landscape pattern metrics can quantitatively describe the characteristics of landscape pattern and are widely used in various fields of landscape ecology.Due to the lack of vertical information,2D landscape metrics cannot delineate the vertical characteristics of landscape pattern.Based on the point clouds,a high-resolution voxel model and several voxel-based 3D landscape metrics were constructed in this study and 3D metrics calculation results were compared with that of 2D metrics.The results showed that certain quantifying difference exists between 2D and 3D landscape metrics.For landscapes with different components and spatial configurations,significant difference was disclosed between 2D and 3D landscape metrics.3D metrics can better reflect the real spatial structure characteristics of the landscape than 2D metrics.

Filtering of Airborne Lidar Point Clouds for Complex Cityscapes

A novel filtering algorithm for Lidar point clouds is presented, which can work well for complex cityscapes. Its main features are filtering based on raw Lidar point clouds without previous triangulation or rasterization. 3D topological relations among points are used to search edge points at the top of discontinuities, which are key information to recognize the bare earth points and building points. Experiment results show that the proposed algorithm can preserve discontinuous features in the bare earth and has no impact of size and shape of buildings.

Landslide data mosaicking based on an airborne laser point cloud and multi-beam sonar images

Landslides are one of the most disastrous geological hazards in southwestern China.Once a landslide becomes unstable,it threatens the lives and safety of local residents.However,empirical studies on landslides have predominantly focused on landslides that occur on land.To this end,we aim to investigate ashore and underwater landslide data synchronously.This study proposes an optimized mosaicking method for ashore and underwater landslide data.This method fuses an airborne laser point cloud with multi-beam depth sounder images.Owing to their relatively high efficiency and large coverage area,airborne laser measurement systems are suitable for emergency investigations of landslides.Based on the airborne laser point cloud,the traversal of the point with the lowest elevation value in the point set can be used to perform rapid extraction of the crude channel boundaries.Further meticulous extraction of the channel boundaries is then implemented using the probability mean value optimization method.In addition,synthesis of the integrated ashore and underwater landslide data angle is realized using the spatial guide line between the channel boundaries and the underwater multibeam sonar images.A landslide located on the right bank of the middle reaches of the Yalong River is selected as a case study to demonstrate that the proposed method has higher precision thantraditional methods.The experimental results show that the mosaicking method in this study can meet the basic needs of landslide modeling and provide a basis for qualitative and quantitative analysis and stability prediction of landslides.

A Novel Airborne 3D Laser Point Cloud Hole Repair Algorithm Considering Topographic Features

Hole repair processing is an important part of point cloud data processing in airborne 3-dimensional(3D)laser scanning technology.Due to the fragmentation and irregularity of the surface morphology,when applying the 3D laser scanning technology to mountain mapping,the conventional mathematical cloud-based point cloud hole repair method is not ideal in practical applications.In order to solve this problem,we propose to repair the valley and ridge line first,and then repair the point cloud hole.The main technical steps of the method include the following points:First,the valley and ridge feature lines are extracted by the GIS slope analysis method;Then,the valley and ridge line missing from the hole are repaired by the mathematical interpolation method,and the repaired results are edited and inserted to the original point cloud;Finally,the traditional repair method is used to repair the point cloud hole whose valley line and ridge line have been repaired.Three experiments were designed and implemented in the east bank of the Xiaobaini River to test the performance of the proposed method.The results showed that compared with the direct point cloud hole repair method in Geomagic Studio software,the average repair accuracy of the proposed method,in the 16 m buffer zone of valley line and ridge line,is increased from 56.31 cm to 31.49 cm.The repair performance is significantly improved.

Building 3D CityGML models of mining industrial structures using integrated UAV and TLS point clouds

Mining industrial areas with anthropogenic engineering structures are one of the most distinctive features of the real world.3D models of the real world have been increasingly popular with numerous applications,such as digital twins and smart factory management.In this study,3D models of mining engineering structures were built based on the CityGML standard.For collecting spatial data,the two most popular geospatial technologies,namely UAV-SfM and TLS were employed.The accuracy of the UAV survey was at the centimeter level,and it satisfied the absolute positional accuracy requirement of creat-ing all levels of detail(LoD)according to the CityGML standard.Therefore,the UAV-SfM point cloud dataset was used to build LoD 2 models.In addition,the comparison between the UAV-SfM and TLS sub-clouds of facades and roofs indicates that the UAV-SfM and TLS point clouds of these objects are highly consistent,therefore,point clouds with a higher level of detail and accuracy provided by the integration of UAV-SfM and TLS were used to build LoD 3 models.The resulting 3D CityGML models include 39 buildings at LoD 2,and two mine shafts with hoistrooms,headframes,and sheave wheels at LoD3.

Automated registration of wide-baseline point clouds in forests using discrete overlap search

Forest is one of the most challenging environments to be recorded in a three-dimensional(3D)digitized geometrical representation,because of the size and the complexity of the environment and the data-acquisition constraints brought by on-site conditions.Previous studies have indicated that the data-acquisition pattern can have more influence on the registration results than other factors.In practice,the ideal short-baseline observations,i.e.,the dense collection mode,is rarely feasible,considering the low accessibility in forest environments and the commonly limited labor and time resources.The wide-baseline observations that cover a forest site using a few folds less observations than short-baseline observations,are therefore more preferable and commonly applied.Nevertheless,the wide-baseline approach is more challenging for data registration since it typically lacks the required sufficient overlaps between datasets.Until now,a robust automated registration solution that is independent of special hardware requirements has still been missing.That is,the registration accuracy is still far from the required level,and the information extractable from the merged point cloud using automated registration could not match that from the merged point cloud using manual registration.This paper proposes a discrete overlap search(DOS)method to find correspondences in the point clouds to solve the low-overlap problem in the wide-baseline point clouds.The proposed automatic method uses potential correspondences from both original data and selected feature points to reconstruct rough observation geometries without external knowledge and to retrieve precise registration parameters at data-level.An extensive experiment was carried out with 24 forest datasets of different conditions categorized in three difficulty levels.The performance of the proposed method was evaluated using various accuracy criteria,as well as based on data acquired from different hardware,platforms,viewing perspectives,and at different points of time.The proposed method achieved a 3D registration accuracy at a 0.50-cm level in all difficulty categories using static terrestrial acquisitions.In the terrestrial-aerial registration,data sets were collected from different sensors and at different points of time with scene changes,and a registration accuracy at the raw data geometric accuracy level was achieved.These results represent the highest automated registration accuracy and the strictest evaluation so far.The proposed method is applicable in multiple scenarios,such as 1)the global positioning of individual under-canopy observations,which is one of the main challenges in applying terrestrial observations lacking a global context,2)the fusion of point clouds acquired from terrestrial and aerial perspectives,which is required in order to achieve a complete forest observation,3)mobile mapping using a new stop-and-go approach,which solves the problems of lacking mobility and slow data collection in static terrestrial measurements as well as the data-quality issue in the continuous mobile approach.Furthermore,this work proposes a new error estimate that units all parameter-level errors into a single quantity and compensates for the downsides of the widely used parameter-and object-level error estimates;it also proposes a new deterministic point sets registration method as an alternative to the popular sampling methods.

Pre-process algorithm for satellite laser ranging data based on curve recognition from points cloud

The satellite laser ranging （SLR） data quality from the COMPASS was analyzed, and the difference between curve recognition in computer vision and pre-process of SLR data finally proposed a new algorithm for SLR was discussed data based on curve recognition from points cloud is proposed. The results obtained by the new algorithm are 85 % （or even higher） consistent with that of the screen displaying method, furthermore, the new method can process SLR data automatically, which makes it possible to be used in the development of the COMPASS navigation system.

Indoor Space Modeling and Parametric Component Construction Based on 3D Laser Point Cloud Data

In order to enhance modeling efficiency and accuracy,we utilized 3D laser point cloud data for indoor space modeling.Point cloud data was obtained with a 3D laser scanner and optimized with Autodesk Recap and Revit software to extract geometric information about the indoor environment.Furthermore,we proposed a method for constructing indoor elements based on parametric components.The research outcomes of this paper will offer new methods and tools for indoor space modeling and design.The approach of indoor space modeling based on 3D laser point cloud data and parametric component construction can enhance modeling efficiency and accuracy,providing architects,interior designers,and decorators with a better working platform and design reference.

基于PointNet++进行附属设施语义分割的隧道收敛变形分析

随着城市轨道交通日趋广泛,隧道结构变形引起的地铁安全事故凸显,亟需对运营期隧道进行变形检测。隧道衬砌作为隧道变形分析的研究对象,衬砌内表面存在的大量附属设施影响隧道收敛变形分析精度。为了提高变形分析精度,解决点云处理环节中存在的自动化程度低的问题,提出基于PointNet++点云语义分割的隧道收敛变形分析方法。首先利用深度学习方法进行点云语义分割,对隧道衬砌附属设施进行自动滤除。然后对隧道衬砌进行断面提取,利用随机抽样一致性算法(Random Sample Consensus,RANSAC)对隧道断面点云进行采样,分析隧道收敛变形程度,从Z+F PROFILER 9012A激光断面扫描仪获取山东省济南市地铁盾构隧道点云实测数据上并进行应用。研究结果表明:所提出的处理方法可以有效地将大规模隧道衬砌与连接紧密的附属设施分离出来,隧道附属设施总体分类精度达到96%,滤波结果较好地保留了隧道衬砌原始形态特征。在对隧道整体和局部收敛变形分析的重复性验证中,测试区间内隧道整体变形精度往返测长半轴平均偏差为1.04 mm,短半轴平均偏差为0.9 mm,测试区间内隧道局部收敛变形往返测标准差最小为0.773 mm,最大为0.938 mm,可以满足隧道收敛变形分析的精度需求。研究结果可以有效提升处理大规模隧道数据的自动化程度,具有良好的有效性与可靠性,对运营期地铁隧道收敛变形检测或监测有较好的实践应用意义。

基于知识蒸馏和定位引导的Pointpillars点云检测网络

激光雷达数据由于其几何特性,被广泛应用于三维目标检测任务中。由于点云数据的稀疏性和不规则性,难以实现特征提取的质量和推理速度间的平衡。本文提出一种基于体柱特征编码的三维目标检测算法,以Pointpillars网络为基础,设计Teacher-Student模型框架对回归框尺度进行蒸馏,增加蒸馏损失,优化训练网络模型,提升特征提取的质量。为进一步提高模型检测效果,设计定位引导分类项,增加分类预测和回归预测之间的相关性,提高物体识别准确率。本网络所做改进没有引入额外的网络嵌入。算法在KITTI数据集上的实验结果表明,相比于基准网络,在三维模式下的平均精度值从60.65%提升到了64.69%,鸟瞰图模式下的平均精度值从67.74%提升到70.24%。模型推理速度为45 FPS,在提升检测精度的同时满足了实时性要求。

Cloud Detection and Centroid Extraction of Laser Footprint Image of GF-7 Satellite Laser Altimetry

The laser altimeter loaded on the GaoFen-7(GF-7)satellite is designed to record the full waveform data and footprint image,which can obtain high-precision elevation control points for stereo image.The footprint camera equipped on the GF-7 laser altimetry system can capture the energy distribution at the time of laser emission and the image of the ground object where the laser falls,which can be used to judge whether the laser is affected by the cloud.At the same time,the centroid of laser spot on the footprint image can be extracted to monitor the change of laser pointing stability.In this manuscript,a data quality analysis scheme of laser altimetry based on footprint image is presented.Firstly,the cloud detection of footprint image is realized based on deep learning.The fusion result of the model is about 5%better than that of the traditional cloud detection algorithm,which can quickly and accurately determine whether the laser spot is affected by cloud.Secondly,according to the characteristics of footprint image,a threshold constrained ellipse fitting method for extracting the centroid of laser spot is proposed to monitor the pointing stability of long-period lasers.Based on the above method,the change of laser spot centroid since GF-7 satellite was put into operation is analyzed,and the conclusions obtained have certain reference significance for the quality control of satellite laser altimetry data and the analysis of pointing angle stability.

Methodology for Extraction of Tunnel Cross-Sections Using Dense Point Cloud Data

Tunnel deformation monitoring is a crucial task to evaluate tunnel stability during the metro operation period.Terrestrial Laser Scanning(TLS)can collect high density and high accuracy point cloud data in a few minutes as an innovation technique,which provides promising applications in tunnel deformation monitoring.Here,an efficient method for extracting tunnel cross-sections and convergence analysis using dense TLS point cloud data is proposed.First,the tunnel orientation is determined using principal component analysis(PCA)in the Euclidean plane.Two control points are introduced to detect and remove the unsuitable points by using point cloud division and then the ground points are removed by defining an elevation value width of 0.5 m.Next,a z-score method is introduced to detect and remove the outlies.Because the tunnel cross-section’s standard shape is round,the circle fitting is implemented using the least-squares method.Afterward,the convergence analysis is made at the angles of 0°,30°and 150°.The proposed approach’s feasibility is tested on a TLS point cloud of a Nanjing subway tunnel acquired using a FARO X330 laser scanner.The results indicate that the proposed methodology achieves an overall accuracy of 1.34 mm,which is also in agreement with the measurements acquired by a total station instrument.The proposed methodology provides new insights and references for the applications of TLS in tunnel deformation monitoring,which can also be extended to other engineering applications.

Usage of 3D Point Cloud Data in BIM （Building Information Modelling）： Current Applications and Challenges

BIM （building information modelling） has gained wider acceptance in the A/E/C （architecture/engineering/construction） industry in the US and internationally. This paper presents current industry approaches of implementing 3D point cloud data in BIM and VDC （virtual design and construction） applications during various stages of a project life cycle and the challenges associated with processing the huge amount of 3D point cloud data. Conversion from discrete 3D point cloud raster data to geometric/vector BIM data remains to be a labor-intensive process. The needs for intelligent geometric feature detection/reconstruction algorithms for automated point cloud processing and issues related to data management are discussed. This paper also presents an innovative approach for integrating 3D point cloud data with BIM to efficiently augment built environment design, construction and management.

基于改进PointPillars的点云车辆目标检测

针对自动驾驶领域中,激光雷达获取的点云数据存在稀疏性以及边缘噪点误检等问题,提出一种基于改进PointPil-lars的点云车辆目标检测方法。首先,基于SimAM注意力机制改进体素化特征输入,使得网络特征提取阶段能更加关注关键信息,提高特征学习的全局性。其次,基于卷积块注意力模块(CBAM)改进骨干网络结构,提出全新的轻量化通道注意力模块Tiny-CAM和可变形空间注意力模块Deformable-SAM,构建Multi-CBAM骨干网络,提升网络特征提取及特征融合能力。在KITTI数据集以及非公开车库点云数据集上进行验证,实验结果表明,与原网络相比,改进PointPillars方法具有更高的检测精度,平均检测精度提升2.98%,针对遮挡小于30%的点云车辆目标检测精度提升6.51%,证明了该方法的有效性。

基于激光点云的隧道超欠挖检测与表达

超欠挖是钻爆法隧道施工难以避免的问题,严重的超欠挖将影响施工安全、工程施工成本以及建设质量等,精准的超欠挖检测可以反映隧道爆破开挖质量,为后期支护成本提供依据,保障隧道工程的安全。本文提出一种基于激光点云的隧道超欠挖检测方法,将点云数据投影至断面坐标系,结合设计数据进行超欠挖检测;利用Visual Studio平台开发相应软件,实现超欠挖量、面积和体积的计算与精度评价;调用OpenGL API,以断面图、三维图与平铺图的形式实现超欠挖可视化,结合报表对检测结果进行表达。经过实测数据验证,本文方法的检测结果高效准确,表达效果形象直观,可满足隧道施工过程中超欠挖检测的需求。

三维激光扫描点云数据在CloudWorx for MicroStation下的处理

三维激光扫描技术作为一种先进的测量手段应用前景十分广阔,但是,在应用其扫描所得的点云数据进行内处理上又遇到了许多技术性的问题。CAD系统处理大量点云数据过程中存在局限性,一旦用CAD系统处理点云时,CAD程序就会出现错误操作提示,甚至完全停止进程。CloudWorx克服了这些局限性,它避免了直接输入数据,而是利用Cyclone技术作为MicroStation环境下有效管理和解决点云的工具,使MicroStation内点云操作与CAD程序执行再无冲突。本文主要介绍了并且还介绍了CloudWorx模块的功能,并举例就点云数据在CloudWorx for MicroStation软件环境下的处理工作进行了详细的介绍。

Integration system research and development for three-dimensional laser scanning information visualization in goaf

An integration processing system of three-dimensional laser scanning information visualization in goaf was developed. It is provided with multiple functions, such as laser scanning information management for goaf, cloud data de-noising optimization, construction, display and operation of three-dimensional model, model editing, profile generation, calculation of goaf volume and roof area, Boolean calculation among models and interaction with the third party soft ware. Concerning this system with a concise interface, plentiful data input/output interfaces, it is featured with high integration, simple and convenient operations of applications. According to practice, in addition to being well-adapted, this system is favorably reliable and stable.