Intelligent extraction of road cracks based on vehicle laser point cloud and panoramic sequence images

In light of the limited efficacy of conventional methods for identifying pavement cracks and the absence of comprehensive depth and location data in two-dimensional photographs,this study presents an intelligent strategy for extracting road cracks.This methodology involves the integration of laser point cloud data obtained from a vehicle-mounted system and a panoramic sequence of images.The study employs a vehicle-mounted LiDAR measurement system to acquire laser point cloud and panoramic sequence image data simultaneously.A convolutional neural network is utilized to extract cracks from the panoramic sequence image.The extracted sequence image is then aligned with the laser point cloud,enabling the assignment of RGB information to the vehicle-mounted three dimensional(3D)point cloud and location information to the two dimensional(2D)panoramic image.Additionally,a threshold value is set based on the crack elevation change to extract the aligned roadway point cloud.The three-dimensional data pertaining to the cracks can be acquired.The experimental findings demonstrate that the use of convolutional neural networks has yielded noteworthy outcomes in the extraction of road cracks.The utilization of point cloud and image alignment techniques enables the extraction of precise location data pertaining to road cracks.This approach exhibits superior accuracy when compared to conventional methods.Moreover,it facilitates rapid and accurate identification and localization of road cracks,thereby playing a crucial role in ensuring road maintenance and traffic safety.Consequently,this technique finds extensive application in the domains of intelligent transportation and urbanization development.The technology exhibits significant promise for use in the domains of intelligent transportation and city development.

Landslide data mosaicking based on an airborne laser point cloud and multi-beam sonar images

Landslides are one of the most disastrous geological hazards in southwestern China.Once a landslide becomes unstable,it threatens the lives and safety of local residents.However,empirical studies on landslides have predominantly focused on landslides that occur on land.To this end,we aim to investigate ashore and underwater landslide data synchronously.This study proposes an optimized mosaicking method for ashore and underwater landslide data.This method fuses an airborne laser point cloud with multi-beam depth sounder images.Owing to their relatively high efficiency and large coverage area,airborne laser measurement systems are suitable for emergency investigations of landslides.Based on the airborne laser point cloud,the traversal of the point with the lowest elevation value in the point set can be used to perform rapid extraction of the crude channel boundaries.Further meticulous extraction of the channel boundaries is then implemented using the probability mean value optimization method.In addition,synthesis of the integrated ashore and underwater landslide data angle is realized using the spatial guide line between the channel boundaries and the underwater multibeam sonar images.A landslide located on the right bank of the middle reaches of the Yalong River is selected as a case study to demonstrate that the proposed method has higher precision thantraditional methods.The experimental results show that the mosaicking method in this study can meet the basic needs of landslide modeling and provide a basis for qualitative and quantitative analysis and stability prediction of landslides.

Pedestrian detection algorithm based on video sequences and laser point cloud

Pedestrian detection is a critical problem in the field of computer vision. Although most existing algorithms are able to detect pedestrians well in controlled environ- ments, it is often difficult to achieve accurate pedestrian de- tection from video sequences alone, especially in pedestrian- intensive scenes wherein pedestrians may cause mutual oc- clusion and thus incomplete detection. To surmount these dif- ficulties, this paper presents pedestrian detection algorithm based on video sequences and laser point cloud. First, laser point cloud is interpreted and classified to separate pedes- trian data and vehicle data. Then a fusion of video image data and laser point cloud data is achieved by calibration. The re- gion of interest after fusion is determined using feature in- formation contained in video image and three-dimensional information of laser point cloud to remove false detection of pedestrian and thus to achieve pedestrian detection in inten- sive scenes. Experimental verification and analysis in video sequences demonstrate that fusion of two data improves the performance of pedestrian detection and has better detection results.

基于知识蒸馏和定位引导的Pointpillars点云检测网络

激光雷达数据由于其几何特性,被广泛应用于三维目标检测任务中。由于点云数据的稀疏性和不规则性,难以实现特征提取的质量和推理速度间的平衡。本文提出一种基于体柱特征编码的三维目标检测算法,以Pointpillars网络为基础,设计Teacher-Student模型框架对回归框尺度进行蒸馏,增加蒸馏损失,优化训练网络模型,提升特征提取的质量。为进一步提高模型检测效果,设计定位引导分类项,增加分类预测和回归预测之间的相关性,提高物体识别准确率。本网络所做改进没有引入额外的网络嵌入。算法在KITTI数据集上的实验结果表明,相比于基准网络,在三维模式下的平均精度值从60.65%提升到了64.69%,鸟瞰图模式下的平均精度值从67.74%提升到70.24%。模型推理速度为45 FPS,在提升检测精度的同时满足了实时性要求。

Pre-process algorithm for satellite laser ranging data based on curve recognition from points cloud

The satellite laser ranging （SLR） data quality from the COMPASS was analyzed, and the difference between curve recognition in computer vision and pre-process of SLR data finally proposed a new algorithm for SLR was discussed data based on curve recognition from points cloud is proposed. The results obtained by the new algorithm are 85 % （or even higher） consistent with that of the screen displaying method, furthermore, the new method can process SLR data automatically, which makes it possible to be used in the development of the COMPASS navigation system.

Filtering of Airborne Lidar Point Clouds for Complex Cityscapes

为激光雷达点云的一个新奇过滤算法被介绍，它能为复杂都市风景工作很好。没有以前的三角测量或 rasterization，它的主要特征基于未加工的激光雷达点云正在过滤。3D 在点之中的拓扑的关系被用来在断绝的顶寻找边点，它是关键信息认出赤裸的地球点和大楼点。实验结果证明建议算法能在赤裸的地球中保存不连续的特征并且没有尺寸的影响和大楼的形状。

改进PointNet++模型在道路杆状物提取中的应用

针对现有道路杆状物提取大多需要针对数据类型人工设计特征、泛用性差、自动化程度低等问题,本文提出一种基于改进PointNet++深度学习网络的道路杆状物语义分割方法,实现了对道路杆状物的提取。首先对原网络模型的感受野、分块大小等参数进行调整,使得该模型更适合道路点云数据;然后针对点云数据不平衡的问题,采用焦点损失函数作为模型的损失函数,使占比较少的类别得到充分训练;最后针对PointNet++网络提取特征时没有考虑邻域内各点特征影响关系的问题,采用邻域特征聚合模块融合邻域信息,提升该网络模型对点云特征的学习能力。为验证所提方法的有效性,使用改进后的网络模型在自建的道路点云组成的数据集上进行了试验,相对于经典PointNet++网络,杆状物类的分割精度明显提升,在简单道路和复杂道路上的交并比(IoU)分别提升了8.44%、15.25%,达到了98.88%、92.50%。

基于激光雷达扫描的料仓原料储料量测量方法

为提高仓内原料储料量测量自动化和智能化水平,设计了一种基于二维激光雷达扫描的储料量测量装置与系统。本系统采用RPLIDARS1型二维激光雷达扫描获取不同储料量物料的原始点云数据,通过坐标变换、重叠点提取、滤波、分割等方法对原始点云进行预处理,采用贪婪投影三角化算法将预处理后的点云进行三维重建,获得仓内原料的三维模型,结合物料三维模型和物料的容重获得仓内原料的储料量,从而实现储料量的自动测量。以玉米为试验对象,测量小型储料塔内玉米储料量并对玉米不同储料量进行扫描测量,验证模型的准确性,结果显示:测量结果的平均绝对误差为8.05kg,平均相对误差为1.52%。研究结果表明,基于二维激光雷达扫描的储料量测量方法是可行的,具有较好的稳定性和测量精度,能够满足实际生产需求。

隔震支座骨架板平面度检测及误差补偿

针对机械加工行业隔震支座骨架板平面度检测损伤表面并且不能多个连续检测的问题,提出一种基于激光传感器和振动误差补偿的非接触平面度检测系统。首先利用激光传感器对骨架板表面进行扫描,并通过滤波和精简算法来优化骨架板点云;然后将运动平台的偏移量写入每个点云坐标,形成精确的骨架板点云数据;最后将传统最小二乘法升维,计算各测量点到拟合平面的偏距值得到平面度。实验结果表明:系统能够有效检测骨架板的平面度,解决了传统检测效率低并且含振动误差的问题,能够更好地适应自动化检测环境。

多源点云优化的城市三维模型构建

简易模型与传统复杂的单体模型相比,对存储、可视化、传输和后续应用技术要求低,敏感信息承载量少,且能满足大部分应用需求,具有更高的应用价值。考虑应用需求与技术现状,自然资源部将城市三维模型(L0D1.3级)纳入实景三维中国建设任务中。目前相关生产以半自动化采集为主,工程化应用存在技术流程烦琐、效率较低且对数据量限制较大等问题。本文立足山东实际,提出了一种基于多源点云优化的城市三维模型快速构建技术,在充分利用现有数据基础上有效提升了数据处理效率,大幅减少了生产成本,并在实景三维山东建设过程中得到了有效验证,具有较好的社会经济效益与推广价值。

Study on the LAI Single Tree Model Based on Terrestrial Laser Scanning

Leaf area index (LAI) is a key parameter for studying global terrestrial ecology and environment and has great ecological significance. How to accurately measure and calculate structural parameters of trees has become an urgent matter. This paper reports the use of terrestrial laser scanning (TLS) as a measurement tool to achieve accurate LAI estimation through point cloud preprocessing measures, the LeWos algorithm, and voxel methods. The accuracy and feasibility of this indirect measurement method were explored. It is found that the single wood structure parameters extracted from TLS have a good linear relationship with manual measurement, and the extraction errors meet the requirements of real-scene conversion. The study also found when the voxel size is consistent with the minimum distance of the point cloud set by TLS instrument, it has a strong correlation with the measured value of canopy analyser. These results lay the foundation for conveniently and quickly obtaining structural parameters of trees, tree growth state detection, and canopy ecological benefit assessment.

点云加权迭代线拟合室内平面图自动生成方法

提出了一种基于三维激光点云加权迭代线拟合的室内平面图自动生成方法,根据线特征对三维点云沿高程方向的投影点云进行分割,采用加权迭代直线拟合方法进行分段直线拟合,并进一步对拟合直线进行融合和轮廓补全,实现室内平面图的自动生成。基于手持SLAM系统获取的典型室内场景激光点云自动生成室内平面图,结果表明,该方法能有效抑制室内点云噪声,结构提取完整性可达94.4%,制图精度优于3 cm,可快速生成室内平面结构图。

Research on 3D Laser Scanning Reconstruction of Ancient Buildings Combined with BIM Technology

After more than 30 years of scientific and social development, surveying and mapping technology by leaps and bounds, engineering surveying technology has undergone tremendous changes. In the process of protecting ancient buildings, it is necessary to obtain the precise dimensions of architectural details. In this study, the path of 3D laser scanning combined with BIM technology is explored. Taking the observation and protection of the ancestral hall of the Liu family as an example, this study aims to draw drawings that reflect the relevant information about the ancient buildings, the accurate three-dimensional model of ancient buildings is established with BIM technology, which provides new methods and ideas for the research and protection of ancient buildings. .

基于多线激光雷达的井下斜坡道无人矿卡定位与建图方法

井下斜坡道的定位与建图是实现井下斜坡道无人驾驶的关键技术之一,矿山井下斜坡道区域为典型非结构化环境特征,且道路具有一定倾斜角度,采用传统SLAM算法无法获得精确里程计信息,导致定位与建图精度难以满足无人矿卡行驶需求。针对上述问题,通过研究激光SLAM(Simultaneous Localization And Mapping)算法LeGO-LOAM,笔者提出一种适用于矿山井下斜坡道环境的定位与建图方法。首先,针对井下斜坡道口两侧均为光滑水泥墙壁,特征点稀少问题,设计了基于人工路标的辅助增强定位方法,有效增加点云特征数量,从而优化位姿估计结果,避免建图漂移现象;然后在特征预处理阶段,提出了一种基于激光点云高度差与坡度信息融合的提取地面点高效算法,通过改善地面地点的选取策略,针对倾斜坑洼路面仍能有效识别地面点,解决了井下斜坡道定位与建图倾斜角度大、误差大等问题;其次,基于CVC(Curved-Voxel Clustering)聚类算法设计了一种斜坡道点云曲率体素聚类算法,采用曲率体素和基于哈希的数据结构对点云进行分割,大幅提高在井下稀疏、噪声环境下点云聚类的鲁棒性;最后,运用Scan-To-Map进行点云匹配,同时兼顾点云配准的性能与速度。在中钢集团山东某井下斜坡道的现场实验证明:与原算法相比精度提升13.15%,Z轴误差降低22.3%,地图质量明显提升,能有效解决井下无人驾驶建图及定位的难题。

基于视觉图像与激光点云融合的交通标志快速识别方法

交通标志对车辆交通起到重要作用和意义,而智能交通中交通标志识别由于标志特征提取效果差,导致识别率低、识别时间长,因此,提出一种新的基于视觉图像与激光点云融合的交通标志快速识别方法。采用双边滤波方法预处理原始激光点云数据;通过归一化处理得到视觉图像激光点云融合的目标空间激光点云位置测距数值;通过测距值获取目标图像位置,归一化处理交通标志视觉图像,引入k均值聚类算法二聚类处理图像,采用制作的切割模板切割图像感兴趣区域,提取交通标志图像的深度特征,结合卷积神经网络二次过滤特征,重新标定二次过滤后的特征,最终利用卷积神经网络模型实现交通标志快速识别;经实验对比证明,采用所提方法提取各个类型交通标志特征的提取效果较好,并且识别率达到89.74%,识别时间仅为13.1 s,干扰下识别时间最高仅为15.1 s,验证了该方法可以快速且准确识别各个类型的交通标志。

一种基于激光点云数据的微距栅格体积算法

针对规则格网算法难以满足激光点云模型高精度体积计算的问题,提出了一种基于激光雷达点云数据的微距栅格体积算法。该方法首先运用葛立恒凸包算法提取凸包点集,然后运用微距格网划分、高程插值和网格体积累加的方法计算体积。与规则格网法不同,这种算法充分利用激光雷达数据高密度点云特征,采用格网微分和增大插值半径的方法改善模型表面的连续性,进而提高计算精度。实验结果表明,微距栅格体积算法具有较好的时间复杂度和较高的计算精度,适宜于激光点云模型高精度体积计算。

基于三维激光点云的地铁隧道特征提取方法研究

针对地铁隧道的结构化特点,为实现轨道及月台平面的自动化巡查,本文提出一种基于几何约束的轨道及平面点云特征快速提取方法。对于隧道激光点云,通过PCA估计的方法确定其点云主轴方向并将其矫正至水平;在此基础上利用直通滤波提取隧道横截面点云,通过RANSAC拟合构建横截面数学模型;然后计算截面上各点到拟合圆心的距离,依据点心距的变化提取候选轨道点与平面点;根据两组截面的特征点优化求解直线与平面方程,计算点线、点面距离,完成直线、平面的特征提取。研究结果表明,轨道检测精度较好,检测准确率高。

堆石坝压实密度快速检测方法的研究

提出了基于三维激光扫描、图像智能识别与小粒径骨料自动筛分机的堆石坝密度快速检测方法,旨在提高堆石坝检测精度和效率,保障水利工程安全。通过三维激光扫描获取堆石坝测坑表面的三维点云数据,实现测坑体积的快速计算;结合图像智能识别技术,实现对骨料粒径的自动测量;利用小粒径骨料自动筛分机对堆石坝中的骨料进行筛分和测量,定量评价压实状态。该方法具有快速、准确等优点,适用于大规模的堆石坝密度检测,达到了推动碾压施工自动化水平的效果。

基于激光点云技术的架空输电线路目标建模方法研究

文章研究基于架空输电线路三维激光点云数据,通过点云自动分类(杆塔、导地线、地面、植被等)实现不同地物提取,在此基础上建立不同塔型模型库并进行特征分析,实现杆塔和导地线的类别提取,并进行精准空间坐标(X、Y、H)提取,实现架空输电线路重要巡检对象的精准定位信息获取,并以此规划基于输电线路三维点云数据的架空输电线路全自动巡检航迹规划,为输电线路去人机全自动巡检技术的研究提供技术支撑。