Intelligent extraction of road cracks based on vehicle laser point cloud and panoramic sequence images

In light of the limited efficacy of conventional methods for identifying pavement cracks and the absence of comprehensive depth and location data in two-dimensional photographs,this study presents an intelligent strategy for extracting road cracks.This methodology involves the integration of laser point cloud data obtained from a vehicle-mounted system and a panoramic sequence of images.The study employs a vehicle-mounted LiDAR measurement system to acquire laser point cloud and panoramic sequence image data simultaneously.A convolutional neural network is utilized to extract cracks from the panoramic sequence image.The extracted sequence image is then aligned with the laser point cloud,enabling the assignment of RGB information to the vehicle-mounted three dimensional(3D)point cloud and location information to the two dimensional(2D)panoramic image.Additionally,a threshold value is set based on the crack elevation change to extract the aligned roadway point cloud.The three-dimensional data pertaining to the cracks can be acquired.The experimental findings demonstrate that the use of convolutional neural networks has yielded noteworthy outcomes in the extraction of road cracks.The utilization of point cloud and image alignment techniques enables the extraction of precise location data pertaining to road cracks.This approach exhibits superior accuracy when compared to conventional methods.Moreover,it facilitates rapid and accurate identification and localization of road cracks,thereby playing a crucial role in ensuring road maintenance and traffic safety.Consequently,this technique finds extensive application in the domains of intelligent transportation and urbanization development.The technology exhibits significant promise for use in the domains of intelligent transportation and city development.

Intelligent Segmentation and Measurement Model for Asphalt Road Cracks Based on Modified Mask R-CNN Algorithm

Nowadays, asphalt road has dominated highways around the world. Among various defects of asphalt road, crackshave been paid more attention, since cracks often cause major engineering and personnel safety incidents. Currentmanual crack inspection methods are time-consuming and labor-intensive, and most segmentation methods cannot detect cracks at the pixel level. This paper proposes an intelligent segmentation and measurement model basedon the modified Mask R-CNN algorithm to automatically and accurately detect asphalt road cracks. The modelproposed in this paper mainly includes a convolutional neural network (CNN), an optimized region proposalnetwork (RPN), a region of interest (RoI) Align layer, a candidate area classification network and a Mask branch offully convolutional network (FCN). The ratio and size of anchors in the RPN are adjusted to improve the accuracyand efficiency of segmentation. Soft non-maximum suppression (Soft-NMS) algorithm is developed to improvethe segmentation accuracy. A dataset including 8,689 images (512× 512 pixels) of asphalt cracks is established andthe road crack is manually marked. Transfer learning is used to initialize the model parameters in the trainingprocess. To optimize the model training parameters, multiple comparison experiments are performed, and the testresults show that the mean average precision (mAP) value and F1-score of the optimal trained model are 0.952 and0.949. Subsequently, the robustness verification test and comparative test of the trained model are conducted andthe topological features of the crack are extracted. Then, the damage area, length and average width of the crackare measured automatically and accurately at pixel level. More importantly, this paper develops an automatic crackdetection platform for asphalt roads to automatically extract the number, area, length and average width of cracks,which can significantly improve the crack detection efficiency for the road maintenance industry.

Deep Learning Method to Detect the Road Cracks and Potholes for Smart Cities

The increasing global population at a rapid pace makes road trafficdense;managing such massive traffic is challenging. In developing countrieslike Pakistan, road traffic accidents (RTA) have the highest mortality percentageamong other Asian countries. The main reasons for RTAs are roadcracks and potholes. Understanding the need for an automated system forthe detection of cracks and potholes, this study proposes a decision supportsystem (DSS) for an autonomous road information system for smart citydevelopment with the use of deep learning. The proposed DSS works in layerswhere initially the image of roads is captured and coordinates attached to theimage with the help of global positioning system (GPS), communicated tothe decision layer to find about the cracks and potholes in the roads, andeventually, that information is passed to the road management informationsystem, which gives information to drivers and the maintenance department.For the decision layer, we projected a CNN-based model for pothole crackdetection (PCD). Aimed at training, a K-fold cross-validation strategy wasused where the value of K was set to 10. The training of PCD was completedwith a self-collected dataset consisting of 6000 images from Pakistani roads.The proposed PCD achieved 98% of precision, 97% recall, and accuracy whiletesting on unseen images. The results produced by our model are higher thanthe existing model in terms of performance and computational cost, whichproves its significance.

Automatic Road Tunnel Crack Inspection Based on Crack Area Sensing and Multiscale Semantic Segmentation

The detection of crack defects on the walls of road tunnels is a crucial step in the process of ensuring travel safetyand performing routine tunnel maintenance. The automatic and accurate detection of cracks on the surface of roadtunnels is the key to improving the maintenance efficiency of road tunnels. Machine vision technology combinedwith a deep neural network model is an effective means to realize the localization and identification of crackdefects on the surface of road tunnels.We propose a complete set of automatic inspection methods for identifyingcracks on the walls of road tunnels as a solution to the problem of difficulty in identifying cracks during manualmaintenance. First, a set of equipment applied to the real-time acquisition of high-definition images of walls inroad tunnels is designed. Images of walls in road tunnels are acquired based on the designed equipment, whereimages containing crack defects are manually identified and selected. Subsequently, the training and validationsets used to construct the crack inspection model are obtained based on the acquired images, whereas the regionscontaining cracks and the pixels of the cracks are finely labeled. After that, a crack area sensing module is designedbased on the proposed you only look once version 7 model combined with coordinate attention mechanism (CAYOLOV7) network to locate the crack regions in the road tunnel surface images. Only subimages containingcracks are acquired and sent to the multiscale semantic segmentation module for extraction of the pixels to whichthe cracks belong based on the DeepLab V3+ network. The precision and recall of the crack region localizationon the surface of a road tunnel based on our proposed method are 82.4% and 93.8%, respectively. Moreover, themean intersection over union (MIoU) and pixel accuracy (PA) values for achieving pixel-level detection accuracyare 76.84% and 78.29%, respectively. The experimental results on the dataset show that our proposed two-stagedetection method outperforms other state-of-the-art models in crack region localization and detection. Based onour proposedmethod, the images captured on the surface of a road tunnel can complete crack detection at a speed often frames/second, and the detection accuracy can reach 0.25 mm, which meets the requirements for maintenanceof an actual project. The designed CA-YOLO V7 network enables precise localization of the area to which a crackbelongs in images acquired under different environmental and lighting conditions in road tunnels. The improvedDeepLab V3+ network based on lightweighting is able to extract crack morphology in a given region more quicklywhile maintaining segmentation accuracy. The established model combines defect localization and segmentationmodels for the first time, realizing pixel-level defect localization and extraction on the surface of road tunnelsin complex environments, and is capable of determining the actual size of cracks based on the physical coordinatesystemafter camera calibration. The trainedmodelhas highaccuracy andcanbe extendedandapplied to embeddedcomputing devices for the assessment and repair of damaged areas in different types of road tunnels.

Research on Infrared Image Fusion Technology Based on Road Crack Detection

This study aimed to propose road crack detection method based on infrared image fusion technology.By analyzing the characteristics of road crack images,this method uses a variety of infrared image fusion methods to process different types of images.The use of this method allows the detection of road cracks,which not only reduces the professional requirements for inspectors,but also improves the accuracy of road crack detection.Based on infrared image processing technology,on the basis of in-depth analysis of infrared image features,a road crack detection method is proposed,which can accurately identify the road crack location,direction,length,and other characteristic information.Experiments showed that this method has a good effect,and can meet the requirement of road crack detection.