Intelligent extraction of road cracks based on vehicle laser point cloud and panoramic sequence images

In light of the limited efficacy of conventional methods for identifying pavement cracks and the absence of comprehensive depth and location data in two-dimensional photographs,this study presents an intelligent strategy for extracting road cracks.This methodology involves the integration of laser point cloud data obtained from a vehicle-mounted system and a panoramic sequence of images.The study employs a vehicle-mounted LiDAR measurement system to acquire laser point cloud and panoramic sequence image data simultaneously.A convolutional neural network is utilized to extract cracks from the panoramic sequence image.The extracted sequence image is then aligned with the laser point cloud,enabling the assignment of RGB information to the vehicle-mounted three dimensional(3D)point cloud and location information to the two dimensional(2D)panoramic image.Additionally,a threshold value is set based on the crack elevation change to extract the aligned roadway point cloud.The three-dimensional data pertaining to the cracks can be acquired.The experimental findings demonstrate that the use of convolutional neural networks has yielded noteworthy outcomes in the extraction of road cracks.The utilization of point cloud and image alignment techniques enables the extraction of precise location data pertaining to road cracks.This approach exhibits superior accuracy when compared to conventional methods.Moreover,it facilitates rapid and accurate identification and localization of road cracks,thereby playing a crucial role in ensuring road maintenance and traffic safety.Consequently,this technique finds extensive application in the domains of intelligent transportation and urbanization development.The technology exhibits significant promise for use in the domains of intelligent transportation and city development.

Automatic Extraction of Urban Road Centerlines from High-Resolution Satellite Imagery Using Automatic Thresholding and Morphological Operation Method

The commercial high-resolution imaging satellite with 1 m spatial resolution IKONOS is an important data source of information for urban planning and geographical information system (GIS) applications. In this paper, a morphological method is proposed. The proposed method combines the automatic thresholding and morphological operation techniques to extract the road centerline of the urban environment. This method intends to solve urban road centerline problems, vehicle, vegetation, building etc. Based on this morphological method, an object extractor is designed to extract road networks from highly remote sensing images. Some filters are applied in this experiment such as line reconstruction and region filling techniques to connect the disconnected road segments and remove the small redundant. Finally, the thinning algorithm is used to extract the road centerline. Experiments have been conducted on a high-resolution IKONOS and QuickBird images showing the efficiency of the proposed method.

A Road Extraction Method for Remote Sensing Image Based on Encoder-Decoder Network

According to the characteristics of the road features,an Encoder-Decoder deep semantic segmentation network is designed for the road extraction of remote sensing images.Firstly,as the features of the road target are rich in local details and simple in semantic features,an Encoder-Decoder network with shallow layers and high resolution is designed to improve the ability to represent detail information.Secondly,as the road area is a small proportion in remote sensing images,the cross-entropy loss function is improved,which solves the imbalance between positive and negative samples in the training process.Experiments on large road extraction datasets show that the proposed method gets the recall rate 83.9%,precision 82.5%and F1-score 82.9%,which can extract the road targets in remote sensing images completely and accurately.The Encoder-Decoder network designed in this paper performs well in the road extraction task and needs less artificial participation,so it has a good application prospect.

Automatic Road Extraction Using Particle Filters from High Resolution Images

Road extraction plays an important role in many applications such as car navigation, but the manual extraction of roads is a laborious, tedious task. To speed the extraction of roads, an approach based on particle filtering to extract automatically roads from high resolution imagery is proposed. Particle filtering provides a statistical framework for propagating sample-based approximations of posterior distributions and has almost no restriction on the ingredients of the model. We integrate the similarity of grey value and the edge point distribution of roads into particle filtering to deal with complex scenes. To handle road appearance changes the tracking algorithm is allowed to update the road model during temporally stable image observations. A fully automatic initialization strategy is used. Experimental results show that the proposed approach is a promising and fully automatic method for extracting roads from images, even in the presence of occlusions.

An automatic method for road centerline extraction from post-earthquake aerial images

Road vector database plays an important role in post-earthquake relief, rescue and reconstruction.However, due to data privacy policy, it is difficult for general users to obtain high-precision and complete vector data of road network. The OpenStreetMap(OSM) project provides an open-source, global free road dataset, but there are inevitable geo-localization/projection errors, which will lead to large errors in hazard survey analysis. In this paper, we proposed a road centerline correction method using postearthquake aerial images. Under the constraint of the vector road map(OpenStreetMap), we rectified the centerline by the context feature and spectral gradient feature of post-event images automatically.The experiment implemented on 0.5 m/pixel post-event aerial images of Haiti, 2010, showed that the completeness and extraction quality of proposed method were over 90% and 80% without any manual intervention.

A Road Extraction Method Based on Region Growing and Mathematical Morphology from Remote Sensing Images

Road traffic is the important driving factor for economic and social development. With the rapid increase of vehicle population, road traffic problems such as traffic jam and traffic accident have become the bottleneck which restricts economic development. In recent years, natural disasters frequently occur in China. Therefore, it is essential to extract road information to compute the degree of road damage for traffic emergency management. A road extraction method based on region growing and mathematical morphology from remote sensing images is proposed in this paper. According to the road features, the remote sensing image is preprocessed to separate road regions from non-road regions preliminarily. After image thresholding, region growing algorithm is used to extract connected regions. Then we sort connected regions by area to exclude the small regions which are probably non-road objects. Finally, the mathematical morphology algorithm is used to fill the holes inside the road regions. The experimental results show that the method proposed can effectively extract roads from remote sensing images. This research also has broad prospects in dealing with traffic emergency management by the government.

Road network extraction from high resolution satellite images

In this paper, an approach of roads network extraction from high resolution satellite images is presented. First, the approach extracts road surface from satellite image using one-class support vector machine （SVM）. Second, the road topology is built from the road surface. The last output of the approach is a series of road segments which is represented by a sequence of points as well as the topological relations among them. The approach includes four steps. In the first step one-class support vector machine is used for classifying pixel of the satellite images to road class or non-road class. In the second step filling holes and connecting gaps for the SVM＇s classification result is applied through mathematical morphology close operation. In the third step the road segment is extracted by a series of operations which include skeletonization, thin, branch pruning and road segmentation. In the last step a geometrical adjustment process is applied through analyzing the road segment curvature. The experiment results demonstrate its robustness and viability on extracting road network from high resolution satellite images.

Application of PDE and Mathematical Morphology in the Extraction Validation of the Roads

The digital images generated by remote sensors often contain noises that are inherent in the process of imaging and transmission. The application of digital processing techniques greatly enhances the ability to extract information on surface targets from remote sensing data. When digital images are used with high spatial resolution, one of the problems emerging the high variability of targets presents in such images. From the computational point of view, the use of partial differential equations is favored by the large number of numerical methods showed in the literature. Many of the models are considered non-complex both from the mathematical and computational standpoints, due to the characteristics of explicit equations. This work uses techniques of the partial differential equations (PDE) and mathematical morphology to extract cartographic features in digital images of the remote sensing. The selected study area corresponds to an image containing part of the Mário Covas Ring Road, located in the metropolitan region of Sao Paulo (SP), Brazil. The results are promising and show the high potential of using mathematical morphology in the field of cartography.

Road network extraction in classified SAR images using genetic algorithm

Due to the complicated background of objectives and speckle noise, it is almost impossible to extract roads directly from original synthetic aperture radar(SAR) images. A method is proposed for extraction of road network from high-resolution SAR image. Firstly, fuzzy C means is used to classify the filtered SAR image unsupervisedly, and the road pixels are isolated from the image to simplify the extraction of road network. Secondly, according to the features of roads and the membership of pixels to roads, a road model is constructed, which can reduce the extraction of road network to searching globally optimization continuous curves which pass some seed points. Finally, regarding the curves as individuals and coding a chromosome using integer code of variance relative to coordinates, the genetic operations are used to search global optimization roads. The experimental results show that the algorithm can effectively extract road network from high-resolution SAR images.

A Review on Extraction of Lakes from Remotely Sensed Optical Satellite Data with a Special Focus on Cryospheric Lakes

Water on the Earth’s surface is an essential part of the hydrological cycle. Water resources include surface waters, groundwater, lakes, inland waters, rivers, coastal waters, and aquifers. Monitoring lake dynamics is critical to favor sustainable management of water resources on Earth. In cryosphere, lake ice cover is a robust indicator of local climate variability and change. Therefore, it is necessary to review recent methods, technologies, and satellite sensors employed for the extraction of lakes from satellite imagery. The present review focuses on the comprehensive evaluation of existing methods for extraction of lake or water body features from remotely sensed optical data. We summarize pixel-based, object-based, hybrid, spectral index based, target and spectral matching methods employed in extracting lake features in urban and cryospheric environments. To our knowledge, almost all of the published research studies on the extraction of surface lakes in cryospheric environments have essentially used satellite remote sensing data and geospatial methods. Satellite sensors of varying spatial, temporal and spectral resolutions have been used to extract and analyze the information regarding surface water. Multispectral remote sensing has been widely utilized in cryospheric studies and has employed a variety of electro-optical satellite sensor systems for characterization and extraction of various cryospheric features, such as glaciers, sea ice, lakes and rivers, the extent of snow and ice, and icebergs. It is apparent that the most common methods for extracting water bodies use single band-based threshold methods, spectral index ratio (SIR)-based multiband methods, image segmentation methods, spectral-matching methods, and target detection methods (unsupervised, supervised and hybrid). A Synergetic fusion of various remote sensing methods is also proposed to improve water information extraction accuracies. The methods developed so far are not generic rather they are specific to either the location or satellite imagery or to the type of the feature to be extracted. Lots of factors are responsible for leading to inaccurate results of lake-feature extraction in cryospheric regions, e.g. the mountain shadow which also appears as a dark pixel is often misclassified as an open lake. The methods which are working well in the cryospheric environment for feature extraction or landcover classification does not really guarantee that they will be working in the same manner for the urban environment. Thus, in coming years, it is expected that much of the work will be done on object-based approach or hybrid approach involving both pixel as well as object-based technology. A more accurate, versatile and robust method is necessary to be developed that would work independent of geographical location (for both urban and cryosphere) and type of optical sensor.

Extracting Campus’Road Network from Walking GPS Trajectories

Road network extraction is vital to both vehicle navigation and road planning.Existing approaches focus on mining urban trunk roads from GPS trajectories of floating cars.However,path extraction,which plays an important role in earthquake relief and village tour,is always ignored.Addressing this issue,we propose a novel approach of extracting campus’road network from walking GPS trajectories.It consists of data preprocessing and road centerline generation.The patrolling GPS trajectories,collected at Hunan University of Science and Technology,were used as the experimental data.The experimental evaluation results show that our approach is able to effectively and accurately extract both campus’trunk roads and paths.The coverage rate is 96.21%while the error rate is 3.26%.

Weakly Supervised Network with Scribble-Supervised and Edge-Mask for Road Extraction from High-Resolution Remote Sensing Images

Significant advancements have been achieved in road surface extraction based on high-resolution remote sensingimage processing. Most current methods rely on fully supervised learning, which necessitates enormous humaneffort to label the image. Within this field, other research endeavors utilize weakly supervised methods. Theseapproaches aim to reduce the expenses associated with annotation by leveraging sparsely annotated data, such asscribbles. This paper presents a novel technique called a weakly supervised network using scribble-supervised andedge-mask (WSSE-net). This network is a three-branch network architecture, whereby each branch is equippedwith a distinct decoder module dedicated to road extraction tasks. One of the branches is dedicated to generatingedge masks using edge detection algorithms and optimizing road edge details. The other two branches supervise themodel’s training by employing scribble labels and spreading scribble information throughout the image. To addressthe historical flaw that created pseudo-labels that are not updated with network training, we use mixup to blendprediction results dynamically and continually update new pseudo-labels to steer network training. Our solutiondemonstrates efficient operation by simultaneously considering both edge-mask aid and dynamic pseudo-labelsupport. The studies are conducted on three separate road datasets, which consist primarily of high-resolutionremote-sensing satellite photos and drone images. The experimental findings suggest that our methodologyperforms better than advanced scribble-supervised approaches and specific traditional fully supervised methods.

GCN引导模型视点的光学遥感道路提取网络

在光学遥感图像中,道路易受遮挡物、铺装材料以及周围环境等多重因素的影响,导致其特征模糊不清。然而,现有道路提取方法即使增强其特征感知能力,仍在特征模糊区域存在大量误判。为解决上述问题,本文提出基于GCN引导模型视点的道路提取网络(RGGVNet)。RGGVNet采用编解码结构,并设计基于GCN的视点引导模块(GVPG)在编解码器的连接处反复引导模型视点,从而增强对特征模糊区域的关注。GVPG利用GCN信息传播过程具有平均特征权重的特性,将特征图中不同区域道路显著性水平作为拉普拉斯矩阵,参与到GCN信息传播从而实现引导模型视点。同时,提出密集引导视点策略(DGVS),采用密集连接的方式将编码器、GVPG和解码器相互连接,确保有效引导模型视点的同时缓解优化困难。在解码阶段设计多分辨率特征融合(MRFF)模块,最小化不同尺度道路特征在特征融合和上采样过程中的信息偏移和损失。在两个公开遥感道路数据集中,本文方法IoU分别达到65.84%和69.36%,F1-score分别达到79.40%和81.90%。从定量和定性两方面实验结果可以看出,本文所提方法性能优于其他主流方法。

基于L-DeepLabv3+的轻量化光学遥感图像道路提取

针对DeepLabv3+在进行光学遥感图像道路提取任务时,存在模型参数量大、细节提取效果差等问题,提出一种改进DeepLabv3+的轻量化道路提取模型L-DeepLabv3+。首先通过将主干网络替换为MobileNetv2来减少模型参数量;其次,在编码层中设计一个改进的空洞空间卷积池化金字塔模块。该模块通过嵌入一个通道空间并联注意力模块和YOLOF模块来增强模型特征表达能力,并且将普通卷积替换为深度可分离卷积进一步减少模型参数量;最后组合采用Dice_loss和Focal_loss作为损失函数来解决正负样本不均衡问题。实验结果表明:L-DeepLabv3+在DeepGlobe Road数据集上进行道路提取的交并比达到68.40%,像素准确率达到82.67%,且模型参数量仅为5.63 MB,FPS达到72.3,与其他模型相比具有明显提升,实现了模型精度与轻量化之间更好的平衡。

融合双域特征均衡的遥感图像道路提取

当前遥感图像道路提取模型仍在很大程度上受道路植被遮挡所影响,导致网络模型对道路信息误判。为此,基于双域特征均衡提出了一种不受遮挡物影响的道路提取方法,高效地实现植被遮挡下的道路提取。具体而言,提出了一种新的道路提取卷积神经网络,该网络由去除遮挡子网络和道路提取子网络组成。在去除遮挡子网络中嵌入一个分层卷积模块用于提取输入图像的深层结构特征和浅层纹理特征,以及双域均衡模块用于特征还原,以此去除目标道路上的遮挡物。道路提取子网络用于对去除遮挡后的道路结构进行精细的分割,得到准确性更高的道路提取结果。通过在四川西南农村地区的遥感数据集上进行大量实验,结果显示基于双域特征均衡的方法相较于其他遥感图像道路提取方法在像素精确度(Overall Accuracy, OA)和交并比(Intersection over Union, IoU)指标上达到了最高,分别是98.16%和85.38%。

结合融合策略的光学影像道路提取技术

成像系统获取数据时一般无法兼顾空间和光谱信息,但当前的光学影像道路提取往往直接以融合后影像为数据源,聚焦网络结构、监督形式等方面的研究,未对融合效果在道路提取中的作用进行深入探索与分析。因此,本文提出了一种结合融合策略的光学影像道路提取技术。首先,以端到端的“编码—解码”网络为基本结构,并结合输入数据的类别、数量等因素进行针对性改进与设计,为后续的试验验证提供训练和测试框架;然后,立足空间信息和光谱信息的注入偏好,选取4种典型的影像融合方法,并以此为技术支持对全色影像和多光谱影像进行融合;最后,在试验部分借助2个公开数据进行了集验证,得出融合策略在道路提取中可有效提升量化评价指标的结论,同时对典型的道路重难点区域提取具有积极的正向促进作用。

融合注意力和扩张卷积的遥感影像道路信息提取方法

针对高分辨率遥感影像语义分割存在地物边缘分割不连续、道路及背景特征复杂多样导致道路提取分割精度不高的问题,提出了一种融合双通道注意力和扩张卷积的遥感影像道路信息提取语义分割网络(A 2DU-Net)。首先,在特征提取部分引入坐标注意力(coordinate attention,CA)模块,捕捉道路位置、方向和跨通道信息,精确定位道路信息。其次,针对网络对细节特征丢失的敏感问题,在编码器的末端利用不同扩张率的空洞卷积构建多尺度特征融合的空洞空间金字塔池化模块(multi-scale Atrous spatial pyramid pooling module,MASPPM)来获得更大的感受野,提高网络性能。最后,为了避免U-Net中纯跳跃连接在语义上不相似特征的融合,在编码器和解码器的跳跃连接之间增加了双通道注意力机制来实现门控筛选,抑制非目标区域的特征,提高网络的分割精度。实验在公共道路数据集Massachusetts上对网络模型进行测试,OA(准确率)、交并比(IoU)、平均交并比(mIoU)和F1等评价指标分别达到98.07%、64.39%、81.20%和88.67%。与主流方法U-Net和DDUNet进行比较,mIoU分别提升了3.07%、0.22%,IoU分别提升了1.98%、0.52%。实验结果表明,所提出的方法优于所有的比较方法,能够有效提高道路分割的精确度。

基于车载点云的道路三维实景建模方法研究

传统的基础测绘存在组织管理固化、服务模式落后、产品形式单一等问题,在新型基础测绘体系下形成了全要素三维实景模型这一成果。本文探讨基于车载点云进行城市道路三维实景建模方法研究,并以某城市主干路为试验对象,对道路及道路两侧部件点云数据进行矢量化得到道路全要素地形数据,以部件点云数据为参考结合外业调绘尺寸用3ds Max软件制作道路部件模板库,并结合点云数据和矢量数据对各类要素进行单体化,最后将道路模型和部件模型融合。结果表明,基于车载点云数据构建的城市道路全要素实景模型不仅可以保证场景的完整性和真实性,还减少了作业时间和成本,实现了各类模型之间的无缝结合,制作完成的模型精度也能满足项目精度要求。