Significant advancements have been achieved in road surface extraction based on high-resolution remote sensingimage processing. Most current methods rely on fully supervised learning, which necessitates enormous human...Significant advancements have been achieved in road surface extraction based on high-resolution remote sensingimage processing. Most current methods rely on fully supervised learning, which necessitates enormous humaneffort to label the image. Within this field, other research endeavors utilize weakly supervised methods. Theseapproaches aim to reduce the expenses associated with annotation by leveraging sparsely annotated data, such asscribbles. This paper presents a novel technique called a weakly supervised network using scribble-supervised andedge-mask (WSSE-net). This network is a three-branch network architecture, whereby each branch is equippedwith a distinct decoder module dedicated to road extraction tasks. One of the branches is dedicated to generatingedge masks using edge detection algorithms and optimizing road edge details. The other two branches supervise themodel’s training by employing scribble labels and spreading scribble information throughout the image. To addressthe historical flaw that created pseudo-labels that are not updated with network training, we use mixup to blendprediction results dynamically and continually update new pseudo-labels to steer network training. Our solutiondemonstrates efficient operation by simultaneously considering both edge-mask aid and dynamic pseudo-labelsupport. The studies are conducted on three separate road datasets, which consist primarily of high-resolutionremote-sensing satellite photos and drone images. The experimental findings suggest that our methodologyperforms better than advanced scribble-supervised approaches and specific traditional fully supervised methods.展开更多
According to the characteristics of the road features,an Encoder-Decoder deep semantic segmentation network is designed for the road extraction of remote sensing images.Firstly,as the features of the road target are r...According to the characteristics of the road features,an Encoder-Decoder deep semantic segmentation network is designed for the road extraction of remote sensing images.Firstly,as the features of the road target are rich in local details and simple in semantic features,an Encoder-Decoder network with shallow layers and high resolution is designed to improve the ability to represent detail information.Secondly,as the road area is a small proportion in remote sensing images,the cross-entropy loss function is improved,which solves the imbalance between positive and negative samples in the training process.Experiments on large road extraction datasets show that the proposed method gets the recall rate 83.9%,precision 82.5%and F1-score 82.9%,which can extract the road targets in remote sensing images completely and accurately.The Encoder-Decoder network designed in this paper performs well in the road extraction task and needs less artificial participation,so it has a good application prospect.展开更多
In light of the limited efficacy of conventional methods for identifying pavement cracks and the absence of comprehensive depth and location data in two-dimensional photographs,this study presents an intelligent strat...In light of the limited efficacy of conventional methods for identifying pavement cracks and the absence of comprehensive depth and location data in two-dimensional photographs,this study presents an intelligent strategy for extracting road cracks.This methodology involves the integration of laser point cloud data obtained from a vehicle-mounted system and a panoramic sequence of images.The study employs a vehicle-mounted LiDAR measurement system to acquire laser point cloud and panoramic sequence image data simultaneously.A convolutional neural network is utilized to extract cracks from the panoramic sequence image.The extracted sequence image is then aligned with the laser point cloud,enabling the assignment of RGB information to the vehicle-mounted three dimensional(3D)point cloud and location information to the two dimensional(2D)panoramic image.Additionally,a threshold value is set based on the crack elevation change to extract the aligned roadway point cloud.The three-dimensional data pertaining to the cracks can be acquired.The experimental findings demonstrate that the use of convolutional neural networks has yielded noteworthy outcomes in the extraction of road cracks.The utilization of point cloud and image alignment techniques enables the extraction of precise location data pertaining to road cracks.This approach exhibits superior accuracy when compared to conventional methods.Moreover,it facilitates rapid and accurate identification and localization of road cracks,thereby playing a crucial role in ensuring road maintenance and traffic safety.Consequently,this technique finds extensive application in the domains of intelligent transportation and urbanization development.The technology exhibits significant promise for use in the domains of intelligent transportation and city development.展开更多
As a significant role for traffic management, city planning, road monitoring, GPS navigation and map updating, the technology of road extraction from a remote sensing (RS) image has been a hot research topic in rece...As a significant role for traffic management, city planning, road monitoring, GPS navigation and map updating, the technology of road extraction from a remote sensing (RS) image has been a hot research topic in recent years. In this paper, after analyzing different road features and road models, the road extraction methods were classified into the classification-based methods, knowledge-based methods, mathematical morphology, active contour model, and dynamic programming. Firstly, the road features, road model, existing difficulties and interference factors for road extraction were analyzed. Secondly, the principle of road extraction, the advantages and disadvantages of various methods and research achievements were briefly highlighted. Then, the comparisons of the different road extraction algorithms were performed, including road features, test samples and shortcomings. Finally, the research results in recent years were summarized emphatically. It is obvious that only using one kind of road features is hard to get an excellent extraction effect. Hence, in order to get good results, the road extraction should combine multiple methods according to the real applications. In the future, how to realize the complete road extraction from a RS image is still an essential but challenging and important research topic.展开更多
In this paper, an approach of roads network extraction from high resolution satellite images is presented. First, the approach extracts road surface from satellite image using one-class support vector machine (SVM)....In this paper, an approach of roads network extraction from high resolution satellite images is presented. First, the approach extracts road surface from satellite image using one-class support vector machine (SVM). Second, the road topology is built from the road surface. The last output of the approach is a series of road segments which is represented by a sequence of points as well as the topological relations among them. The approach includes four steps. In the first step one-class support vector machine is used for classifying pixel of the satellite images to road class or non-road class. In the second step filling holes and connecting gaps for the SVM's classification result is applied through mathematical morphology close operation. In the third step the road segment is extracted by a series of operations which include skeletonization, thin, branch pruning and road segmentation. In the last step a geometrical adjustment process is applied through analyzing the road segment curvature. The experiment results demonstrate its robustness and viability on extracting road network from high resolution satellite images.展开更多
The commercial high-resolution imaging satellite with 1 m spatial resolution IKONOS is an important data source of information for urban planning and geographical information system (GIS) applications. In this paper, ...The commercial high-resolution imaging satellite with 1 m spatial resolution IKONOS is an important data source of information for urban planning and geographical information system (GIS) applications. In this paper, a morphological method is proposed. The proposed method combines the automatic thresholding and morphological operation techniques to extract the road centerline of the urban environment. This method intends to solve urban road centerline problems, vehicle, vegetation, building etc. Based on this morphological method, an object extractor is designed to extract road networks from highly remote sensing images. Some filters are applied in this experiment such as line reconstruction and region filling techniques to connect the disconnected road segments and remove the small redundant. Finally, the thinning algorithm is used to extract the road centerline. Experiments have been conducted on a high-resolution IKONOS and QuickBird images showing the efficiency of the proposed method.展开更多
Road network extraction is vital to both vehicle navigation and road planning.Existing approaches focus on mining urban trunk roads from GPS trajectories of floating cars.However,path extraction,which plays an importa...Road network extraction is vital to both vehicle navigation and road planning.Existing approaches focus on mining urban trunk roads from GPS trajectories of floating cars.However,path extraction,which plays an important role in earthquake relief and village tour,is always ignored.Addressing this issue,we propose a novel approach of extracting campus’road network from walking GPS trajectories.It consists of data preprocessing and road centerline generation.The patrolling GPS trajectories,collected at Hunan University of Science and Technology,were used as the experimental data.The experimental evaluation results show that our approach is able to effectively and accurately extract both campus’trunk roads and paths.The coverage rate is 96.21%while the error rate is 3.26%.展开更多
The application of autonomous agricultural vehicles is gaining popularity as a way to increase production efficiency and lower operational costs.To achieve high performance,perception tasks(such as obstacle detection,...The application of autonomous agricultural vehicles is gaining popularity as a way to increase production efficiency and lower operational costs.To achieve high performance,perception tasks(such as obstacle detection,road extraction,and drivable area extraction)are of great importance.Compared with structured roads,field roads between farmlands,including unstructured roads and semi-structured roads,are unfavorable for autonomous agricultural vehicle driving due to their bumpiness and unstructured nature.This study proposed an extraction method for the straight field roads between farmlands.The proposed method was based on the point cloud data acquired by LiDAR(Velodyne VLP-16)mounted on a John Deere 12046B-1204 tractor.The proposed method has three aspects:Euclidean Clustering-based extraction,boundary-based extraction,and road point cloud curve segment modification.Firstly,Euclidean Clustering with K-Dimensional(KD)-Tree data structure was adopted to extract the road curve segments close to the LiDAR composed of road points.Secondly,the boundary lines constraint was constructed to extract the distant road curve segments.Thirdly,the local distance ratio was used to modify the extracted road curve segments.The average extraction accuracy for both semi-structured and unstructured roads exceeded 98%,and the false positive rate(FPR)was less than 0.5%.These experimental findings demonstrated that the proposed road extraction method was precise and effective.The proposed method of this study can be applied to enhance the perception ability of autonomous agricultural vehicles thereby increasing the efficiency and safety of field road driving.展开更多
Vehicles have been increasingly equipped with GPS receivers to record their trajectories,which we call floating car data.Compared with other data sources,these data are characterized by low cost,wide coverage,and rapi...Vehicles have been increasingly equipped with GPS receivers to record their trajectories,which we call floating car data.Compared with other data sources,these data are characterized by low cost,wide coverage,and rapid updating.The data have become an important source for road network extraction.In this paper,we propose a novel approach for mining road networks from floating car data.First,a Gaussian model is used to transform the data into bitmap,and the Otsu algorithm is utilized to detect road intersections.Then,a clothoid-based method is used to resample the GPS points to improve the clustering accuracy,and the data are clustered based on a distance-direction algorithm.Last,road centerlines are extracted with a weighted least squares algorithm.We report on experiments that were conducted on floating car data from Wuhan,China.To conclude,existing methods are compared with our method to prove that the proposed method is practical and effective.展开更多
基金the National Natural Science Foundation of China(42001408,61806097).
文摘Significant advancements have been achieved in road surface extraction based on high-resolution remote sensingimage processing. Most current methods rely on fully supervised learning, which necessitates enormous humaneffort to label the image. Within this field, other research endeavors utilize weakly supervised methods. Theseapproaches aim to reduce the expenses associated with annotation by leveraging sparsely annotated data, such asscribbles. This paper presents a novel technique called a weakly supervised network using scribble-supervised andedge-mask (WSSE-net). This network is a three-branch network architecture, whereby each branch is equippedwith a distinct decoder module dedicated to road extraction tasks. One of the branches is dedicated to generatingedge masks using edge detection algorithms and optimizing road edge details. The other two branches supervise themodel’s training by employing scribble labels and spreading scribble information throughout the image. To addressthe historical flaw that created pseudo-labels that are not updated with network training, we use mixup to blendprediction results dynamically and continually update new pseudo-labels to steer network training. Our solutiondemonstrates efficient operation by simultaneously considering both edge-mask aid and dynamic pseudo-labelsupport. The studies are conducted on three separate road datasets, which consist primarily of high-resolutionremote-sensing satellite photos and drone images. The experimental findings suggest that our methodologyperforms better than advanced scribble-supervised approaches and specific traditional fully supervised methods.
基金National Natural Science Foundation of China(Nos.61673017,61403398)and Natural Science Foundation of Shaanxi Province(Nos.2017JM6077,2018ZDXM-GY-039)。
文摘According to the characteristics of the road features,an Encoder-Decoder deep semantic segmentation network is designed for the road extraction of remote sensing images.Firstly,as the features of the road target are rich in local details and simple in semantic features,an Encoder-Decoder network with shallow layers and high resolution is designed to improve the ability to represent detail information.Secondly,as the road area is a small proportion in remote sensing images,the cross-entropy loss function is improved,which solves the imbalance between positive and negative samples in the training process.Experiments on large road extraction datasets show that the proposed method gets the recall rate 83.9%,precision 82.5%and F1-score 82.9%,which can extract the road targets in remote sensing images completely and accurately.The Encoder-Decoder network designed in this paper performs well in the road extraction task and needs less artificial participation,so it has a good application prospect.
基金founded by National Key R&D Program of China (No.2021YFB2601200)National Natural Science Foundation of China (No.42171416)Teacher Support Program for Pyramid Talent Training Project of Beijing University of Civil Engineering and Architecture (No.JDJQ20200307).
文摘In light of the limited efficacy of conventional methods for identifying pavement cracks and the absence of comprehensive depth and location data in two-dimensional photographs,this study presents an intelligent strategy for extracting road cracks.This methodology involves the integration of laser point cloud data obtained from a vehicle-mounted system and a panoramic sequence of images.The study employs a vehicle-mounted LiDAR measurement system to acquire laser point cloud and panoramic sequence image data simultaneously.A convolutional neural network is utilized to extract cracks from the panoramic sequence image.The extracted sequence image is then aligned with the laser point cloud,enabling the assignment of RGB information to the vehicle-mounted three dimensional(3D)point cloud and location information to the two dimensional(2D)panoramic image.Additionally,a threshold value is set based on the crack elevation change to extract the aligned roadway point cloud.The three-dimensional data pertaining to the cracks can be acquired.The experimental findings demonstrate that the use of convolutional neural networks has yielded noteworthy outcomes in the extraction of road cracks.The utilization of point cloud and image alignment techniques enables the extraction of precise location data pertaining to road cracks.This approach exhibits superior accuracy when compared to conventional methods.Moreover,it facilitates rapid and accurate identification and localization of road cracks,thereby playing a crucial role in ensuring road maintenance and traffic safety.Consequently,this technique finds extensive application in the domains of intelligent transportation and urbanization development.The technology exhibits significant promise for use in the domains of intelligent transportation and city development.
基金financially supported by the Special Fund for Basic Scientific Research of Central Colleges(No.2013G2241019)Shaanxi Province Science and Technology Fund(No.2013KW03)Xi'an City Science and Technology Fund(No.CX1252(8))
文摘As a significant role for traffic management, city planning, road monitoring, GPS navigation and map updating, the technology of road extraction from a remote sensing (RS) image has been a hot research topic in recent years. In this paper, after analyzing different road features and road models, the road extraction methods were classified into the classification-based methods, knowledge-based methods, mathematical morphology, active contour model, and dynamic programming. Firstly, the road features, road model, existing difficulties and interference factors for road extraction were analyzed. Secondly, the principle of road extraction, the advantages and disadvantages of various methods and research achievements were briefly highlighted. Then, the comparisons of the different road extraction algorithms were performed, including road features, test samples and shortcomings. Finally, the research results in recent years were summarized emphatically. It is obvious that only using one kind of road features is hard to get an excellent extraction effect. Hence, in order to get good results, the road extraction should combine multiple methods according to the real applications. In the future, how to realize the complete road extraction from a RS image is still an essential but challenging and important research topic.
基金Supported by National Natural Science Foundation of China(NSFC)(61232014,61421062,61472010)National Key Technology R&D Program of China(2015BAK01B06)
文摘In this paper, an approach of roads network extraction from high resolution satellite images is presented. First, the approach extracts road surface from satellite image using one-class support vector machine (SVM). Second, the road topology is built from the road surface. The last output of the approach is a series of road segments which is represented by a sequence of points as well as the topological relations among them. The approach includes four steps. In the first step one-class support vector machine is used for classifying pixel of the satellite images to road class or non-road class. In the second step filling holes and connecting gaps for the SVM's classification result is applied through mathematical morphology close operation. In the third step the road segment is extracted by a series of operations which include skeletonization, thin, branch pruning and road segmentation. In the last step a geometrical adjustment process is applied through analyzing the road segment curvature. The experiment results demonstrate its robustness and viability on extracting road network from high resolution satellite images.
文摘The commercial high-resolution imaging satellite with 1 m spatial resolution IKONOS is an important data source of information for urban planning and geographical information system (GIS) applications. In this paper, a morphological method is proposed. The proposed method combines the automatic thresholding and morphological operation techniques to extract the road centerline of the urban environment. This method intends to solve urban road centerline problems, vehicle, vegetation, building etc. Based on this morphological method, an object extractor is designed to extract road networks from highly remote sensing images. Some filters are applied in this experiment such as line reconstruction and region filling techniques to connect the disconnected road segments and remove the small redundant. Finally, the thinning algorithm is used to extract the road centerline. Experiments have been conducted on a high-resolution IKONOS and QuickBird images showing the efficiency of the proposed method.
基金This project was funded by the National Natural Science Foundation of China(61872139,41871320)Provincial and Municipal Joint Fund of Hunan Provincial Natural Science Foundation of China(2018JJ4052)+2 种基金Hunan Provincial Natural Science Foundation of China(2017JJ2081)the Key Project of Hunan Provincial Education Department(17A070,19A172)the Project of Hunan Provincial Education Department(17C0646).
文摘Road network extraction is vital to both vehicle navigation and road planning.Existing approaches focus on mining urban trunk roads from GPS trajectories of floating cars.However,path extraction,which plays an important role in earthquake relief and village tour,is always ignored.Addressing this issue,we propose a novel approach of extracting campus’road network from walking GPS trajectories.It consists of data preprocessing and road centerline generation.The patrolling GPS trajectories,collected at Hunan University of Science and Technology,were used as the experimental data.The experimental evaluation results show that our approach is able to effectively and accurately extract both campus’trunk roads and paths.The coverage rate is 96.21%while the error rate is 3.26%.
基金financially supported by the National Key Research&Development Project(Grant No.2021YFB3901302)the Beijing Municipal Science and Technology Project(Grant No.Z201100008020008).
文摘The application of autonomous agricultural vehicles is gaining popularity as a way to increase production efficiency and lower operational costs.To achieve high performance,perception tasks(such as obstacle detection,road extraction,and drivable area extraction)are of great importance.Compared with structured roads,field roads between farmlands,including unstructured roads and semi-structured roads,are unfavorable for autonomous agricultural vehicle driving due to their bumpiness and unstructured nature.This study proposed an extraction method for the straight field roads between farmlands.The proposed method was based on the point cloud data acquired by LiDAR(Velodyne VLP-16)mounted on a John Deere 12046B-1204 tractor.The proposed method has three aspects:Euclidean Clustering-based extraction,boundary-based extraction,and road point cloud curve segment modification.Firstly,Euclidean Clustering with K-Dimensional(KD)-Tree data structure was adopted to extract the road curve segments close to the LiDAR composed of road points.Secondly,the boundary lines constraint was constructed to extract the distant road curve segments.Thirdly,the local distance ratio was used to modify the extracted road curve segments.The average extraction accuracy for both semi-structured and unstructured roads exceeded 98%,and the false positive rate(FPR)was less than 0.5%.These experimental findings demonstrated that the proposed road extraction method was precise and effective.The proposed method of this study can be applied to enhance the perception ability of autonomous agricultural vehicles thereby increasing the efficiency and safety of field road driving.
基金supported by the Joint Fund for Innovation and Development of Automobile Industry of National Natural Science Foundation of China[Grant Number U1764262]the National Natural Science Foundation of China[Grant Number 42101448].
文摘Vehicles have been increasingly equipped with GPS receivers to record their trajectories,which we call floating car data.Compared with other data sources,these data are characterized by low cost,wide coverage,and rapid updating.The data have become an important source for road network extraction.In this paper,we propose a novel approach for mining road networks from floating car data.First,a Gaussian model is used to transform the data into bitmap,and the Otsu algorithm is utilized to detect road intersections.Then,a clothoid-based method is used to resample the GPS points to improve the clustering accuracy,and the data are clustered based on a distance-direction algorithm.Last,road centerlines are extracted with a weighted least squares algorithm.We report on experiments that were conducted on floating car data from Wuhan,China.To conclude,existing methods are compared with our method to prove that the proposed method is practical and effective.