Lane line detection is a fundamental step in applications like autonomous driving and intelligent traffic monitoring. Emerging applications today have higher requirements for accurate lane detection. In this paper, we...Lane line detection is a fundamental step in applications like autonomous driving and intelligent traffic monitoring. Emerging applications today have higher requirements for accurate lane detection. In this paper, we present a precise information extraction algorithm for lane lines. Specifically, with Gaussian Mixture Model(GMM), we solved the issue of lane line occlusion in multi-lane scenes. Then, Progressive Probabilistic Hough Transform(PPHT) was used for line segments detection. After K-Means clustering for line segments classification, we solved the problem of extracting precise information that includes left and right edges as well as endpoints of each lane line based on geometric characteristics. Finally, we fitted these solid and dashed lane lines respectively. Experimental results indicate that the proposed method performs better than the other methods in both single-lane and multi-lane scenarios.展开更多
The advancement of autonomous driving heavily relies on the ability to accurate lane lines detection.As deep learning and computer vision technologies evolve,a variety of deep learning-based methods for lane line dete...The advancement of autonomous driving heavily relies on the ability to accurate lane lines detection.As deep learning and computer vision technologies evolve,a variety of deep learning-based methods for lane line detection have been proposed by researchers in the field.However,owing to the simple appearance of lane lines and the lack of distinctive features,it is easy for other objects with similar local appearances to interfere with the process of detecting lane lines.The precision of lane line detection is limited by the unpredictable quantity and diversity of lane lines.To address the aforementioned challenges,we propose a novel deep learning approach for lane line detection.This method leverages the Swin Transformer in conjunction with LaneNet(called ST-LaneNet).The experience results showed that the true positive detection rate can reach 97.53%for easy lanes and 96.83%for difficult lanes(such as scenes with severe occlusion and extreme lighting conditions),which can better accomplish the objective of detecting lane lines.In 1000 detection samples,the average detection accuracy can reach 97.83%,the average inference time per image can reach 17.8 ms,and the average number of frames per second can reach 64.8 Hz.The programming scripts and associated models for this project can be accessed openly at the following GitHub repository:https://github.com/Duane 711/Lane-line-detec tion-ST-LaneNet.展开更多
Accurate perception of lane line information is one of the basic requirements of unmanned driving technology, which is related to the localization of the vehicle and the determination of the forward direction. In this...Accurate perception of lane line information is one of the basic requirements of unmanned driving technology, which is related to the localization of the vehicle and the determination of the forward direction. In this paper, multi-level constraints are added to the lane line detection model PINet, which is used to improve the perception of lane lines. Predicted lane lines in the network are predicted to have real and imaginary attributes, which are used to enhance the perception of features around the lane lines, with pixel-level constraints on the lane lines;images are converted to bird’s-eye views, where the parallelism between lane lines is reconstructed, with lane line-level constraints on the predicted lane lines;and vanishing points are used to focus on the image hierarchy, with image-level constraints on the lane lines. The model proposed in this paper meets both accuracy (96.44%) and real-time (30 + FPS) requirements, has been tested on the highway on the ground, and has performed stably.展开更多
Recently,the development and application of lane line departure warning systems have been in the market.For any of the systems,the key part of lane line tracking,lane line identification,or lane line departure warning...Recently,the development and application of lane line departure warning systems have been in the market.For any of the systems,the key part of lane line tracking,lane line identification,or lane line departure warning is whether it can accurately and quickly detect lane lines.Since 1990 s,they have been studied and implemented for the situations defined by the good viewing conditions and the clear lane markings on road.After then,the accuracy for particular situations,the robustness for a wide range of scenarios,time efficiency and integration into higher-order tasks define visual lane line detection and tracking as a continuing research subject.At present,these kinds of lane marking line detection methods based on machine vision and image processing can be divided into two categories:the traditional image processing and semantic segmentation(includes deep learning)methods.The former mainly involves feature-based and model-based steps,and which can be classified into similarity-and discontinuity-based ones;and the model-based step includes different parametric straight line,curve or pattern models.The semantic segmentation includes different machine learning,neural network and deep learning methods,which is the new trend for the research and application of lane line departure warning systems.This paper describes and analyzes the lane line departure warning systems,image processing algorithms and semantic segmentation methods for lane line detection.展开更多
Updating high-definition maps is imperative for the safety of autonomous vehicles.However,positional changes in lane lines are hard to be detected in a timely manner due to a limited number of expensive surveying vehi...Updating high-definition maps is imperative for the safety of autonomous vehicles.However,positional changes in lane lines are hard to be detected in a timely manner due to a limited number of expensive surveying vehicles over a large geo-graphic area.Herein,a novel method is proposed to detect the geometric changes of lane lines using low-cost sensors,such as consumer-grade global navigation satellite system(GNSS)hardware receivers and cameras.The proposed framework geometric change detection using low-cost sensors(GCD-L)and algorithm change segment compare(CSC),which are based on the lane width between the curb line and the adjacent leftmost lane line,can perceive the positional changes of the leftmost lane line on highway and expressway roads.The effectiveness of the proposed method is verified by evaluating it on a real-world typical urban ring road dataset.The experimental results show that 71%detected change segments are valid with only two round crowdsourced maps.展开更多
Monitoring the extra-high-voltage transmission line corridor(EHVTLC)in mountains is critical for safe smart-grid operation.However,the transmission lines are so narrow that they are difficult to recognize using multis...Monitoring the extra-high-voltage transmission line corridor(EHVTLC)in mountains is critical for safe smart-grid operation.However,the transmission lines are so narrow that they are difficult to recognize using multispectral satellite images with a spatial resolution of 10 m.In this study,we developed a new method using the red band–shadow-eliminated vegetation index(SEVI)–blue band(RSB)composite image to enhance the EHVTLC in green mountains(named RSB-enhancement method).Using this method,the EHVTLC becomes evident in the false-color synthesis of the RSB composite of the Sentinel-2 image.Then,we recognized and extracted approximately 342.45 km of the EHVTLC in a mountainous region of Fuzhou City,China,including a 46.73 km three-parallel-lane segment of 1000 kV and a 295.72 km two-parallel-lane segment of 500 kV.Spatial analysis shows that the SEVI mean difference between the EHVTLC and the buffer zone reaches approximately 10%,and three landslides and 2.66 km^(2) soil erosion reside in the buffer zone which area is approximately 73.67 km^(2).Finally,the RSB-enhancement method can be used in other satellite images with spatial resolutions of greater than 10 m for enhancement and recognition the transmission line corridors in green mountains.展开更多
基金supported by the National Nature Science Foundation of China under Grant No.61502226the Jiangsu Provincial Transportation Science and Technology Project No.2017X04the Fundamental Research Funds for the Central Universities
文摘Lane line detection is a fundamental step in applications like autonomous driving and intelligent traffic monitoring. Emerging applications today have higher requirements for accurate lane detection. In this paper, we present a precise information extraction algorithm for lane lines. Specifically, with Gaussian Mixture Model(GMM), we solved the issue of lane line occlusion in multi-lane scenes. Then, Progressive Probabilistic Hough Transform(PPHT) was used for line segments detection. After K-Means clustering for line segments classification, we solved the problem of extracting precise information that includes left and right edges as well as endpoints of each lane line based on geometric characteristics. Finally, we fitted these solid and dashed lane lines respectively. Experimental results indicate that the proposed method performs better than the other methods in both single-lane and multi-lane scenarios.
基金Supported by National Natural Science Foundation of China(Grant Nos.51605003,51575001)Natural Science Foundation of Anhui Higher Education Institutions of China(Grant No.KJ2020A0358)Young and Middle-Aged Top Talents Training Program of Anhui Polytechnic University of China.
文摘The advancement of autonomous driving heavily relies on the ability to accurate lane lines detection.As deep learning and computer vision technologies evolve,a variety of deep learning-based methods for lane line detection have been proposed by researchers in the field.However,owing to the simple appearance of lane lines and the lack of distinctive features,it is easy for other objects with similar local appearances to interfere with the process of detecting lane lines.The precision of lane line detection is limited by the unpredictable quantity and diversity of lane lines.To address the aforementioned challenges,we propose a novel deep learning approach for lane line detection.This method leverages the Swin Transformer in conjunction with LaneNet(called ST-LaneNet).The experience results showed that the true positive detection rate can reach 97.53%for easy lanes and 96.83%for difficult lanes(such as scenes with severe occlusion and extreme lighting conditions),which can better accomplish the objective of detecting lane lines.In 1000 detection samples,the average detection accuracy can reach 97.83%,the average inference time per image can reach 17.8 ms,and the average number of frames per second can reach 64.8 Hz.The programming scripts and associated models for this project can be accessed openly at the following GitHub repository:https://github.com/Duane 711/Lane-line-detec tion-ST-LaneNet.
文摘Accurate perception of lane line information is one of the basic requirements of unmanned driving technology, which is related to the localization of the vehicle and the determination of the forward direction. In this paper, multi-level constraints are added to the lane line detection model PINet, which is used to improve the perception of lane lines. Predicted lane lines in the network are predicted to have real and imaginary attributes, which are used to enhance the perception of features around the lane lines, with pixel-level constraints on the lane lines;images are converted to bird’s-eye views, where the parallelism between lane lines is reconstructed, with lane line-level constraints on the predicted lane lines;and vanishing points are used to focus on the image hierarchy, with image-level constraints on the lane lines. The model proposed in this paper meets both accuracy (96.44%) and real-time (30 + FPS) requirements, has been tested on the highway on the ground, and has performed stably.
基金financially supported by the National Natural Science Foundation of China(grant No.61170147)the Scientific and Technological Project of Shaanxi Province in China(grant No.2019GY-038)。
文摘Recently,the development and application of lane line departure warning systems have been in the market.For any of the systems,the key part of lane line tracking,lane line identification,or lane line departure warning is whether it can accurately and quickly detect lane lines.Since 1990 s,they have been studied and implemented for the situations defined by the good viewing conditions and the clear lane markings on road.After then,the accuracy for particular situations,the robustness for a wide range of scenarios,time efficiency and integration into higher-order tasks define visual lane line detection and tracking as a continuing research subject.At present,these kinds of lane marking line detection methods based on machine vision and image processing can be divided into two categories:the traditional image processing and semantic segmentation(includes deep learning)methods.The former mainly involves feature-based and model-based steps,and which can be classified into similarity-and discontinuity-based ones;and the model-based step includes different parametric straight line,curve or pattern models.The semantic segmentation includes different machine learning,neural network and deep learning methods,which is the new trend for the research and application of lane line departure warning systems.This paper describes and analyzes the lane line departure warning systems,image processing algorithms and semantic segmentation methods for lane line detection.
基金sponsored by the National Natural Science Foundation of China-52102426,U1864203 and 61773234the Project Funded by China Postdoctoral Science Foundation-2019M660622.
文摘Updating high-definition maps is imperative for the safety of autonomous vehicles.However,positional changes in lane lines are hard to be detected in a timely manner due to a limited number of expensive surveying vehicles over a large geo-graphic area.Herein,a novel method is proposed to detect the geometric changes of lane lines using low-cost sensors,such as consumer-grade global navigation satellite system(GNSS)hardware receivers and cameras.The proposed framework geometric change detection using low-cost sensors(GCD-L)and algorithm change segment compare(CSC),which are based on the lane width between the curb line and the adjacent leftmost lane line,can perceive the positional changes of the leftmost lane line on highway and expressway roads.The effectiveness of the proposed method is verified by evaluating it on a real-world typical urban ring road dataset.The experimental results show that 71%detected change segments are valid with only two round crowdsourced maps.
基金supported by the Science and Technology Plan Leading Project of Fujian Province,China[grant num-ber 2021Y0005]Water Conservancy Science and Technology Project of Fujian Province,China[grant number MSK202301].
文摘Monitoring the extra-high-voltage transmission line corridor(EHVTLC)in mountains is critical for safe smart-grid operation.However,the transmission lines are so narrow that they are difficult to recognize using multispectral satellite images with a spatial resolution of 10 m.In this study,we developed a new method using the red band–shadow-eliminated vegetation index(SEVI)–blue band(RSB)composite image to enhance the EHVTLC in green mountains(named RSB-enhancement method).Using this method,the EHVTLC becomes evident in the false-color synthesis of the RSB composite of the Sentinel-2 image.Then,we recognized and extracted approximately 342.45 km of the EHVTLC in a mountainous region of Fuzhou City,China,including a 46.73 km three-parallel-lane segment of 1000 kV and a 295.72 km two-parallel-lane segment of 500 kV.Spatial analysis shows that the SEVI mean difference between the EHVTLC and the buffer zone reaches approximately 10%,and three landslides and 2.66 km^(2) soil erosion reside in the buffer zone which area is approximately 73.67 km^(2).Finally,the RSB-enhancement method can be used in other satellite images with spatial resolutions of greater than 10 m for enhancement and recognition the transmission line corridors in green mountains.