Accurate perception of lane line information is one of the basic requirements of unmanned driving technology, which is related to the localization of the vehicle and the determination of the forward direction. In this...Accurate perception of lane line information is one of the basic requirements of unmanned driving technology, which is related to the localization of the vehicle and the determination of the forward direction. In this paper, multi-level constraints are added to the lane line detection model PINet, which is used to improve the perception of lane lines. Predicted lane lines in the network are predicted to have real and imaginary attributes, which are used to enhance the perception of features around the lane lines, with pixel-level constraints on the lane lines;images are converted to bird’s-eye views, where the parallelism between lane lines is reconstructed, with lane line-level constraints on the predicted lane lines;and vanishing points are used to focus on the image hierarchy, with image-level constraints on the lane lines. The model proposed in this paper meets both accuracy (96.44%) and real-time (30 + FPS) requirements, has been tested on the highway on the ground, and has performed stably.展开更多
The advancement of autonomous driving heavily relies on the ability to accurate lane lines detection.As deep learning and computer vision technologies evolve,a variety of deep learning-based methods for lane line dete...The advancement of autonomous driving heavily relies on the ability to accurate lane lines detection.As deep learning and computer vision technologies evolve,a variety of deep learning-based methods for lane line detection have been proposed by researchers in the field.However,owing to the simple appearance of lane lines and the lack of distinctive features,it is easy for other objects with similar local appearances to interfere with the process of detecting lane lines.The precision of lane line detection is limited by the unpredictable quantity and diversity of lane lines.To address the aforementioned challenges,we propose a novel deep learning approach for lane line detection.This method leverages the Swin Transformer in conjunction with LaneNet(called ST-LaneNet).The experience results showed that the true positive detection rate can reach 97.53%for easy lanes and 96.83%for difficult lanes(such as scenes with severe occlusion and extreme lighting conditions),which can better accomplish the objective of detecting lane lines.In 1000 detection samples,the average detection accuracy can reach 97.83%,the average inference time per image can reach 17.8 ms,and the average number of frames per second can reach 64.8 Hz.The programming scripts and associated models for this project can be accessed openly at the following GitHub repository:https://github.com/Duane 711/Lane-line-detec tion-ST-LaneNet.展开更多
Recently,the development and application of lane line departure warning systems have been in the market.For any of the systems,the key part of lane line tracking,lane line identification,or lane line departure warning...Recently,the development and application of lane line departure warning systems have been in the market.For any of the systems,the key part of lane line tracking,lane line identification,or lane line departure warning is whether it can accurately and quickly detect lane lines.Since 1990 s,they have been studied and implemented for the situations defined by the good viewing conditions and the clear lane markings on road.After then,the accuracy for particular situations,the robustness for a wide range of scenarios,time efficiency and integration into higher-order tasks define visual lane line detection and tracking as a continuing research subject.At present,these kinds of lane marking line detection methods based on machine vision and image processing can be divided into two categories:the traditional image processing and semantic segmentation(includes deep learning)methods.The former mainly involves feature-based and model-based steps,and which can be classified into similarity-and discontinuity-based ones;and the model-based step includes different parametric straight line,curve or pattern models.The semantic segmentation includes different machine learning,neural network and deep learning methods,which is the new trend for the research and application of lane line departure warning systems.This paper describes and analyzes the lane line departure warning systems,image processing algorithms and semantic segmentation methods for lane line detection.展开更多
文摘Accurate perception of lane line information is one of the basic requirements of unmanned driving technology, which is related to the localization of the vehicle and the determination of the forward direction. In this paper, multi-level constraints are added to the lane line detection model PINet, which is used to improve the perception of lane lines. Predicted lane lines in the network are predicted to have real and imaginary attributes, which are used to enhance the perception of features around the lane lines, with pixel-level constraints on the lane lines;images are converted to bird’s-eye views, where the parallelism between lane lines is reconstructed, with lane line-level constraints on the predicted lane lines;and vanishing points are used to focus on the image hierarchy, with image-level constraints on the lane lines. The model proposed in this paper meets both accuracy (96.44%) and real-time (30 + FPS) requirements, has been tested on the highway on the ground, and has performed stably.
基金Supported by National Natural Science Foundation of China(Grant Nos.51605003,51575001)Natural Science Foundation of Anhui Higher Education Institutions of China(Grant No.KJ2020A0358)Young and Middle-Aged Top Talents Training Program of Anhui Polytechnic University of China.
文摘The advancement of autonomous driving heavily relies on the ability to accurate lane lines detection.As deep learning and computer vision technologies evolve,a variety of deep learning-based methods for lane line detection have been proposed by researchers in the field.However,owing to the simple appearance of lane lines and the lack of distinctive features,it is easy for other objects with similar local appearances to interfere with the process of detecting lane lines.The precision of lane line detection is limited by the unpredictable quantity and diversity of lane lines.To address the aforementioned challenges,we propose a novel deep learning approach for lane line detection.This method leverages the Swin Transformer in conjunction with LaneNet(called ST-LaneNet).The experience results showed that the true positive detection rate can reach 97.53%for easy lanes and 96.83%for difficult lanes(such as scenes with severe occlusion and extreme lighting conditions),which can better accomplish the objective of detecting lane lines.In 1000 detection samples,the average detection accuracy can reach 97.83%,the average inference time per image can reach 17.8 ms,and the average number of frames per second can reach 64.8 Hz.The programming scripts and associated models for this project can be accessed openly at the following GitHub repository:https://github.com/Duane 711/Lane-line-detec tion-ST-LaneNet.
基金financially supported by the National Natural Science Foundation of China(grant No.61170147)the Scientific and Technological Project of Shaanxi Province in China(grant No.2019GY-038)。
文摘Recently,the development and application of lane line departure warning systems have been in the market.For any of the systems,the key part of lane line tracking,lane line identification,or lane line departure warning is whether it can accurately and quickly detect lane lines.Since 1990 s,they have been studied and implemented for the situations defined by the good viewing conditions and the clear lane markings on road.After then,the accuracy for particular situations,the robustness for a wide range of scenarios,time efficiency and integration into higher-order tasks define visual lane line detection and tracking as a continuing research subject.At present,these kinds of lane marking line detection methods based on machine vision and image processing can be divided into two categories:the traditional image processing and semantic segmentation(includes deep learning)methods.The former mainly involves feature-based and model-based steps,and which can be classified into similarity-and discontinuity-based ones;and the model-based step includes different parametric straight line,curve or pattern models.The semantic segmentation includes different machine learning,neural network and deep learning methods,which is the new trend for the research and application of lane line departure warning systems.This paper describes and analyzes the lane line departure warning systems,image processing algorithms and semantic segmentation methods for lane line detection.