The advancement of autonomous driving heavily relies on the ability to accurate lane lines detection.As deep learning and computer vision technologies evolve,a variety of deep learning-based methods for lane line dete...The advancement of autonomous driving heavily relies on the ability to accurate lane lines detection.As deep learning and computer vision technologies evolve,a variety of deep learning-based methods for lane line detection have been proposed by researchers in the field.However,owing to the simple appearance of lane lines and the lack of distinctive features,it is easy for other objects with similar local appearances to interfere with the process of detecting lane lines.The precision of lane line detection is limited by the unpredictable quantity and diversity of lane lines.To address the aforementioned challenges,we propose a novel deep learning approach for lane line detection.This method leverages the Swin Transformer in conjunction with LaneNet(called ST-LaneNet).The experience results showed that the true positive detection rate can reach 97.53%for easy lanes and 96.83%for difficult lanes(such as scenes with severe occlusion and extreme lighting conditions),which can better accomplish the objective of detecting lane lines.In 1000 detection samples,the average detection accuracy can reach 97.83%,the average inference time per image can reach 17.8 ms,and the average number of frames per second can reach 64.8 Hz.The programming scripts and associated models for this project can be accessed openly at the following GitHub repository:https://github.com/Duane 711/Lane-line-detec tion-ST-LaneNet.展开更多
Accurate perception of lane line information is one of the basic requirements of unmanned driving technology, which is related to the localization of the vehicle and the determination of the forward direction. In this...Accurate perception of lane line information is one of the basic requirements of unmanned driving technology, which is related to the localization of the vehicle and the determination of the forward direction. In this paper, multi-level constraints are added to the lane line detection model PINet, which is used to improve the perception of lane lines. Predicted lane lines in the network are predicted to have real and imaginary attributes, which are used to enhance the perception of features around the lane lines, with pixel-level constraints on the lane lines;images are converted to bird’s-eye views, where the parallelism between lane lines is reconstructed, with lane line-level constraints on the predicted lane lines;and vanishing points are used to focus on the image hierarchy, with image-level constraints on the lane lines. The model proposed in this paper meets both accuracy (96.44%) and real-time (30 + FPS) requirements, has been tested on the highway on the ground, and has performed stably.展开更多
The formation control of multiple unmanned aerial vehicles(multi-UAVs)has always been a research hotspot.Based on the straight line trajectory,a multi-UAVs target point assignment algorithm based on the assignment pro...The formation control of multiple unmanned aerial vehicles(multi-UAVs)has always been a research hotspot.Based on the straight line trajectory,a multi-UAVs target point assignment algorithm based on the assignment probability is proposed to achieve the shortest overall formation path of multi-UAVs with low complexity and reduce the energy consumption.In order to avoid the collision between UAVs in the formation process,the concept of safety ball is introduced,and the collision detection based on continuous motion of two time slots and the lane occupation detection after motion is proposed to avoid collision between UAVs.Based on the idea of game theory,a method of UAV motion form setting based on the maximization of interests is proposed,including the maximization of self-interest and the maximization of formation interest is proposed,so that multi-UAVs can complete the formation task quickly and reasonably with the linear trajectory assigned in advance.Finally,through simulation verification,the multi-UAVs target assignment algorithm based on the assignment probability proposed in this paper can effectively reduce the total path length,and the UAV motion selection method based on the maximization interests can effectively complete the task formation.展开更多
Lane detection is a fundamental necessary task for autonomous driving.The conventional methods mainly treat lane detection as a pixel-wise segmentation problem,which suffers from the challenge of uncontrollable drivin...Lane detection is a fundamental necessary task for autonomous driving.The conventional methods mainly treat lane detection as a pixel-wise segmentation problem,which suffers from the challenge of uncontrollable driving road environments and needs post-processing to abstract the lane parameters.In this work,a series of lines are used to represent traffic lanes and a novel line deformation network(LDNet) is proposed to directly predict the coordinates of lane line points.Inspired by the dynamic behavior of classic snake algorithms,LDNet uses a neural network to iteratively deform an initial lane line to match the lane markings.To capture the long and discontinuous structures of lane lines,1 D convolution in LDNet is used for structured feature learning along the lane lines.Based on LDNet,a two-stage pipeline is developed for lane marking detection:(1) initial lane line proposal to predict a list of lane line candidates,and(2) lane line deformation to obtain the coordinates of lane line points.Experiments show that the proposed approach achieves competitive performances on the TuSimple dataset while being efficient for real-time applications on a GTX 1650 GPU.In particular,the accuracy of LDNet with the annotated starting and ending points is up to99.45%,which indicates the improved initial lane line proposal method can further enhance the performance of LDNet.展开更多
基于Transformer的车道预测LSTR(Lane Shape Prediction with Transformers)算法在检测车道线时存在缺少捕捉局部特征的能力和多头注意力机制中头数多余的问题.本文提出了改进LSTR算法的车道线检测方法,首先在最后一个编码器中前馈网络...基于Transformer的车道预测LSTR(Lane Shape Prediction with Transformers)算法在检测车道线时存在缺少捕捉局部特征的能力和多头注意力机制中头数多余的问题.本文提出了改进LSTR算法的车道线检测方法,首先在最后一个编码器中前馈网络的后面引入CBAM(Convolutional Block Attention Module)注意力机制模块,充分利用通道和空间上的信息,捕捉特征图中更多的细节;然后对解码器中的掩码多头注意力机制进行剪枝,使用掩码单头注意力机制来进行替换,以便更多关注前一时刻的车道线信息.改进后的LSTR算法在TuSimple数据集上准确度为96.31%,明显高于PolyLaneNet(Lane Estimation via Deep Polynomial Regression)等算法,在CULane数据集上比原始算法的F1评分上升了2.11%.展开更多
UFLD(ultra fast structure aware deep lane detection)是一种轻量化车道线检测模型,为提升模型的检测精度,对模型进行改进。引入CAM(channel attention mechanism)使模型能更关注携带重要车道线信息的特征通道和像素;为了感知车道线...UFLD(ultra fast structure aware deep lane detection)是一种轻量化车道线检测模型,为提升模型的检测精度,对模型进行改进。引入CAM(channel attention mechanism)使模型能更关注携带重要车道线信息的特征通道和像素;为了感知车道线的细节信息,引入ASPP(atrous spatial pyramid pooling)扩大卷积过程的感受野,提高模型分割精度;搭建引入CAM和ASPP后的改进模型,并在改进的模型上进行实验。实验结果表明:在TuSimple数据集上以ResNet18为主干网络的模型检测精度由95.81%提升至95.98%,以ResNet34为主干网络的模型检测精度由95.84%提升至96.12%;在CULane数据集上,无论是以ResNet18还是以ResNet34为主干网络模型,其平均精度均有不同程度的提高。展开更多
基金Supported by National Natural Science Foundation of China(Grant Nos.51605003,51575001)Natural Science Foundation of Anhui Higher Education Institutions of China(Grant No.KJ2020A0358)Young and Middle-Aged Top Talents Training Program of Anhui Polytechnic University of China.
文摘The advancement of autonomous driving heavily relies on the ability to accurate lane lines detection.As deep learning and computer vision technologies evolve,a variety of deep learning-based methods for lane line detection have been proposed by researchers in the field.However,owing to the simple appearance of lane lines and the lack of distinctive features,it is easy for other objects with similar local appearances to interfere with the process of detecting lane lines.The precision of lane line detection is limited by the unpredictable quantity and diversity of lane lines.To address the aforementioned challenges,we propose a novel deep learning approach for lane line detection.This method leverages the Swin Transformer in conjunction with LaneNet(called ST-LaneNet).The experience results showed that the true positive detection rate can reach 97.53%for easy lanes and 96.83%for difficult lanes(such as scenes with severe occlusion and extreme lighting conditions),which can better accomplish the objective of detecting lane lines.In 1000 detection samples,the average detection accuracy can reach 97.83%,the average inference time per image can reach 17.8 ms,and the average number of frames per second can reach 64.8 Hz.The programming scripts and associated models for this project can be accessed openly at the following GitHub repository:https://github.com/Duane 711/Lane-line-detec tion-ST-LaneNet.
文摘Accurate perception of lane line information is one of the basic requirements of unmanned driving technology, which is related to the localization of the vehicle and the determination of the forward direction. In this paper, multi-level constraints are added to the lane line detection model PINet, which is used to improve the perception of lane lines. Predicted lane lines in the network are predicted to have real and imaginary attributes, which are used to enhance the perception of features around the lane lines, with pixel-level constraints on the lane lines;images are converted to bird’s-eye views, where the parallelism between lane lines is reconstructed, with lane line-level constraints on the predicted lane lines;and vanishing points are used to focus on the image hierarchy, with image-level constraints on the lane lines. The model proposed in this paper meets both accuracy (96.44%) and real-time (30 + FPS) requirements, has been tested on the highway on the ground, and has performed stably.
基金supported by the Basic Scientific Research Business Expenses of Central Universities(3072022QBZ0806)。
文摘The formation control of multiple unmanned aerial vehicles(multi-UAVs)has always been a research hotspot.Based on the straight line trajectory,a multi-UAVs target point assignment algorithm based on the assignment probability is proposed to achieve the shortest overall formation path of multi-UAVs with low complexity and reduce the energy consumption.In order to avoid the collision between UAVs in the formation process,the concept of safety ball is introduced,and the collision detection based on continuous motion of two time slots and the lane occupation detection after motion is proposed to avoid collision between UAVs.Based on the idea of game theory,a method of UAV motion form setting based on the maximization of interests is proposed,including the maximization of self-interest and the maximization of formation interest is proposed,so that multi-UAVs can complete the formation task quickly and reasonably with the linear trajectory assigned in advance.Finally,through simulation verification,the multi-UAVs target assignment algorithm based on the assignment probability proposed in this paper can effectively reduce the total path length,and the UAV motion selection method based on the maximization interests can effectively complete the task formation.
基金Supported by the Science and Technology Research Project of Hubei Provincial Department of Education (No.Q20202604)。
文摘Lane detection is a fundamental necessary task for autonomous driving.The conventional methods mainly treat lane detection as a pixel-wise segmentation problem,which suffers from the challenge of uncontrollable driving road environments and needs post-processing to abstract the lane parameters.In this work,a series of lines are used to represent traffic lanes and a novel line deformation network(LDNet) is proposed to directly predict the coordinates of lane line points.Inspired by the dynamic behavior of classic snake algorithms,LDNet uses a neural network to iteratively deform an initial lane line to match the lane markings.To capture the long and discontinuous structures of lane lines,1 D convolution in LDNet is used for structured feature learning along the lane lines.Based on LDNet,a two-stage pipeline is developed for lane marking detection:(1) initial lane line proposal to predict a list of lane line candidates,and(2) lane line deformation to obtain the coordinates of lane line points.Experiments show that the proposed approach achieves competitive performances on the TuSimple dataset while being efficient for real-time applications on a GTX 1650 GPU.In particular,the accuracy of LDNet with the annotated starting and ending points is up to99.45%,which indicates the improved initial lane line proposal method can further enhance the performance of LDNet.
文摘基于Transformer的车道预测LSTR(Lane Shape Prediction with Transformers)算法在检测车道线时存在缺少捕捉局部特征的能力和多头注意力机制中头数多余的问题.本文提出了改进LSTR算法的车道线检测方法,首先在最后一个编码器中前馈网络的后面引入CBAM(Convolutional Block Attention Module)注意力机制模块,充分利用通道和空间上的信息,捕捉特征图中更多的细节;然后对解码器中的掩码多头注意力机制进行剪枝,使用掩码单头注意力机制来进行替换,以便更多关注前一时刻的车道线信息.改进后的LSTR算法在TuSimple数据集上准确度为96.31%,明显高于PolyLaneNet(Lane Estimation via Deep Polynomial Regression)等算法,在CULane数据集上比原始算法的F1评分上升了2.11%.
文摘UFLD(ultra fast structure aware deep lane detection)是一种轻量化车道线检测模型,为提升模型的检测精度,对模型进行改进。引入CAM(channel attention mechanism)使模型能更关注携带重要车道线信息的特征通道和像素;为了感知车道线的细节信息,引入ASPP(atrous spatial pyramid pooling)扩大卷积过程的感受野,提高模型分割精度;搭建引入CAM和ASPP后的改进模型,并在改进的模型上进行实验。实验结果表明:在TuSimple数据集上以ResNet18为主干网络的模型检测精度由95.81%提升至95.98%,以ResNet34为主干网络的模型检测精度由95.84%提升至96.12%;在CULane数据集上,无论是以ResNet18还是以ResNet34为主干网络模型,其平均精度均有不同程度的提高。
