基于深度强化学习的自动驾驶车辆专用道汇入引导

Merging guidance of exclusive lanes for connected and autonomous vehicles based on deep reinforcement learning

为满足自动驾驶车辆(CAV)与人工驾驶车辆混行过程中安全和效率的需求,自动驾驶车辆专用道应运而生。当高速公路内侧车道设为自动驾驶车辆专用道时,引导自动驾驶车辆从普通车道汇入至专用道的策略研究具有重要的理论意义和实际价值。首先,设计专用道入口并提出车辆控制规则;其次,以使更多自动驾驶车辆换道至专用道为目标,基于深度强化学习,选择换道信号动作引导车辆换道;最后,通过Python语言编译进行数值仿真验证。结果表明:在自动驾驶车辆渗透率、到达专用道自动驾驶车辆比例等不同因素构建的9种场景下,本文算法能够快速收敛;能够有效引导自动驾驶车辆汇入专用道,保证通行效率;相较无信号控制情况,渗透率为20%~40%时,第2车道交通拥堵显著减少;在两段式专用道入口场景下,CAV换道至专用道的比例比单入口场景明显提高。所提出的策略具有较好的适用性,能为工程建设提供参考借鉴。

Exclusive lanes for connected and autonomous vehicles(CAVs)will emerge in order to ensure the safety and efficiency requirements in the process of traffic flow mixed with human-driving vehicles and CAVs.When the inner lane of the expressway is set as the exclusive lane for CAVs,it has important theoretical significance and practical value to study the strategy of guiding CAVs to merge from the ordinary lane to the exclusive lane. Firstly, the entrance area of exclusive lane was designed and vehicle control rules were proposed. Secondly, with the goal of making more CAVs change lanes to the exclusive lane, the strategy of selecting lane-changing signal actions was proposed based on deep reinforcement learning. Finally, the numerical simulation was carried out with Python language compilation. The results show that the proposed algorithm can converge very quickly under 9 scenarios constructed by different factors, such as the CAV penetration rates and the proportion of CAVs arriving at the exclusive lane;it can effectively guide CAVs to merge into exclusive lanes and ensure traffic efficiency;congestion in the second lane can be significantly reduced compared to the unsignalized control when the penetration rate changes from 20% to 40%;the proportion of CAVs changing to the exclusive lane is significantly higher under the two exclusive lane entrances scenario than that under the one entrance scenario. It shows that the proposed strategy has good applicability and can provide reference for engineering construction.