基于Sumtree DDPG的智能交通信号控制算法

Intelligent Traffic Signal Control Algorithm Based on Sumtree DDPG

提出了基于和树—深度确定性策略梯度(Sumtree DDPG)的多路口智能交通信号控制算法,通过对交叉路口数据的实时观测,智能地调控交通信号周期时长、相位顺序以及相位持续时间,提高路口通行效率.同时,基于和树结构的经验数据存储模式提高采样效率,加速了算法收敛.仿真结果表明,在动态环境下,该算法在车辆排队长度、车辆等待时间、车辆平均速度等性能指标上均优于现有的固定配时方案和基于流量权重的配时算法.

A multi-intersection intelligent traffic signal control algorithm based on sumtree deep deterministic policy gradient (Sumtree DDPG) is proposed. Through real-time observation of intersection data,the cycle length,phase sequence and phase duration of the traffic signal can be intelligently adjusted to improve the efficiency of intersections. Meanwhile,the empirical data storage mode based on sumtree structure can improve the sampling efficiency and accelerate the algorithm convergence. Compared with fixed signal timing and signal timing algorithm based on traffic flow weight,a simulation is carried out that the proposed algorithm obtains good performance in vehicle queue length,vehicle waiting time and vehicle average speed in dynamic environment.