基于切换模型的两交叉口信号灯Q学习协调控制

Based on Switching-model Cooperative Control for Two Intersections Applying Q-Learning

为了解决两交叉口信号灯协调控制,在建立两交叉口切换模型的基础上,提出了组合相位的概念,将两交叉口形式上转换为单交叉口的形式,采用解决单个智能体和环境交互的Q学习算法实现了两交叉口之间的协调控制。应用Paramics微观交通仿真软件进行了算法仿真,仿真结果验证了该方法的有效性。

In order to realize the cooperative control for two adjacent intersections, the signal control for two intersections is put forward based on the method, which the traffic signal control for an isolated intersection has been resolved by Q-Learning. According to the switching-model for two intersections, the combination phase of two intersections is advanced in order to transform two intersections to a single one. So the cooperation control for two intersections can be resolved by general Q-Learning. It is illustrated by Paramics simulation software that the method is effective and feasible.