This paper investigates the use of multi-agent deep Q-network(MADQN)to address the curse of dimensionality issue occurred in the traditional multi-agent reinforcement learning(MARL)approach.The proposed MADQN is appli...This paper investigates the use of multi-agent deep Q-network(MADQN)to address the curse of dimensionality issue occurred in the traditional multi-agent reinforcement learning(MARL)approach.The proposed MADQN is applied to traffic light controllers at multiple intersections with busy traffic and traffic disruptions,particularly rainfall.MADQN is based on deep Q-network(DQN),which is an integration of the traditional reinforcement learning(RL)and the newly emerging deep learning(DL)approaches.MADQN enables traffic light controllers to learn,exchange knowledge with neighboring agents,and select optimal joint actions in a collaborative manner.A case study based on a real traffic network is conducted as part of a sustainable urban city project in the Sunway City of Kuala Lumpur in Malaysia.Investigation is also performed using a grid traffic network(GTN)to understand that the proposed scheme is effective in a traditional traffic network.Our proposed scheme is evaluated using two simulation tools,namely Matlab and Simulation of Urban Mobility(SUMO).Our proposed scheme has shown that the cumulative delay of vehicles can be reduced by up to 30%in the simulations.展开更多
A single intersection of two phases is selected as a model to put forward a new optimal time-planning scheme for traffic light based on the model of hybrid automata for single intersection. A method of optimization is...A single intersection of two phases is selected as a model to put forward a new optimal time-planning scheme for traffic light based on the model of hybrid automata for single intersection. A method of optimization is proposed for hybrid systems, and the average queue length over all queues is used as an objective function to find an optimal switching scheme for traffic light. It is illustrated that traffic light control for single intersection is a typical hybrid system, and the optimal planning-time scheme can be obtained using the optimal hybrid systems control based on the two stages method.展开更多
The problem of traffic congestion is a significant phenomenon that has had a substantial impact on the transportation system within the country. This phenomenon has given rise to numerous intricacies, particularly in ...The problem of traffic congestion is a significant phenomenon that has had a substantial impact on the transportation system within the country. This phenomenon has given rise to numerous intricacies, particularly in instances where emergency situations occur at traffic light intersections that are consistently congested with a high volume of vehicles. This implementation of a traffic light controller system is designed with the intention of addressing this problem. The purpose of the system was to facilitate the operation of a 3-way traffic control light and provide priority to emergency vehicles using a Radio Frequency Identification (RFID) sensor and Reduced Instruction Set Computing (RISC) Architecture Based Microcontroller. This research work involved designing a system to mitigate the occurrence of accidents commonly observed at traffic light intersections, where vehicles often need to maneuver in order to make way for emergency vehicles following a designated route. The research effectively achieved the analysis, simulation and implementation of wireless communication devices for traffic light control. The implemented prototype utilizes RFID transmission, operates in conjunction with the sequential mode of traffic lights to alter the traffic light sequence accordingly and reverts the traffic lights back to their normal sequence after the emergency vehicle has passed the traffic lights.展开更多
针对城市道路中十字交叉路口处车辆拥堵、排队等待的问题,在C-V2X(Cellular Vehicle-to-Everything)车载通信系统中,利用改进DEEC(Distributed Energy Efficient Clustering)分簇算法,选择剩余节点能量较高的车辆节点作为簇头,提高簇的...针对城市道路中十字交叉路口处车辆拥堵、排队等待的问题,在C-V2X(Cellular Vehicle-to-Everything)车载通信系统中,利用改进DEEC(Distributed Energy Efficient Clustering)分簇算法,选择剩余节点能量较高的车辆节点作为簇头,提高簇的生存时间,并通过中继车辆进行信息传输以降低车辆通信时延。同时,利用韦伯斯特(Webster)交通灯改进配时算法进行相应的信号灯相位调度和周期的配时,减少车辆等待时间。通过VISSIM交通仿真建模软件验证Webster交通灯改进配时算法能够减少交叉路口处车辆等待时间,缓解城市道路中的交通拥堵。数值仿真结果表明:该方案降低了车辆通信时延,减少了车辆等待时间,改善了交通拥堵问题。展开更多
文摘This paper investigates the use of multi-agent deep Q-network(MADQN)to address the curse of dimensionality issue occurred in the traditional multi-agent reinforcement learning(MARL)approach.The proposed MADQN is applied to traffic light controllers at multiple intersections with busy traffic and traffic disruptions,particularly rainfall.MADQN is based on deep Q-network(DQN),which is an integration of the traditional reinforcement learning(RL)and the newly emerging deep learning(DL)approaches.MADQN enables traffic light controllers to learn,exchange knowledge with neighboring agents,and select optimal joint actions in a collaborative manner.A case study based on a real traffic network is conducted as part of a sustainable urban city project in the Sunway City of Kuala Lumpur in Malaysia.Investigation is also performed using a grid traffic network(GTN)to understand that the proposed scheme is effective in a traditional traffic network.Our proposed scheme is evaluated using two simulation tools,namely Matlab and Simulation of Urban Mobility(SUMO).Our proposed scheme has shown that the cumulative delay of vehicles can be reduced by up to 30%in the simulations.
文摘A single intersection of two phases is selected as a model to put forward a new optimal time-planning scheme for traffic light based on the model of hybrid automata for single intersection. A method of optimization is proposed for hybrid systems, and the average queue length over all queues is used as an objective function to find an optimal switching scheme for traffic light. It is illustrated that traffic light control for single intersection is a typical hybrid system, and the optimal planning-time scheme can be obtained using the optimal hybrid systems control based on the two stages method.
文摘The problem of traffic congestion is a significant phenomenon that has had a substantial impact on the transportation system within the country. This phenomenon has given rise to numerous intricacies, particularly in instances where emergency situations occur at traffic light intersections that are consistently congested with a high volume of vehicles. This implementation of a traffic light controller system is designed with the intention of addressing this problem. The purpose of the system was to facilitate the operation of a 3-way traffic control light and provide priority to emergency vehicles using a Radio Frequency Identification (RFID) sensor and Reduced Instruction Set Computing (RISC) Architecture Based Microcontroller. This research work involved designing a system to mitigate the occurrence of accidents commonly observed at traffic light intersections, where vehicles often need to maneuver in order to make way for emergency vehicles following a designated route. The research effectively achieved the analysis, simulation and implementation of wireless communication devices for traffic light control. The implemented prototype utilizes RFID transmission, operates in conjunction with the sequential mode of traffic lights to alter the traffic light sequence accordingly and reverts the traffic lights back to their normal sequence after the emergency vehicle has passed the traffic lights.
文摘针对城市道路中十字交叉路口处车辆拥堵、排队等待的问题,在C-V2X(Cellular Vehicle-to-Everything)车载通信系统中,利用改进DEEC(Distributed Energy Efficient Clustering)分簇算法,选择剩余节点能量较高的车辆节点作为簇头,提高簇的生存时间,并通过中继车辆进行信息传输以降低车辆通信时延。同时,利用韦伯斯特(Webster)交通灯改进配时算法进行相应的信号灯相位调度和周期的配时,减少车辆等待时间。通过VISSIM交通仿真建模软件验证Webster交通灯改进配时算法能够减少交叉路口处车辆等待时间,缓解城市道路中的交通拥堵。数值仿真结果表明:该方案降低了车辆通信时延,减少了车辆等待时间,改善了交通拥堵问题。
