This article studies the effective traffic signal control problem of multiple intersections in a city-level traffic system.A novel regional multi-agent cooperative reinforcement learning algorithm called RegionSTLight...This article studies the effective traffic signal control problem of multiple intersections in a city-level traffic system.A novel regional multi-agent cooperative reinforcement learning algorithm called RegionSTLight is proposed to improve the traffic efficiency.Firstly a regional multi-agent Q-learning framework is proposed,which can equivalently decompose the global Q value of the traffic system into the local values of several regions Based on the framework and the idea of human-machine cooperation,a dynamic zoning method is designed to divide the traffic network into several strong-coupled regions according to realtime traffic flow densities.In order to achieve better cooperation inside each region,a lightweight spatio-temporal fusion feature extraction network is designed.The experiments in synthetic real-world and city-level scenarios show that the proposed RegionS TLight converges more quickly,is more stable,and obtains better asymptotic performance compared to state-of-theart models.展开更多
Road throughput can be increased by driving at small inter-vehicle time gaps. The amplification of velocity disturbances in upstream direction, however, poses limitations to the minimum feasible time gap. This effect ...Road throughput can be increased by driving at small inter-vehicle time gaps. The amplification of velocity disturbances in upstream direction, however, poses limitations to the minimum feasible time gap. This effect is covered by the notion of string stability. String-stable behavior is thus considered an essential requirement for the design of automatic distance control systems, which are needed to allow for safe driving at time gaps well below 1 s. Using wireless inter-vehicle communications to provide real-time information of the preceding vehicle, in addition to the information obtained by common Adaptive Cruise Control (ACC) sensors, appears to significantly decrease the feasible time gap, which is shown by practical experiments with a test fleet consisting of six passenger vehicles. The large-scale deployment of this system, known as Cooperative ACC (CACC), however, poses challenges with respect to the reliability of the wireless communication system. A solution for this scalability problem can be found in decreasing the transmission power and/or beaconing rate, or adapting the communications protocol. Although the main CACC objective is to increase road throughput, the first commercial application of CACC is foreseen to be in truck platooning, since short distance following is expected to yield significant fuel savings in this case.展开更多
The introduction of automated driving systems raised questions about how the human driver interacts with the automated system. Non-cooperative game theory is increasingly used for modelling and understanding such inte...The introduction of automated driving systems raised questions about how the human driver interacts with the automated system. Non-cooperative game theory is increasingly used for modelling and understanding such interaction, while its counterpart, cooperative game theory is rarely discussed for similar applications despite it may be potentially more suitable. This paper describes the modelling of a human driver’s steering interaction with an automated steering system using cooperative game theory. The distributed Model Predictive Control approach is adopted to derive the driver’s and the automated steering system’s strategies in a Pareto equilibrium sense, namely their cooperative Pareto steering strategies. Two separate numerical studies are carried out to study the influence of strategy parameters, and the influence of strategy types on the driver’s and the automated system’s steering performance. It is found that when a driver interacts with an automated steering system using a cooperative Pareto steering strategy, the driver can improve his/her performance in following a target path through increasing his/her effort in pursuing his/her own interest under the driver-automation cooperative control goal. It is also found that a driver’s adoption of cooperative Pareto steering strategy leads to a reinforcement in the driver’s steering angle control, compared to the driver’s adoption of non-cooperative Nash strategy. This in turn enables the vehicle to return from a lane-change maneuver to straight-line driving swifter.展开更多
Cooperative driving around intersections has aroused increasing interest in the last five years.Meanwhile,driving safety in non-signalized intersections has become an issue that has attracted attention globally.In vie...Cooperative driving around intersections has aroused increasing interest in the last five years.Meanwhile,driving safety in non-signalized intersections has become an issue that has attracted attention globally.In view of the potential collision risk when more than three vehicles approach a non-signalized intersection from different directions,we propose a driving model using cooperative game theory.First,the characteristic functions of this model are primarily established on each vehicle’s profit function and include safety,rapidity and comfort indicators.Second,the Shapley theorem is adopted,and its group rationality,individual rationality,and uniqueness are proved to be suitable for the characteristic functions of the model.Following this,different drivers’characteristics are considered.In order to simplify the calculation process,a zero-mean normalization method is introduced.In addition,a genetic algorithm method is adopted to search an optimal strategy set in the constrained multi-objective optimization problem.Finally,the model is confirmed as valid after simulation with a series of initial conditions.展开更多
Autonomous driving is an emerging technology attracting interests from various sectors in recent years.Most of existing work treats autonomous vehicles as isolated individuals and has focused on developing separate in...Autonomous driving is an emerging technology attracting interests from various sectors in recent years.Most of existing work treats autonomous vehicles as isolated individuals and has focused on developing separate intelligent modules.In this paper,we attempt to exploit the connectivity among vehicles and propose a systematic framework to develop autonomous driving techniques.We first introduce a general hierarchical information fusion framework for cooperative sensing to obtain global situational awareness for vehicles.Following this,a cooperative intelligence framework is proposed for autonomous driving systems.This general framework can guide the development of data collection,sharing and processing strategies to realize different intelligent functions in autonomous driving.展开更多
At the 11th Forum on China-ASEAN Technology Transfer and Collaborative Innovation(hereinafter referred to as the China-ASEAN Innovation Forum)in July 2023,ASEAN Secretary-General Kao Kim Hourn highlighted the pivotal ...At the 11th Forum on China-ASEAN Technology Transfer and Collaborative Innovation(hereinafter referred to as the China-ASEAN Innovation Forum)in July 2023,ASEAN Secretary-General Kao Kim Hourn highlighted the pivotal role of technology transfer and innovation in driving economic growth.He emphasized that technology transfer can assist China and ASEAN in bypassing traditional developmental stages.展开更多
Intelligent vehicle(Ⅳ)technology has developed rapidly in recent years.However,achieving fully unmanned driving still presents numerous challenges,which means that human drivers will continue to play a vital role in ...Intelligent vehicle(Ⅳ)technology has developed rapidly in recent years.However,achieving fully unmanned driving still presents numerous challenges,which means that human drivers will continue to play a vital role in vehicle operation for the foreseeable future.Human-machine shared driving,involving cooperation between a human driver and an automated driving system(AVS),has been widely regarded as a necessary stage for the development of IVs.Focusing onⅣdriving safety,this study proposed a human-machine shared lateral control strategy(HSLCS)based on the reliability of driver risk perception.The HSLCS starts by identifying the effective areas of driver risk perception based on eye movements.It establishes an anisotropic driving risk field,which serves as the foundation for the AVS to assess risk levels.Building upon the cumulative and diminishing effects of risk perception,the proposed approach leverages the driver's risk perception effective area and converts the risk field into a representation aligned with the driver's perspective.Subsequently,it quantifies the reliability of the driver's risk perception by using area-matching rules.Finally,based on the driver’s risk perception reliability and dif-ferences in lateral driving operation between the human driver and the AVS,the dynamic distribution of driving authority is achieved through a fuzzy rule-based system,and the human-machine shared lateral control is completed by using model predictive control.The HSLCS was tested across various scenarios on a driver-in-the-loop test platform.The results show that the HSLCS can realize the synergy and complementarity of human and machine intelligence,effectively ensuring the safety ofⅣoperation.展开更多
Cooperative driving is widely viewed as a promising method to better utilize limited road resources and alleviate traffic congestion.In recent years,several cooperative driving approaches for idealized traffic scenari...Cooperative driving is widely viewed as a promising method to better utilize limited road resources and alleviate traffic congestion.In recent years,several cooperative driving approaches for idealized traffic scenarios(i.e.,uniform vehicle arrivals,lengths,and speeds)have been proposed.However,theoretical analyses and comparisons of these approaches are lacking.In this study,we propose a unified group-by-group zipper-style movement model to describe different approaches synthetically and evaluate their performance.We derive the maximum throughput for cooperative driving plans of idealized unsignalized intersections and discuss how to minimize the delay of vehicles.The obtained conclusions shed light on future cooperative driving studies.展开更多
The burden of schistosomiasis remains a global public health problem,especially in sub-Saharan Africa despite progress in terms of morbidity control.Successful control efforts achieved by China in the last six decades...The burden of schistosomiasis remains a global public health problem,especially in sub-Saharan Africa despite progress in terms of morbidity control.Successful control efforts achieved by China in the last six decades came with considerable experience and lessons that could benefit schistosomiasis control programs in other endemic countries.China's role and commitment to global health cooperation has become increasingly important;this has created a platform for partnership with developing partners for the establishment of Forum on China-Africa health cooperation which prioritizes the pursuit of global elimination target for schistosomiasis and malaria,control of HIV/AIDS,and improved access to reproductive health care.Chinese government's commitment towards achieving schistosomiasis elimination in Africa prompted the establishment of Institution-based Network on China-Africa Cooperation for Schistosomiasis Elimination (INCAS),by the National Institute of Parasitic Diseases to promote schistosomiasis elimination in Africa.Schistosomiasis experts from six provincial institutions and counterparts from 10 African countries participated in the first workshop on China-Africa cooperation for Schistosomiasis Elimination in Africa at Lilongwe,Malawi,in 2015.Experts at the inaugural meeting shared experiences from their national schistosomiasis control programs,as well as identified areas for collaborative synergy targeting schistosomiasis elimination in Africa.The establishment of INCAS,which comprises of 28 member-institutions from China and Africa,was proposed at this meeting.We,therefore,provide information on INCAS activities,cooperation mechanism,as well as assess the strengths,weaknesses,opportunities,and threats as we target schistosomiasis elimination in Africa using the INCAS platform.展开更多
基金supported by the National Science and Technology Major Project (2021ZD0112702)the National Natural Science Foundation (NNSF)of China (62373100,62233003)the Natural Science Foundation of Jiangsu Province of China (BK20202006)。
文摘This article studies the effective traffic signal control problem of multiple intersections in a city-level traffic system.A novel regional multi-agent cooperative reinforcement learning algorithm called RegionSTLight is proposed to improve the traffic efficiency.Firstly a regional multi-agent Q-learning framework is proposed,which can equivalently decompose the global Q value of the traffic system into the local values of several regions Based on the framework and the idea of human-machine cooperation,a dynamic zoning method is designed to divide the traffic network into several strong-coupled regions according to realtime traffic flow densities.In order to achieve better cooperation inside each region,a lightweight spatio-temporal fusion feature extraction network is designed.The experiments in synthetic real-world and city-level scenarios show that the proposed RegionS TLight converges more quickly,is more stable,and obtains better asymptotic performance compared to state-of-theart models.
文摘Road throughput can be increased by driving at small inter-vehicle time gaps. The amplification of velocity disturbances in upstream direction, however, poses limitations to the minimum feasible time gap. This effect is covered by the notion of string stability. String-stable behavior is thus considered an essential requirement for the design of automatic distance control systems, which are needed to allow for safe driving at time gaps well below 1 s. Using wireless inter-vehicle communications to provide real-time information of the preceding vehicle, in addition to the information obtained by common Adaptive Cruise Control (ACC) sensors, appears to significantly decrease the feasible time gap, which is shown by practical experiments with a test fleet consisting of six passenger vehicles. The large-scale deployment of this system, known as Cooperative ACC (CACC), however, poses challenges with respect to the reliability of the wireless communication system. A solution for this scalability problem can be found in decreasing the transmission power and/or beaconing rate, or adapting the communications protocol. Although the main CACC objective is to increase road throughput, the first commercial application of CACC is foreseen to be in truck platooning, since short distance following is expected to yield significant fuel savings in this case.
文摘The introduction of automated driving systems raised questions about how the human driver interacts with the automated system. Non-cooperative game theory is increasingly used for modelling and understanding such interaction, while its counterpart, cooperative game theory is rarely discussed for similar applications despite it may be potentially more suitable. This paper describes the modelling of a human driver’s steering interaction with an automated steering system using cooperative game theory. The distributed Model Predictive Control approach is adopted to derive the driver’s and the automated steering system’s strategies in a Pareto equilibrium sense, namely their cooperative Pareto steering strategies. Two separate numerical studies are carried out to study the influence of strategy parameters, and the influence of strategy types on the driver’s and the automated system’s steering performance. It is found that when a driver interacts with an automated steering system using a cooperative Pareto steering strategy, the driver can improve his/her performance in following a target path through increasing his/her effort in pursuing his/her own interest under the driver-automation cooperative control goal. It is also found that a driver’s adoption of cooperative Pareto steering strategy leads to a reinforcement in the driver’s steering angle control, compared to the driver’s adoption of non-cooperative Nash strategy. This in turn enables the vehicle to return from a lane-change maneuver to straight-line driving swifter.
基金Project(61673233)supported by the National Natural Science Foundation of ChinaProject(D171100006417003)supported by Beijing Municipal Science and Technology Program,China
文摘Cooperative driving around intersections has aroused increasing interest in the last five years.Meanwhile,driving safety in non-signalized intersections has become an issue that has attracted attention globally.In view of the potential collision risk when more than three vehicles approach a non-signalized intersection from different directions,we propose a driving model using cooperative game theory.First,the characteristic functions of this model are primarily established on each vehicle’s profit function and include safety,rapidity and comfort indicators.Second,the Shapley theorem is adopted,and its group rationality,individual rationality,and uniqueness are proved to be suitable for the characteristic functions of the model.Following this,different drivers’characteristics are considered.In order to simplify the calculation process,a zero-mean normalization method is introduced.In addition,a genetic algorithm method is adopted to search an optimal strategy set in the constrained multi-objective optimization problem.Finally,the model is confirmed as valid after simulation with a series of initial conditions.
基金in part supported by the Ministry National Key Research and Development Project under Grant 2017YFE0121400the Major Project from Beijing Municipal Science and Technology Commission under Grant Z181100003218007the National Natural Science Foundation of China under Grants 61622101 and 61571020
文摘Autonomous driving is an emerging technology attracting interests from various sectors in recent years.Most of existing work treats autonomous vehicles as isolated individuals and has focused on developing separate intelligent modules.In this paper,we attempt to exploit the connectivity among vehicles and propose a systematic framework to develop autonomous driving techniques.We first introduce a general hierarchical information fusion framework for cooperative sensing to obtain global situational awareness for vehicles.Following this,a cooperative intelligence framework is proposed for autonomous driving systems.This general framework can guide the development of data collection,sharing and processing strategies to realize different intelligent functions in autonomous driving.
文摘At the 11th Forum on China-ASEAN Technology Transfer and Collaborative Innovation(hereinafter referred to as the China-ASEAN Innovation Forum)in July 2023,ASEAN Secretary-General Kao Kim Hourn highlighted the pivotal role of technology transfer and innovation in driving economic growth.He emphasized that technology transfer can assist China and ASEAN in bypassing traditional developmental stages.
基金supported by the National Natural Science Foundation of China under Grant 52172386the National Natural Science Foundation of China under Grant U22A20247+1 种基金the Jilin Province Science and Technology Development Plan Projects under Grant 20210101057JCthe Jilin Provincial Department of Science and Technology under Grant 20220301009GX.
文摘Intelligent vehicle(Ⅳ)technology has developed rapidly in recent years.However,achieving fully unmanned driving still presents numerous challenges,which means that human drivers will continue to play a vital role in vehicle operation for the foreseeable future.Human-machine shared driving,involving cooperation between a human driver and an automated driving system(AVS),has been widely regarded as a necessary stage for the development of IVs.Focusing onⅣdriving safety,this study proposed a human-machine shared lateral control strategy(HSLCS)based on the reliability of driver risk perception.The HSLCS starts by identifying the effective areas of driver risk perception based on eye movements.It establishes an anisotropic driving risk field,which serves as the foundation for the AVS to assess risk levels.Building upon the cumulative and diminishing effects of risk perception,the proposed approach leverages the driver's risk perception effective area and converts the risk field into a representation aligned with the driver's perspective.Subsequently,it quantifies the reliability of the driver's risk perception by using area-matching rules.Finally,based on the driver’s risk perception reliability and dif-ferences in lateral driving operation between the human driver and the AVS,the dynamic distribution of driving authority is achieved through a fuzzy rule-based system,and the human-machine shared lateral control is completed by using model predictive control.The HSLCS was tested across various scenarios on a driver-in-the-loop test platform.The results show that the HSLCS can realize the synergy and complementarity of human and machine intelligence,effectively ensuring the safety ofⅣoperation.
基金This work was supported by the National Natural Science Foundation of China(No.52272420)the Science and Technology Innovation Committee of Shenzhen(No.CJGJZD20200617102801005)the Tsinghua-Toyota Joint Research Institution.
文摘Cooperative driving is widely viewed as a promising method to better utilize limited road resources and alleviate traffic congestion.In recent years,several cooperative driving approaches for idealized traffic scenarios(i.e.,uniform vehicle arrivals,lengths,and speeds)have been proposed.However,theoretical analyses and comparisons of these approaches are lacking.In this study,we propose a unified group-by-group zipper-style movement model to describe different approaches synthetically and evaluate their performance.We derive the maximum throughput for cooperative driving plans of idealized unsignalized intersections and discuss how to minimize the delay of vehicles.The obtained conclusions shed light on future cooperative driving studies.
文摘The burden of schistosomiasis remains a global public health problem,especially in sub-Saharan Africa despite progress in terms of morbidity control.Successful control efforts achieved by China in the last six decades came with considerable experience and lessons that could benefit schistosomiasis control programs in other endemic countries.China's role and commitment to global health cooperation has become increasingly important;this has created a platform for partnership with developing partners for the establishment of Forum on China-Africa health cooperation which prioritizes the pursuit of global elimination target for schistosomiasis and malaria,control of HIV/AIDS,and improved access to reproductive health care.Chinese government's commitment towards achieving schistosomiasis elimination in Africa prompted the establishment of Institution-based Network on China-Africa Cooperation for Schistosomiasis Elimination (INCAS),by the National Institute of Parasitic Diseases to promote schistosomiasis elimination in Africa.Schistosomiasis experts from six provincial institutions and counterparts from 10 African countries participated in the first workshop on China-Africa cooperation for Schistosomiasis Elimination in Africa at Lilongwe,Malawi,in 2015.Experts at the inaugural meeting shared experiences from their national schistosomiasis control programs,as well as identified areas for collaborative synergy targeting schistosomiasis elimination in Africa.The establishment of INCAS,which comprises of 28 member-institutions from China and Africa,was proposed at this meeting.We,therefore,provide information on INCAS activities,cooperation mechanism,as well as assess the strengths,weaknesses,opportunities,and threats as we target schistosomiasis elimination in Africa using the INCAS platform.