Collision avoidance decision-making models of multiple agents in virtual driving environment are studied. Based on the behavioral characteristics and hierarchical structure of the collision avoidance decision-making i...Collision avoidance decision-making models of multiple agents in virtual driving environment are studied. Based on the behavioral characteristics and hierarchical structure of the collision avoidance decision-making in real life driving, delphi approach and mathematical statistics method are introduced to construct pair-wise comparison judgment matrix of collision avoidance decision choices to each collision situation. Analytic hierarchy process (AHP) is adopted to establish the agents' collision avoidance decision-making model. To simulate drivers' characteristics, driver factors are added to categorize driving modes into impatient mode, normal mode, and the cautious mode. The results show that this model can simulate human's thinking process, and the agents in the virtual environment can deal with collision situations and make decisions to avoid collisions without intervention. The model can also reflect diversity and uncertainly of real life driving behaviors, and solves the multi-objective, multi-choice ranking priority problem in multi-vehicle collision scenarios. This collision avoidance model of multi-agents model is feasible and effective, and can provide richer and closer-to-life virtual scene for driving simulator, reflecting real-life traffic environment more truly, this model can also promote the practicality of driving simulator.展开更多
Uncertain environment on multi-lane highway,e.g.,the stochastic lane-change maneuver of surrounding vehicles,is a big challenge for achieving safe automated highway driving.To improve the driving safety,a heuristic re...Uncertain environment on multi-lane highway,e.g.,the stochastic lane-change maneuver of surrounding vehicles,is a big challenge for achieving safe automated highway driving.To improve the driving safety,a heuristic reinforcement learning decision-making framework with integrated risk assessment is proposed.First,the framework includes a long short-term memory model to predict the trajectory of surrounding vehicles and a future integrated risk assessment model to estimate the possible driving risk.Second,a heuristic decaying state entropy deep reinforcement learning algorithm is introduced to address the exploration and exploitation dilemma of reinforcement learning.Finally,the framework also includes a rule-based vehicle decision model for interaction decision problems with surrounding vehicles.The proposed framework is validated in both low-density and high-density traffic scenarios.The results show that the traffic efficiency and vehicle safety are both improved compared to the common dueling double deep Q-Network method and rule-based method.展开更多
A gear position decision method used in automated mechanical transmission is introduced. The algorithm of the mechod is composed of a driving environment and driver's intention estimator, the shift schedules suit ...A gear position decision method used in automated mechanical transmission is introduced. The algorithm of the mechod is composed of a driving environment and driver's intention estimator, the shift schedules suit for each typical driving environment and driver's intention situation, and an inference ligic to determine the most proper gear position for the present situation. The estimator identifies the driving environment and driver's intention features which are divided into some typical models. Based on the identified results, the algorithm works out the best gear position. It just simulates the course of driver's making gear position decision when driving a automobile with manual transmission. The test results show that the automated mechanical transmission with the method gives less unnecessary shifting and more proper gear position than common shift schedules.展开更多
基金supported by National Basic Research Program (973 Program,No.2004CB719402)National Natural Science Foundation of China (No.60736019)Natural Science Foundation of Zhejiang Province, China(No.Y105430).
文摘Collision avoidance decision-making models of multiple agents in virtual driving environment are studied. Based on the behavioral characteristics and hierarchical structure of the collision avoidance decision-making in real life driving, delphi approach and mathematical statistics method are introduced to construct pair-wise comparison judgment matrix of collision avoidance decision choices to each collision situation. Analytic hierarchy process (AHP) is adopted to establish the agents' collision avoidance decision-making model. To simulate drivers' characteristics, driver factors are added to categorize driving modes into impatient mode, normal mode, and the cautious mode. The results show that this model can simulate human's thinking process, and the agents in the virtual environment can deal with collision situations and make decisions to avoid collisions without intervention. The model can also reflect diversity and uncertainly of real life driving behaviors, and solves the multi-objective, multi-choice ranking priority problem in multi-vehicle collision scenarios. This collision avoidance model of multi-agents model is feasible and effective, and can provide richer and closer-to-life virtual scene for driving simulator, reflecting real-life traffic environment more truly, this model can also promote the practicality of driving simulator.
基金support of the National Engineering Laboratory of High Mobility antiriot vehicle technology under Grant B20210017the National Natural Science Foundation of China under Grant 11672127+2 种基金the Fundamental Research Funds for the Central Universities under Grant NP2022408the Postgraduate Research&Practice Innovation Program of Jiangsu Province under Grant KYCX21_0188the Chinese Scholar Council under Grant 202106830118.
文摘Uncertain environment on multi-lane highway,e.g.,the stochastic lane-change maneuver of surrounding vehicles,is a big challenge for achieving safe automated highway driving.To improve the driving safety,a heuristic reinforcement learning decision-making framework with integrated risk assessment is proposed.First,the framework includes a long short-term memory model to predict the trajectory of surrounding vehicles and a future integrated risk assessment model to estimate the possible driving risk.Second,a heuristic decaying state entropy deep reinforcement learning algorithm is introduced to address the exploration and exploitation dilemma of reinforcement learning.Finally,the framework also includes a rule-based vehicle decision model for interaction decision problems with surrounding vehicles.The proposed framework is validated in both low-density and high-density traffic scenarios.The results show that the traffic efficiency and vehicle safety are both improved compared to the common dueling double deep Q-Network method and rule-based method.
文摘A gear position decision method used in automated mechanical transmission is introduced. The algorithm of the mechod is composed of a driving environment and driver's intention estimator, the shift schedules suit for each typical driving environment and driver's intention situation, and an inference ligic to determine the most proper gear position for the present situation. The estimator identifies the driving environment and driver's intention features which are divided into some typical models. Based on the identified results, the algorithm works out the best gear position. It just simulates the course of driver's making gear position decision when driving a automobile with manual transmission. The test results show that the automated mechanical transmission with the method gives less unnecessary shifting and more proper gear position than common shift schedules.