Decision-making and motion planning are extremely important in autonomous driving to ensure safe driving in a real-world environment.This study proposes an online evolutionary decision-making and motion planning frame...Decision-making and motion planning are extremely important in autonomous driving to ensure safe driving in a real-world environment.This study proposes an online evolutionary decision-making and motion planning framework for autonomous driving based on a hybrid data-and model-driven method.First,a data-driven decision-making module based on deep reinforcement learning(DRL)is developed to pursue a rational driving performance as much as possible.Then,model predictive control(MPC)is employed to execute both longitudinal and lateral motion planning tasks.Multiple constraints are defined according to the vehicle’s physical limit to meet the driving task requirements.Finally,two principles of safety and rationality for the self-evolution of autonomous driving are proposed.A motion envelope is established and embedded into a rational exploration and exploitation scheme,which filters out unreasonable experiences by masking unsafe actions so as to collect high-quality training data for the DRL agent.Experiments with a high-fidelity vehicle model and MATLAB/Simulink co-simulation environment are conducted,and the results show that the proposed online-evolution framework is able to generate safer,more rational,and more efficient driving action in a real-world environment.展开更多
This paper investigates the path-following control problem with obstacle avoidance of autonomous surface vehicles in the presence of actuator faults,uncertainty and external disturbances.Autonomous surface vehicles in...This paper investigates the path-following control problem with obstacle avoidance of autonomous surface vehicles in the presence of actuator faults,uncertainty and external disturbances.Autonomous surface vehicles inevitably suffer from actuator faults in complex sea environments,which may cause existing obstacle avoidance strategies to fail.To reduce the influence of actuator faults,an improved artificial potential function is constructed by introducing the lower bound of actuator efficiency factors.The nonlinear state observer,which only depends on measurable position information of the autonomous surface vehicle,is used to address uncertainties and external disturbances.By using a backstepping technique and adaptive mechanism,a path-following control strategy with obstacle avoidance and fault tolerance is designed which can ensure that the tracking errors converge to a small neighborhood of zero.Compared with existing results,the proposed control strategy has the capability of obstacle avoidance and fault tolerance simultaneously.Finally,the comparison results through simulations are given to verify the effectiveness of the proposed method.展开更多
As the complexity of autonomous vehicles(AVs)continues to increase and artificial intelligence algorithms are becoming increasingly ubiquitous,a novel safety concern known as the safety of the intended functionality(S...As the complexity of autonomous vehicles(AVs)continues to increase and artificial intelligence algorithms are becoming increasingly ubiquitous,a novel safety concern known as the safety of the intended functionality(SOTIF)has emerged,presenting significant challenges to the widespread deployment of AVs.SOTIF focuses on issues arising from the functional insufficiencies of the AVs’intended functionality or its implementation,apart from conventional safety considerations.From the systems engineering standpoint,this study offers a comprehensive exploration of the SOTIF landscape by reviewing academic research,practical activities,challenges,and perspectives across the development,verification,validation,and operation phases.Academic research encompasses system-level SOTIF studies and algorithm-related SOTIF issues and solutions.Moreover,it encapsulates practical SOTIF activities undertaken by corporations,government entities,and academic institutions spanning international and Chinese contexts,focusing on the overarching methodologies and practices in different phases.Finally,the paper presents future challenges and outlook pertaining to the development,verification,validation,and operation phases,motivating stakeholders to address the remaining obstacles and challenges.展开更多
While autonomous vehicles are vital components of intelligent transportation systems,ensuring the trustworthiness of decision-making remains a substantial challenge in realizing autonomous driving.Therefore,we present...While autonomous vehicles are vital components of intelligent transportation systems,ensuring the trustworthiness of decision-making remains a substantial challenge in realizing autonomous driving.Therefore,we present a novel robust reinforcement learning approach with safety guarantees to attain trustworthy decision-making for autonomous vehicles.The proposed technique ensures decision trustworthiness in terms of policy robustness and collision safety.Specifically,an adversary model is learned online to simulate the worst-case uncertainty by approximating the optimal adversarial perturbations on the observed states and environmental dynamics.In addition,an adversarial robust actor-critic algorithm is developed to enable the agent to learn robust policies against perturbations in observations and dynamics.Moreover,we devise a safety mask to guarantee the collision safety of the autonomous driving agent during both the training and testing processes using an interpretable knowledge model known as the Responsibility-Sensitive Safety Model.Finally,the proposed approach is evaluated through both simulations and experiments.These results indicate that the autonomous driving agent can make trustworthy decisions and drastically reduce the number of collisions through robust safety policies.展开更多
The attention is a scarce resource in decentralized autonomous organizations(DAOs),as their self-governance relies heavily on the attention-intensive decision-making process of“proposal and voting”.To prevent the ne...The attention is a scarce resource in decentralized autonomous organizations(DAOs),as their self-governance relies heavily on the attention-intensive decision-making process of“proposal and voting”.To prevent the negative effects of pro-posers’attention-capturing strategies that contribute to the“tragedy of the commons”and ensure an efficient distribution of attention among multiple proposals,it is necessary to establish a market-driven allocation scheme for DAOs’attention.First,the Harberger tax-based attention markets are designed to facilitate its allocation via continuous and automated trading,where the individualized Harberger tax rate(HTR)determined by the pro-posers’reputation is adopted.Then,the Stackelberg game model is formulated in these markets,casting attention to owners in the role of leaders and other competitive proposers as followers.Its equilibrium trading strategies are also discussed to unravel the intricate dynamics of attention pricing.Moreover,utilizing the single-round Stackelberg game as an illustrative example,the existence of Nash equilibrium trading strategies is demonstrated.Finally,the impact of individualized HTR on trading strategies is investigated,and results suggest that it has a negative correlation with leaders’self-accessed prices and ownership duration,but its effect on their revenues varies under different conditions.This study is expected to provide valuable insights into leveraging attention resources to improve DAOs’governance and decision-making process.展开更多
This study presents a general optimal trajectory planning(GOTP)framework for autonomous vehicles(AVs)that can effectively avoid obstacles and guide AVs to complete driving tasks safely and efficiently.Firstly,we emplo...This study presents a general optimal trajectory planning(GOTP)framework for autonomous vehicles(AVs)that can effectively avoid obstacles and guide AVs to complete driving tasks safely and efficiently.Firstly,we employ the fifth-order Bezier curve to generate and smooth the reference path along the road centerline.Cartesian coordinates are then transformed to achieve the curvature continuity of the generated curve.Considering the road constraints and vehicle dynamics,limited polynomial candidate trajectories are generated and smoothed in a curvilinear coordinate system.Furthermore,in selecting the optimal trajectory,we develop a unified and auto-tune objective function based on the principle of least action by employing AVs to simulate drivers’behavior and summarizing their manipulation characteristics of“seeking benefits and avoiding losses.”Finally,by integrating the idea of receding-horizon optimization,the proposed framework is achieved by considering dynamic multi-performance objectives and selecting trajectories that satisfy feasibility,optimality,and adaptability.Extensive simulations and experiments are performed,and the results demonstrate the framework’s feasibility and effectiveness,which avoids both dynamic and static obstacles and applies to various scenarios with multi-source interactive traffic participants.Moreover,we prove that the proposed method can guarantee real-time planning and safety requirements compared to drivers’manipulation.展开更多
A Rapid-exploration Random Tree(RRT)autonomous detection algorithm based on the multi-guide-node deflection strategy and Karto Simultaneous Localization and Mapping(SLAM)algorithm was proposed to solve the problems of...A Rapid-exploration Random Tree(RRT)autonomous detection algorithm based on the multi-guide-node deflection strategy and Karto Simultaneous Localization and Mapping(SLAM)algorithm was proposed to solve the problems of low efficiency of detecting frontier boundary points and drift distortion in the process of map building in the traditional RRT algorithm in the autonomous detection strategy of mobile robot.Firstly,an RRT global frontier boundary point detection algorithm based on the multi-guide-node deflection strategy was put forward,which introduces the reference value of guide nodes’deflection probability into the random sampling function so that the global search tree can detect frontier boundary points towards the guide nodes according to random probability.After that,a new autonomous detection algorithm for mobile robots was proposed by combining the graph optimization-based Karto SLAM algorithm with the previously improved RRT algorithm.The algorithm simulation platform based on the Gazebo platform was built.The simulation results show that compared with the traditional RRT algorithm,the proposed RRT autonomous detection algorithm can effectively reduce the time of autonomous detection,plan the length of detection trajectory under the condition of high average detection coverage,and complete the task of autonomous detection mapping more efficiently.Finally,with the help of the ROS-based mobile robot experimental platform,the performance of the proposed algorithm was verified in the real environment of different obstacles.The experimental results show that in the actual environment of simple and complex obstacles,the proposed RRT autonomous detection algorithm was superior to the traditional RRT autonomous detection algorithm in the time of detection,length of detection trajectory,and average coverage,thus improving the efficiency and accuracy of autonomous detection.展开更多
The 6th generation mobile networks(6G)network is a kind of multi-network interconnection and multi-scenario coexistence network,where multiple network domains break the original fixed boundaries to form connections an...The 6th generation mobile networks(6G)network is a kind of multi-network interconnection and multi-scenario coexistence network,where multiple network domains break the original fixed boundaries to form connections and convergence.In this paper,with the optimization objective of maximizing network utility while ensuring flows performance-centric weighted fairness,this paper designs a reinforcement learning-based cloud-edge autonomous multi-domain data center network architecture that achieves single-domain autonomy and multi-domain collaboration.Due to the conflict between the utility of different flows,the bandwidth fairness allocation problem for various types of flows is formulated by considering different defined reward functions.Regarding the tradeoff between fairness and utility,this paper deals with the corresponding reward functions for the cases where the flows undergo abrupt changes and smooth changes in the flows.In addition,to accommodate the Quality of Service(QoS)requirements for multiple types of flows,this paper proposes a multi-domain autonomous routing algorithm called LSTM+MADDPG.Introducing a Long Short-Term Memory(LSTM)layer in the actor and critic networks,more information about temporal continuity is added,further enhancing the adaptive ability changes in the dynamic network environment.The LSTM+MADDPG algorithm is compared with the latest reinforcement learning algorithm by conducting experiments on real network topology and traffic traces,and the experimental results show that LSTM+MADDPG improves the delay convergence speed by 14.6%and delays the start moment of packet loss by 18.2%compared with other algorithms.展开更多
Autonomous driving has witnessed rapid advancement;however,ensuring safe and efficient driving in intricate scenarios remains a critical challenge.In particular,traffic roundabouts bring a set of challenges to autonom...Autonomous driving has witnessed rapid advancement;however,ensuring safe and efficient driving in intricate scenarios remains a critical challenge.In particular,traffic roundabouts bring a set of challenges to autonomous driving due to the unpredictable entry and exit of vehicles,susceptibility to traffic flow bottlenecks,and imperfect data in perceiving environmental information,rendering them a vital issue in the practical application of autonomous driving.To address the traffic challenges,this work focused on complex roundabouts with multi-lane and proposed a Perception EnhancedDeepDeterministic Policy Gradient(PE-DDPG)for AutonomousDriving in the Roundabouts.Specifically,themodel incorporates an enhanced variational autoencoder featuring an integrated spatial attention mechanism alongside the Deep Deterministic Policy Gradient framework,enhancing the vehicle’s capability to comprehend complex roundabout environments and make decisions.Furthermore,the PE-DDPG model combines a dynamic path optimization strategy for roundabout scenarios,effectively mitigating traffic bottlenecks and augmenting throughput efficiency.Extensive experiments were conducted with the collaborative simulation platform of CARLA and SUMO,and the experimental results show that the proposed PE-DDPG outperforms the baseline methods in terms of the convergence capacity of the training process,the smoothness of driving and the traffic efficiency with diverse traffic flow patterns and penetration rates of autonomous vehicles(AVs).Generally,the proposed PE-DDPGmodel could be employed for autonomous driving in complex scenarios with imperfect data.展开更多
The development of ethnic minority tourism is currently a hot topic in domestic tourism development.As an important component of Chinese civilization,the Manchu people have created brilliant culture in the long river ...The development of ethnic minority tourism is currently a hot topic in domestic tourism development.As an important component of Chinese civilization,the Manchu people have created brilliant culture in the long river of historical development.As the hometown of the Manchu people,Fushun has unique folk cultural tourism resources and a strong ethnic flavor.Nowadays,under the promotion of the rural revitalization strategy,the construction of new rural areas is constantly developing,and rural tourism is gradually becoming a new industry.Therefore,in the context of the increasingly prosperous rural tourism industry,it has become increasingly important to combine the ethnic customs of Manchu culture with rural tourism.Taking the ethnic customs and integrated development of rural tourism in Xinbin Manchu Autonomous County of Fushun City,Liaoning Province as the research object,this paper mainly sorts out the current situation and characteristics of rural tourism development in the region,systematically explores the problems in development and how to further optimize development,and proposes new models suitable for the development of folk tourism in Xinbin of Fushun,in order to achieve maximum economic and social benefits and provide a reference for promoting the development of tourism in the region.展开更多
A photovoltaic (PV) string with multiple modules with bypass diodes frequently deployed on a variety of autonomous PV systems may present multiple power peaks under uneven shading. For optimal solar harvesting, there ...A photovoltaic (PV) string with multiple modules with bypass diodes frequently deployed on a variety of autonomous PV systems may present multiple power peaks under uneven shading. For optimal solar harvesting, there is a need for a control schema to force the PV string to operate at global maximum power point (GMPP). While a lot of tracking methods have been proposed in the literature, they are usually complex and do not fully take advantage of the available characteristics of the PV array. This work highlights how the voltage at operating point and the forward voltage of the bypass diode are considered to design a global maximum power point tracking (GMPPT) algorithm with a very limited global search phase called Fast GMPPT. This algorithm successfully tracks GMPP between 94% and 98% of the time under a theoretical evaluation. It is then compared against Perturb and Observe, Deterministic Particle Swarm Optimization, and Grey Wolf Optimization under a sequence of irradiance steps as well as a power-over-voltage characteristics profile that mimics the electrical characteristics of a PV string under varying partial shading conditions. Overall, the simulation with the sequence of irradiance steps shows that while Fast GMPPT does not have the best convergence time, it has an excellent convergence rate as well as causes the least amount of power loss during the global search phase. Experimental test under varying partial shading conditions shows that while the GMPPT proposal is simple and lightweight, it is very performant under a wide range of dynamically varying partial shading conditions and boasts the best energy efficiency (94.74%) out of the 4 tested algorithms.展开更多
This paper is concerned with the cooperative target tracking of multiple autonomous surface vehicles(ASVs)under switching interaction topologies.For the target to be tracked,only its position can be measured/received ...This paper is concerned with the cooperative target tracking of multiple autonomous surface vehicles(ASVs)under switching interaction topologies.For the target to be tracked,only its position can be measured/received by some of the ASVs,and its velocity is unavailable to all the ASVs.A distributed extended state observer taking into consideration switching topologies is designed to integrally estimate unknown target dynamics and neighboring ASVs'dynamics.Accordingly,a novel kinematic controller is designed,which takes full advantage of known information and avoids the approximation of some virtual control vectors.Moreover,a disturbance observer is presented to estimate unknown time-varying environmental disturbance.Furthermore,a distributed dynamic controller is designed to regulate the involved ASVs to cooperatively track the target.It enables each ASV to adjust its forces and moments according to the received information from its neighbors.The effectiveness of the derived results is demonstrated through cooperative target tracking performance analysis for a tracking system composed of five interacting ASVs.展开更多
Autonomous marine vehicles(AMVs)have received considerable attention in the past few decades,mainly because they play essential roles in broad marine applications such as environmental monitoring and resource explorat...Autonomous marine vehicles(AMVs)have received considerable attention in the past few decades,mainly because they play essential roles in broad marine applications such as environmental monitoring and resource exploration.Recent advances in the field of communication technologies,perception capability,computational power and advanced optimization algorithms have stimulated new interest in the development of AMVs.In order to deploy the constrained AMVs in the complex dynamic maritime environment,it is crucial to enhance the guidance and control capabilities through effective and practical planning,and control algorithms.Model predictive control(MPC)has been exceptionally successful in different fields due to its ability to systematically handle constraints while optimizing control performance.This paper aims to provide a review of recent progress in the context of motion planning and control for AMVs from the perceptive of MPC.Finally,future research trends and directions in this substantial research area of AMVs are highlighted.展开更多
The latest 6G improvements secured autonomous driving's realism in Intelligent Autonomous Transport Systems(IATS).Despite the IATS's benefits,security remains a significant challenge.Blockchain technology has ...The latest 6G improvements secured autonomous driving's realism in Intelligent Autonomous Transport Systems(IATS).Despite the IATS's benefits,security remains a significant challenge.Blockchain technology has grown in popularity as a means of implementing safe,dependable,and decentralised independent IATS systems,allowing for more utilisation of legacy IATS infrastructures and resources,which is especially advantageous for crowdsourcing technologies.Blockchain technology can be used to address security concerns in the IATS and to aid in logistics development.In light of the inadequacy of reliance and inattention to rights created by centralised and conventional logistics systems,this paper discusses the creation of a blockchain-based IATS powered by deep learning for secure cargo and vehicle matching(BDL-IATS).The BDL-IATS approach utilises Ethereum as the primary blockchain for storing private data such as order and shipment details.Additionally,the deep belief network(DBN)model is used to select suitable vehicles and goods for transportation.Additionally,the chaotic krill herd technique is used to tune the DBN model’s hyper-parameters.The performance of the BDL-IATS technique is validated,and the findings are inspected under a variety of conditions.The simulationfindings indicated that the BDL-IATS strategy outperformed recent state-of-the-art approaches.展开更多
Autonomous agents can explore the environment around them when equipped with advanced hardware and software systems that help intelligent agents minimize collisions.These systems are developed under the term Artificia...Autonomous agents can explore the environment around them when equipped with advanced hardware and software systems that help intelligent agents minimize collisions.These systems are developed under the term Artificial Intelligence(AI)safety.AI safety is essential to provide reliable service to consumers in various fields such asmilitary,education,healthcare,and automotive.This paper presents the design of an AI safety algorithmfor safe autonomous navigation using Reinforcement Learning(RL).Machine Learning Agents Toolkit(ML-Agents)was used to train the agentwith a proximal policy optimizer algorithmwith an intrinsic curiositymodule(PPO+ICM).This training aims to improve AI safety and minimize or prevent any mistakes that can cause dangerous collisions by the intelligent agent.Four experiments have been executed to validate the results of our research.The designed algorithmwas tested in a virtual environment with four differentmodels.A comparison was presented in four cases to identify the best-performing model for improvingAI safety.The designed algorithmenabled the intelligent agent to perform the required task safely using RL.A goal collision ratio of 64%was achieved,and the collision incidents were minimized from 134 to 52 in the virtual environment within 30min.展开更多
Implementing autonomous bus services in several cities has garnered substantial research attention worldwide.However,the benefits and challenges of this emerging mode remain insufficiently understood.Consequently,VOSv...Implementing autonomous bus services in several cities has garnered substantial research attention worldwide.However,the benefits and challenges of this emerging mode remain insufficiently understood.Consequently,VOSviewer was employed for a bibliometric analysis involving 300 publications,investigating the associations among authors,journals,and keywords.Subsequently,we comprehensively reviewed the current state of research on two topics and proposed future recommendations.Results indicate that the first document related to autonomous bus services was published in 2009.Most user attitude-related research data are obtained via questionnaires and analyzed using statistical techniques.Autonomous bus services are expected to benefit passengers regarding travel time,cost,safety,etc.,while passenger preferences are inconsistent.However,integrating the service into existing bus systems requires careful consideration of the schedule sequences.Notably,modular autonomous bus services present a new opportunity for the further optimization of bus services.In future studies,standardized data acquisition procedures should be developed to achieve comparable results.Regarding traveler choice behavior,the effect of specific autonomous bus service policies over time and the heterogeneity due to cultural or social contexts across regions should be assessed.To further promote autonomous bus services,based on fluctuating travel demands,the effects of vehicle capacity,speed,and cost of fleet composition should be evaluated comprehensively to optimize the bus network and schedule sequence.Owing to the protracted nature of the transition from conventional to fully autonomous buses,one should prioritize semi-autonomous bus services.Another essential future research direction is to integrate modular autonomous bus assembly or disassembly strategies with different fine-grained operation optimization techniques in various scenarios.展开更多
BACKGROUND^(14)C urea breath test(^(14)C UBT)and immunohistochemical staining(IHC)are widely used for detection Helicobacter pylori(H.pylori)infection with different sensitivity,and there is a difference in H.pylori i...BACKGROUND^(14)C urea breath test(^(14)C UBT)and immunohistochemical staining(IHC)are widely used for detection Helicobacter pylori(H.pylori)infection with different sensitivity,and there is a difference in H.pylori infection rate in Uyghur and Han ethnic groups.Both need large cohort studies to evaluate the differences more accurately.AIM To analyze the difference between^(14)C UBT and IHC for H.pylori detection in Xinjiang Uyghur Autonomous Region and the difference between Uyghur and Han populations.METHODS There were 3944 cases of H.pylori infection detected by both IHC and^(14)C UBT at the same time(interval<1 wk,with sampling site including gastric antrum,selected from 5747 patients).We compared the sensitivity of^(14)C UBT and IHC.We also compared 555 pairs of Han/Uyghur cases(completely matched for gender and age)for their H.pylori infection rates.The overall H.pylori infection rate of all 5747 cases and the correlation with other clinicopathological data were also further analyzed.SPSS V23.0 software was used for statistical analysis.RESULTS The sensitivity was 94.9%for^(14)C UBT and 65.1%for IHC,which was a significant difference(n=3944,P<0.001).However,among those cases negative for H.pylori by^(14)C UBT(detection value≤100),4.8%were positive by IHC.Combining both methods,the overall H.pylori infection rate was 48.6%(n=5747),and differences in gender,age group,ethnicity and region of residence significantly affected the H.pylori positive rates.According to age group(Han/Uyghur),the positive rates were≤30 years(62.2%/100.0%),31-40 years(45.2%/85.7%),41-50 years(47.2%/79.2%),51-60 years(44.6%/76.1%),61-70 years(40.9%/68.2%),71-80 years(41.7%/54.1%)and≥81 years(42.9%/NA).The H.pylori infection rates of Han/Uyghur paired cases were 41.4%and 73.3%,which was a significant difference(P<0.001)(555 pairs).H.pylori positivity was significantly related to moderate-severe grade 2-3 chronic/active gastritis and intestinal metaplasia(all P<0.05).CONCLUSION The sensitivity of^(14)C UBT was significantly higher,but combined application can still increase the accuracy.The prevention H.pylori should be emphasized for Uygur and young people.展开更多
With the maturation of autonomous driving technology, the use of autonomous vehicles in a socially acceptable manner has become a growing demand of the public. Human-like autonomous driving is expected due to the impa...With the maturation of autonomous driving technology, the use of autonomous vehicles in a socially acceptable manner has become a growing demand of the public. Human-like autonomous driving is expected due to the impact of the differences between autonomous vehicles and human drivers on safety.Although human-like decision-making has become a research hotspot, a unified theory has not yet been formed, and there are significant differences in the implementation and performance of existing methods. This paper provides a comprehensive overview of human-like decision-making for autonomous vehicles. The following issues are discussed: 1) The intelligence level of most autonomous driving decision-making algorithms;2) The driving datasets and simulation platforms for testing and verifying human-like decision-making;3) The evaluation metrics of human-likeness;personalized driving;the application of decisionmaking in real traffic scenarios;and 4) The potential research direction of human-like driving. These research results are significant for creating interpretable human-like driving models and applying them in dynamic traffic scenarios. In the future, the combination of intuitive logical reasoning and hierarchical structure will be an important topic for further research. It is expected to meet the needs of human-like driving.展开更多
This paper investigates the problem of path tracking control for autonomous ground vehicles(AGVs),where the input saturation,system nonlinearities and uncertainties are considered.Firstly,the nonlinear path tracking s...This paper investigates the problem of path tracking control for autonomous ground vehicles(AGVs),where the input saturation,system nonlinearities and uncertainties are considered.Firstly,the nonlinear path tracking system is formulated as a linear parameter varying(LPV)model where the variation of vehicle velocity is taken into account.Secondly,considering the noise effects on the measurement of lateral offset and heading angle,an observer-based control strategy is proposed,and by analyzing the frequency domain characteristics of the derivative of desired heading angle,a finite frequency H_∞index is proposed to attenuate the effects of the derivative of desired heading angle on path tracking error.Thirdly,sufficient conditions are derived to guarantee robust H_∞performance of the path tracking system,and the calculation of observer and controller gains is converted into solving a convex optimization problem.Finally,simulation examples verify the advantages of the control method proposed in this paper.展开更多
Model predictive control is widely used in the design of autonomous driving algorithms.However,its parameters are sensitive to dynamically varying driving conditions,making it difficult to be implemented into practice...Model predictive control is widely used in the design of autonomous driving algorithms.However,its parameters are sensitive to dynamically varying driving conditions,making it difficult to be implemented into practice.As a result,this study presents a self-learning algorithm based on reinforcement learning to tune a model predictive controller.Specifically,the proposed algorithm is used to extract features of dynamic traffic scenes and adjust the weight coefficients of the model predictive controller.In this method,a risk threshold model is proposed to classify the risk level of the scenes based on the scene features,and aid in the design of the reinforcement learning reward function and ultimately improve the adaptability of the model predictive controller to real-world scenarios.The proposed algorithm is compared to a pure model predictive controller in car-following case.According to the results,the proposed method enables autonomous vehicles to adjust the priority of performance indices reasonably in different scenarios according to risk variations,showing a good scenario adaptability with safety guaranteed.展开更多
基金the financial support of the National Key Research and Development Program of China(2020AAA0108100)the Shanghai Municipal Science and Technology Major Project(2021SHZDZX0100)the Shanghai Gaofeng and Gaoyuan Project for University Academic Program Development for funding。
文摘Decision-making and motion planning are extremely important in autonomous driving to ensure safe driving in a real-world environment.This study proposes an online evolutionary decision-making and motion planning framework for autonomous driving based on a hybrid data-and model-driven method.First,a data-driven decision-making module based on deep reinforcement learning(DRL)is developed to pursue a rational driving performance as much as possible.Then,model predictive control(MPC)is employed to execute both longitudinal and lateral motion planning tasks.Multiple constraints are defined according to the vehicle’s physical limit to meet the driving task requirements.Finally,two principles of safety and rationality for the self-evolution of autonomous driving are proposed.A motion envelope is established and embedded into a rational exploration and exploitation scheme,which filters out unreasonable experiences by masking unsafe actions so as to collect high-quality training data for the DRL agent.Experiments with a high-fidelity vehicle model and MATLAB/Simulink co-simulation environment are conducted,and the results show that the proposed online-evolution framework is able to generate safer,more rational,and more efficient driving action in a real-world environment.
基金the National Natural Science Foundation of China(51939001,52171292,51979020,61976033)Dalian Outstanding Young Talents Program(2022RJ05)+1 种基金the Topnotch Young Talents Program of China(36261402)the Liaoning Revitalization Talents Program(XLYC20-07188)。
文摘This paper investigates the path-following control problem with obstacle avoidance of autonomous surface vehicles in the presence of actuator faults,uncertainty and external disturbances.Autonomous surface vehicles inevitably suffer from actuator faults in complex sea environments,which may cause existing obstacle avoidance strategies to fail.To reduce the influence of actuator faults,an improved artificial potential function is constructed by introducing the lower bound of actuator efficiency factors.The nonlinear state observer,which only depends on measurable position information of the autonomous surface vehicle,is used to address uncertainties and external disturbances.By using a backstepping technique and adaptive mechanism,a path-following control strategy with obstacle avoidance and fault tolerance is designed which can ensure that the tracking errors converge to a small neighborhood of zero.Compared with existing results,the proposed control strategy has the capability of obstacle avoidance and fault tolerance simultaneously.Finally,the comparison results through simulations are given to verify the effectiveness of the proposed method.
基金supported by the National Science Foundation of China Project(52072215,U1964203,52242213,and 52221005)National Key Research and Development(R&D)Program of China(2022YFB2503003)State Key Laboratory of Intelligent Green Vehicle and Mobility。
文摘As the complexity of autonomous vehicles(AVs)continues to increase and artificial intelligence algorithms are becoming increasingly ubiquitous,a novel safety concern known as the safety of the intended functionality(SOTIF)has emerged,presenting significant challenges to the widespread deployment of AVs.SOTIF focuses on issues arising from the functional insufficiencies of the AVs’intended functionality or its implementation,apart from conventional safety considerations.From the systems engineering standpoint,this study offers a comprehensive exploration of the SOTIF landscape by reviewing academic research,practical activities,challenges,and perspectives across the development,verification,validation,and operation phases.Academic research encompasses system-level SOTIF studies and algorithm-related SOTIF issues and solutions.Moreover,it encapsulates practical SOTIF activities undertaken by corporations,government entities,and academic institutions spanning international and Chinese contexts,focusing on the overarching methodologies and practices in different phases.Finally,the paper presents future challenges and outlook pertaining to the development,verification,validation,and operation phases,motivating stakeholders to address the remaining obstacles and challenges.
基金supported in part by the Start-Up Grant-Nanyang Assistant Professorship Grant of Nanyang Technological Universitythe Agency for Science,Technology and Research(A*STAR)under Advanced Manufacturing and Engineering(AME)Young Individual Research under Grant(A2084c0156)+2 种基金the MTC Individual Research Grant(M22K2c0079)the ANR-NRF Joint Grant(NRF2021-NRF-ANR003 HM Science)the Ministry of Education(MOE)under the Tier 2 Grant(MOE-T2EP50222-0002)。
文摘While autonomous vehicles are vital components of intelligent transportation systems,ensuring the trustworthiness of decision-making remains a substantial challenge in realizing autonomous driving.Therefore,we present a novel robust reinforcement learning approach with safety guarantees to attain trustworthy decision-making for autonomous vehicles.The proposed technique ensures decision trustworthiness in terms of policy robustness and collision safety.Specifically,an adversary model is learned online to simulate the worst-case uncertainty by approximating the optimal adversarial perturbations on the observed states and environmental dynamics.In addition,an adversarial robust actor-critic algorithm is developed to enable the agent to learn robust policies against perturbations in observations and dynamics.Moreover,we devise a safety mask to guarantee the collision safety of the autonomous driving agent during both the training and testing processes using an interpretable knowledge model known as the Responsibility-Sensitive Safety Model.Finally,the proposed approach is evaluated through both simulations and experiments.These results indicate that the autonomous driving agent can make trustworthy decisions and drastically reduce the number of collisions through robust safety policies.
基金supported by the National Natural Science Foundation of China(62103411)the Science and Technology Development Fund of Macao SAR(0093/2023/RIA2,0050/2020/A1)。
文摘The attention is a scarce resource in decentralized autonomous organizations(DAOs),as their self-governance relies heavily on the attention-intensive decision-making process of“proposal and voting”.To prevent the negative effects of pro-posers’attention-capturing strategies that contribute to the“tragedy of the commons”and ensure an efficient distribution of attention among multiple proposals,it is necessary to establish a market-driven allocation scheme for DAOs’attention.First,the Harberger tax-based attention markets are designed to facilitate its allocation via continuous and automated trading,where the individualized Harberger tax rate(HTR)determined by the pro-posers’reputation is adopted.Then,the Stackelberg game model is formulated in these markets,casting attention to owners in the role of leaders and other competitive proposers as followers.Its equilibrium trading strategies are also discussed to unravel the intricate dynamics of attention pricing.Moreover,utilizing the single-round Stackelberg game as an illustrative example,the existence of Nash equilibrium trading strategies is demonstrated.Finally,the impact of individualized HTR on trading strategies is investigated,and results suggest that it has a negative correlation with leaders’self-accessed prices and ownership duration,but its effect on their revenues varies under different conditions.This study is expected to provide valuable insights into leveraging attention resources to improve DAOs’governance and decision-making process.
基金supported by the National Natural Science Foundation of China(the Key Project,52131201Science Fund for Creative Research Groups,52221005)+1 种基金the China Scholarship Councilthe Joint Laboratory for Internet of Vehicles,Ministry of Education–China MOBILE Communications Corporation。
文摘This study presents a general optimal trajectory planning(GOTP)framework for autonomous vehicles(AVs)that can effectively avoid obstacles and guide AVs to complete driving tasks safely and efficiently.Firstly,we employ the fifth-order Bezier curve to generate and smooth the reference path along the road centerline.Cartesian coordinates are then transformed to achieve the curvature continuity of the generated curve.Considering the road constraints and vehicle dynamics,limited polynomial candidate trajectories are generated and smoothed in a curvilinear coordinate system.Furthermore,in selecting the optimal trajectory,we develop a unified and auto-tune objective function based on the principle of least action by employing AVs to simulate drivers’behavior and summarizing their manipulation characteristics of“seeking benefits and avoiding losses.”Finally,by integrating the idea of receding-horizon optimization,the proposed framework is achieved by considering dynamic multi-performance objectives and selecting trajectories that satisfy feasibility,optimality,and adaptability.Extensive simulations and experiments are performed,and the results demonstrate the framework’s feasibility and effectiveness,which avoids both dynamic and static obstacles and applies to various scenarios with multi-source interactive traffic participants.Moreover,we prove that the proposed method can guarantee real-time planning and safety requirements compared to drivers’manipulation.
基金This research was funded by National Natural Science Foundation of China(No.62063006)Guangxi Science and Technology Major Program(No.2022AA05002)+2 种基金Key Laboratory of AI and Information Processing(Hechi University),Education Department of Guangxi Zhuang Autonomous Region(No.2022GXZDSY003)Guangxi Key Laboratory of Spatial Information and Geomatics(Guilin University of Technology)(No.21-238-21-16)Innovation Project of Guangxi Graduate Education(No.YCSW2023352).
文摘A Rapid-exploration Random Tree(RRT)autonomous detection algorithm based on the multi-guide-node deflection strategy and Karto Simultaneous Localization and Mapping(SLAM)algorithm was proposed to solve the problems of low efficiency of detecting frontier boundary points and drift distortion in the process of map building in the traditional RRT algorithm in the autonomous detection strategy of mobile robot.Firstly,an RRT global frontier boundary point detection algorithm based on the multi-guide-node deflection strategy was put forward,which introduces the reference value of guide nodes’deflection probability into the random sampling function so that the global search tree can detect frontier boundary points towards the guide nodes according to random probability.After that,a new autonomous detection algorithm for mobile robots was proposed by combining the graph optimization-based Karto SLAM algorithm with the previously improved RRT algorithm.The algorithm simulation platform based on the Gazebo platform was built.The simulation results show that compared with the traditional RRT algorithm,the proposed RRT autonomous detection algorithm can effectively reduce the time of autonomous detection,plan the length of detection trajectory under the condition of high average detection coverage,and complete the task of autonomous detection mapping more efficiently.Finally,with the help of the ROS-based mobile robot experimental platform,the performance of the proposed algorithm was verified in the real environment of different obstacles.The experimental results show that in the actual environment of simple and complex obstacles,the proposed RRT autonomous detection algorithm was superior to the traditional RRT autonomous detection algorithm in the time of detection,length of detection trajectory,and average coverage,thus improving the efficiency and accuracy of autonomous detection.
文摘The 6th generation mobile networks(6G)network is a kind of multi-network interconnection and multi-scenario coexistence network,where multiple network domains break the original fixed boundaries to form connections and convergence.In this paper,with the optimization objective of maximizing network utility while ensuring flows performance-centric weighted fairness,this paper designs a reinforcement learning-based cloud-edge autonomous multi-domain data center network architecture that achieves single-domain autonomy and multi-domain collaboration.Due to the conflict between the utility of different flows,the bandwidth fairness allocation problem for various types of flows is formulated by considering different defined reward functions.Regarding the tradeoff between fairness and utility,this paper deals with the corresponding reward functions for the cases where the flows undergo abrupt changes and smooth changes in the flows.In addition,to accommodate the Quality of Service(QoS)requirements for multiple types of flows,this paper proposes a multi-domain autonomous routing algorithm called LSTM+MADDPG.Introducing a Long Short-Term Memory(LSTM)layer in the actor and critic networks,more information about temporal continuity is added,further enhancing the adaptive ability changes in the dynamic network environment.The LSTM+MADDPG algorithm is compared with the latest reinforcement learning algorithm by conducting experiments on real network topology and traffic traces,and the experimental results show that LSTM+MADDPG improves the delay convergence speed by 14.6%and delays the start moment of packet loss by 18.2%compared with other algorithms.
基金supported in part by the projects of the National Natural Science Foundation of China(62376059,41971340)Fujian Provincial Department of Science and Technology(2023XQ008,2023I0024,2021Y4019),Fujian Provincial Department of Finance(GY-Z230007,GYZ23012)Fujian Key Laboratory of Automotive Electronics and Electric Drive(KF-19-22001).
文摘Autonomous driving has witnessed rapid advancement;however,ensuring safe and efficient driving in intricate scenarios remains a critical challenge.In particular,traffic roundabouts bring a set of challenges to autonomous driving due to the unpredictable entry and exit of vehicles,susceptibility to traffic flow bottlenecks,and imperfect data in perceiving environmental information,rendering them a vital issue in the practical application of autonomous driving.To address the traffic challenges,this work focused on complex roundabouts with multi-lane and proposed a Perception EnhancedDeepDeterministic Policy Gradient(PE-DDPG)for AutonomousDriving in the Roundabouts.Specifically,themodel incorporates an enhanced variational autoencoder featuring an integrated spatial attention mechanism alongside the Deep Deterministic Policy Gradient framework,enhancing the vehicle’s capability to comprehend complex roundabout environments and make decisions.Furthermore,the PE-DDPG model combines a dynamic path optimization strategy for roundabout scenarios,effectively mitigating traffic bottlenecks and augmenting throughput efficiency.Extensive experiments were conducted with the collaborative simulation platform of CARLA and SUMO,and the experimental results show that the proposed PE-DDPG outperforms the baseline methods in terms of the convergence capacity of the training process,the smoothness of driving and the traffic efficiency with diverse traffic flow patterns and penetration rates of autonomous vehicles(AVs).Generally,the proposed PE-DDPGmodel could be employed for autonomous driving in complex scenarios with imperfect data.
文摘The development of ethnic minority tourism is currently a hot topic in domestic tourism development.As an important component of Chinese civilization,the Manchu people have created brilliant culture in the long river of historical development.As the hometown of the Manchu people,Fushun has unique folk cultural tourism resources and a strong ethnic flavor.Nowadays,under the promotion of the rural revitalization strategy,the construction of new rural areas is constantly developing,and rural tourism is gradually becoming a new industry.Therefore,in the context of the increasingly prosperous rural tourism industry,it has become increasingly important to combine the ethnic customs of Manchu culture with rural tourism.Taking the ethnic customs and integrated development of rural tourism in Xinbin Manchu Autonomous County of Fushun City,Liaoning Province as the research object,this paper mainly sorts out the current situation and characteristics of rural tourism development in the region,systematically explores the problems in development and how to further optimize development,and proposes new models suitable for the development of folk tourism in Xinbin of Fushun,in order to achieve maximum economic and social benefits and provide a reference for promoting the development of tourism in the region.
文摘A photovoltaic (PV) string with multiple modules with bypass diodes frequently deployed on a variety of autonomous PV systems may present multiple power peaks under uneven shading. For optimal solar harvesting, there is a need for a control schema to force the PV string to operate at global maximum power point (GMPP). While a lot of tracking methods have been proposed in the literature, they are usually complex and do not fully take advantage of the available characteristics of the PV array. This work highlights how the voltage at operating point and the forward voltage of the bypass diode are considered to design a global maximum power point tracking (GMPPT) algorithm with a very limited global search phase called Fast GMPPT. This algorithm successfully tracks GMPP between 94% and 98% of the time under a theoretical evaluation. It is then compared against Perturb and Observe, Deterministic Particle Swarm Optimization, and Grey Wolf Optimization under a sequence of irradiance steps as well as a power-over-voltage characteristics profile that mimics the electrical characteristics of a PV string under varying partial shading conditions. Overall, the simulation with the sequence of irradiance steps shows that while Fast GMPPT does not have the best convergence time, it has an excellent convergence rate as well as causes the least amount of power loss during the global search phase. Experimental test under varying partial shading conditions shows that while the GMPPT proposal is simple and lightweight, it is very performant under a wide range of dynamically varying partial shading conditions and boasts the best energy efficiency (94.74%) out of the 4 tested algorithms.
基金supported in part by the National Science Foundation of China(61873335,61833011)the Project of Scie nce and Technology Commission of Shanghai Municipality,China(20ZR1420200,21SQBS01600,19510750300,21190780300)。
文摘This paper is concerned with the cooperative target tracking of multiple autonomous surface vehicles(ASVs)under switching interaction topologies.For the target to be tracked,only its position can be measured/received by some of the ASVs,and its velocity is unavailable to all the ASVs.A distributed extended state observer taking into consideration switching topologies is designed to integrally estimate unknown target dynamics and neighboring ASVs'dynamics.Accordingly,a novel kinematic controller is designed,which takes full advantage of known information and avoids the approximation of some virtual control vectors.Moreover,a disturbance observer is presented to estimate unknown time-varying environmental disturbance.Furthermore,a distributed dynamic controller is designed to regulate the involved ASVs to cooperatively track the target.It enables each ASV to adjust its forces and moments according to the received information from its neighbors.The effectiveness of the derived results is demonstrated through cooperative target tracking performance analysis for a tracking system composed of five interacting ASVs.
基金supported by the Natural Sciences and Engineering Research Council of Canada(NSERC)。
文摘Autonomous marine vehicles(AMVs)have received considerable attention in the past few decades,mainly because they play essential roles in broad marine applications such as environmental monitoring and resource exploration.Recent advances in the field of communication technologies,perception capability,computational power and advanced optimization algorithms have stimulated new interest in the development of AMVs.In order to deploy the constrained AMVs in the complex dynamic maritime environment,it is crucial to enhance the guidance and control capabilities through effective and practical planning,and control algorithms.Model predictive control(MPC)has been exceptionally successful in different fields due to its ability to systematically handle constraints while optimizing control performance.This paper aims to provide a review of recent progress in the context of motion planning and control for AMVs from the perceptive of MPC.Finally,future research trends and directions in this substantial research area of AMVs are highlighted.
文摘The latest 6G improvements secured autonomous driving's realism in Intelligent Autonomous Transport Systems(IATS).Despite the IATS's benefits,security remains a significant challenge.Blockchain technology has grown in popularity as a means of implementing safe,dependable,and decentralised independent IATS systems,allowing for more utilisation of legacy IATS infrastructures and resources,which is especially advantageous for crowdsourcing technologies.Blockchain technology can be used to address security concerns in the IATS and to aid in logistics development.In light of the inadequacy of reliance and inattention to rights created by centralised and conventional logistics systems,this paper discusses the creation of a blockchain-based IATS powered by deep learning for secure cargo and vehicle matching(BDL-IATS).The BDL-IATS approach utilises Ethereum as the primary blockchain for storing private data such as order and shipment details.Additionally,the deep belief network(DBN)model is used to select suitable vehicles and goods for transportation.Additionally,the chaotic krill herd technique is used to tune the DBN model’s hyper-parameters.The performance of the BDL-IATS technique is validated,and the findings are inspected under a variety of conditions.The simulationfindings indicated that the BDL-IATS strategy outperformed recent state-of-the-art approaches.
基金the United States Air Force Office of Scientific Research(AFOSR)contract FA9550-22-1-0268 awarded to KHA,https://www.afrl.af.mil/AFOSR/.The contract is entitled:“Investigating Improving Safety of Autonomous Exploring Intelligent Agents with Human-in-the-Loop Reinforcement Learning,”and in part by Jackson State University.
文摘Autonomous agents can explore the environment around them when equipped with advanced hardware and software systems that help intelligent agents minimize collisions.These systems are developed under the term Artificial Intelligence(AI)safety.AI safety is essential to provide reliable service to consumers in various fields such asmilitary,education,healthcare,and automotive.This paper presents the design of an AI safety algorithmfor safe autonomous navigation using Reinforcement Learning(RL).Machine Learning Agents Toolkit(ML-Agents)was used to train the agentwith a proximal policy optimizer algorithmwith an intrinsic curiositymodule(PPO+ICM).This training aims to improve AI safety and minimize or prevent any mistakes that can cause dangerous collisions by the intelligent agent.Four experiments have been executed to validate the results of our research.The designed algorithmwas tested in a virtual environment with four differentmodels.A comparison was presented in four cases to identify the best-performing model for improvingAI safety.The designed algorithmenabled the intelligent agent to perform the required task safely using RL.A goal collision ratio of 64%was achieved,and the collision incidents were minimized from 134 to 52 in the virtual environment within 30min.
基金supported by the Natural Science Foundation of China(No.51808187,No.52062027)the Key Research and Development Project of Gansu Province(No.22YF7GA142)+2 种基金Soft Science Special Project of Gansu Basic Research PIan(No.22JR4ZA035)Gansu Provincial Science and Technology Major Special Project-Enterprise Innovation Consortium Project(No.21ZD3GA002,No.22ZD6GA010)Lanzhou Jiaotong University Basic Research Top Talents Training Program(No.2022JC02).
文摘Implementing autonomous bus services in several cities has garnered substantial research attention worldwide.However,the benefits and challenges of this emerging mode remain insufficiently understood.Consequently,VOSviewer was employed for a bibliometric analysis involving 300 publications,investigating the associations among authors,journals,and keywords.Subsequently,we comprehensively reviewed the current state of research on two topics and proposed future recommendations.Results indicate that the first document related to autonomous bus services was published in 2009.Most user attitude-related research data are obtained via questionnaires and analyzed using statistical techniques.Autonomous bus services are expected to benefit passengers regarding travel time,cost,safety,etc.,while passenger preferences are inconsistent.However,integrating the service into existing bus systems requires careful consideration of the schedule sequences.Notably,modular autonomous bus services present a new opportunity for the further optimization of bus services.In future studies,standardized data acquisition procedures should be developed to achieve comparable results.Regarding traveler choice behavior,the effect of specific autonomous bus service policies over time and the heterogeneity due to cultural or social contexts across regions should be assessed.To further promote autonomous bus services,based on fluctuating travel demands,the effects of vehicle capacity,speed,and cost of fleet composition should be evaluated comprehensively to optimize the bus network and schedule sequence.Owing to the protracted nature of the transition from conventional to fully autonomous buses,one should prioritize semi-autonomous bus services.Another essential future research direction is to integrate modular autonomous bus assembly or disassembly strategies with different fine-grained operation optimization techniques in various scenarios.
文摘BACKGROUND^(14)C urea breath test(^(14)C UBT)and immunohistochemical staining(IHC)are widely used for detection Helicobacter pylori(H.pylori)infection with different sensitivity,and there is a difference in H.pylori infection rate in Uyghur and Han ethnic groups.Both need large cohort studies to evaluate the differences more accurately.AIM To analyze the difference between^(14)C UBT and IHC for H.pylori detection in Xinjiang Uyghur Autonomous Region and the difference between Uyghur and Han populations.METHODS There were 3944 cases of H.pylori infection detected by both IHC and^(14)C UBT at the same time(interval<1 wk,with sampling site including gastric antrum,selected from 5747 patients).We compared the sensitivity of^(14)C UBT and IHC.We also compared 555 pairs of Han/Uyghur cases(completely matched for gender and age)for their H.pylori infection rates.The overall H.pylori infection rate of all 5747 cases and the correlation with other clinicopathological data were also further analyzed.SPSS V23.0 software was used for statistical analysis.RESULTS The sensitivity was 94.9%for^(14)C UBT and 65.1%for IHC,which was a significant difference(n=3944,P<0.001).However,among those cases negative for H.pylori by^(14)C UBT(detection value≤100),4.8%were positive by IHC.Combining both methods,the overall H.pylori infection rate was 48.6%(n=5747),and differences in gender,age group,ethnicity and region of residence significantly affected the H.pylori positive rates.According to age group(Han/Uyghur),the positive rates were≤30 years(62.2%/100.0%),31-40 years(45.2%/85.7%),41-50 years(47.2%/79.2%),51-60 years(44.6%/76.1%),61-70 years(40.9%/68.2%),71-80 years(41.7%/54.1%)and≥81 years(42.9%/NA).The H.pylori infection rates of Han/Uyghur paired cases were 41.4%and 73.3%,which was a significant difference(P<0.001)(555 pairs).H.pylori positivity was significantly related to moderate-severe grade 2-3 chronic/active gastritis and intestinal metaplasia(all P<0.05).CONCLUSION The sensitivity of^(14)C UBT was significantly higher,but combined application can still increase the accuracy.The prevention H.pylori should be emphasized for Uygur and young people.
基金supported by the National Key R&D Program of China (2022YFB2502900)the National Natural Science Foundation of China (62088102, 61790563)。
文摘With the maturation of autonomous driving technology, the use of autonomous vehicles in a socially acceptable manner has become a growing demand of the public. Human-like autonomous driving is expected due to the impact of the differences between autonomous vehicles and human drivers on safety.Although human-like decision-making has become a research hotspot, a unified theory has not yet been formed, and there are significant differences in the implementation and performance of existing methods. This paper provides a comprehensive overview of human-like decision-making for autonomous vehicles. The following issues are discussed: 1) The intelligence level of most autonomous driving decision-making algorithms;2) The driving datasets and simulation platforms for testing and verifying human-like decision-making;3) The evaluation metrics of human-likeness;personalized driving;the application of decisionmaking in real traffic scenarios;and 4) The potential research direction of human-like driving. These research results are significant for creating interpretable human-like driving models and applying them in dynamic traffic scenarios. In the future, the combination of intuitive logical reasoning and hierarchical structure will be an important topic for further research. It is expected to meet the needs of human-like driving.
基金supported by the National Natural Science Foundation of China(62173029,62273033,U20A20225)the Fundamental Research Funds for the Central Universities,China(FRF-BD-19-002A)。
文摘This paper investigates the problem of path tracking control for autonomous ground vehicles(AGVs),where the input saturation,system nonlinearities and uncertainties are considered.Firstly,the nonlinear path tracking system is formulated as a linear parameter varying(LPV)model where the variation of vehicle velocity is taken into account.Secondly,considering the noise effects on the measurement of lateral offset and heading angle,an observer-based control strategy is proposed,and by analyzing the frequency domain characteristics of the derivative of desired heading angle,a finite frequency H_∞index is proposed to attenuate the effects of the derivative of desired heading angle on path tracking error.Thirdly,sufficient conditions are derived to guarantee robust H_∞performance of the path tracking system,and the calculation of observer and controller gains is converted into solving a convex optimization problem.Finally,simulation examples verify the advantages of the control method proposed in this paper.
基金Supported by National Key R&D Program of China(Grant No.2022YFB2502900)Fundamental Research Funds for the Central Universities of China,Science and Technology Commission of Shanghai Municipality of China(Grant No.21ZR1465900)Shanghai Gaofeng&Gaoyuan Project for University Academic Program Development of China.
文摘Model predictive control is widely used in the design of autonomous driving algorithms.However,its parameters are sensitive to dynamically varying driving conditions,making it difficult to be implemented into practice.As a result,this study presents a self-learning algorithm based on reinforcement learning to tune a model predictive controller.Specifically,the proposed algorithm is used to extract features of dynamic traffic scenes and adjust the weight coefficients of the model predictive controller.In this method,a risk threshold model is proposed to classify the risk level of the scenes based on the scene features,and aid in the design of the reinforcement learning reward function and ultimately improve the adaptability of the model predictive controller to real-world scenarios.The proposed algorithm is compared to a pure model predictive controller in car-following case.According to the results,the proposed method enables autonomous vehicles to adjust the priority of performance indices reasonably in different scenarios according to risk variations,showing a good scenario adaptability with safety guaranteed.