Path-Following Control With Obstacle Avoidance of Autonomous Surface Vehicles Subject to Actuator Faults

This paper investigates the path-following control problem with obstacle avoidance of autonomous surface vehicles in the presence of actuator faults,uncertainty and external disturbances.Autonomous surface vehicles inevitably suffer from actuator faults in complex sea environments,which may cause existing obstacle avoidance strategies to fail.To reduce the influence of actuator faults,an improved artificial potential function is constructed by introducing the lower bound of actuator efficiency factors.The nonlinear state observer,which only depends on measurable position information of the autonomous surface vehicle,is used to address uncertainties and external disturbances.By using a backstepping technique and adaptive mechanism,a path-following control strategy with obstacle avoidance and fault tolerance is designed which can ensure that the tracking errors converge to a small neighborhood of zero.Compared with existing results,the proposed control strategy has the capability of obstacle avoidance and fault tolerance simultaneously.Finally,the comparison results through simulations are given to verify the effectiveness of the proposed method.

Toward Trustworthy Decision-Making for Autonomous Vehicles:A Robust Reinforcement Learning Approach with Safety Guarantees

While autonomous vehicles are vital components of intelligent transportation systems,ensuring the trustworthiness of decision-making remains a substantial challenge in realizing autonomous driving.Therefore,we present a novel robust reinforcement learning approach with safety guarantees to attain trustworthy decision-making for autonomous vehicles.The proposed technique ensures decision trustworthiness in terms of policy robustness and collision safety.Specifically,an adversary model is learned online to simulate the worst-case uncertainty by approximating the optimal adversarial perturbations on the observed states and environmental dynamics.In addition,an adversarial robust actor-critic algorithm is developed to enable the agent to learn robust policies against perturbations in observations and dynamics.Moreover,we devise a safety mask to guarantee the collision safety of the autonomous driving agent during both the training and testing processes using an interpretable knowledge model known as the Responsibility-Sensitive Safety Model.Finally,the proposed approach is evaluated through both simulations and experiments.These results indicate that the autonomous driving agent can make trustworthy decisions and drastically reduce the number of collisions through robust safety policies.

A Survey on an Emerging Safety Challenge for Autonomous Vehicles:Safety of the Intended Functionality

As the complexity of autonomous vehicles(AVs)continues to increase and artificial intelligence algorithms are becoming increasingly ubiquitous,a novel safety concern known as the safety of the intended functionality(SOTIF)has emerged,presenting significant challenges to the widespread deployment of AVs.SOTIF focuses on issues arising from the functional insufficiencies of the AVs’intended functionality or its implementation,apart from conventional safety considerations.From the systems engineering standpoint,this study offers a comprehensive exploration of the SOTIF landscape by reviewing academic research,practical activities,challenges,and perspectives across the development,verification,validation,and operation phases.Academic research encompasses system-level SOTIF studies and algorithm-related SOTIF issues and solutions.Moreover,it encapsulates practical SOTIF activities undertaken by corporations,government entities,and academic institutions spanning international and Chinese contexts,focusing on the overarching methodologies and practices in different phases.Finally,the paper presents future challenges and outlook pertaining to the development,verification,validation,and operation phases,motivating stakeholders to address the remaining obstacles and challenges.

General Optimal Trajectory Planning:Enabling Autonomous Vehicles with the Principle of Least Action

This study presents a general optimal trajectory planning(GOTP)framework for autonomous vehicles(AVs)that can effectively avoid obstacles and guide AVs to complete driving tasks safely and efficiently.Firstly,we employ the fifth-order Bezier curve to generate and smooth the reference path along the road centerline.Cartesian coordinates are then transformed to achieve the curvature continuity of the generated curve.Considering the road constraints and vehicle dynamics,limited polynomial candidate trajectories are generated and smoothed in a curvilinear coordinate system.Furthermore,in selecting the optimal trajectory,we develop a unified and auto-tune objective function based on the principle of least action by employing AVs to simulate drivers’behavior and summarizing their manipulation characteristics of“seeking benefits and avoiding losses.”Finally,by integrating the idea of receding-horizon optimization,the proposed framework is achieved by considering dynamic multi-performance objectives and selecting trajectories that satisfy feasibility,optimality,and adaptability.Extensive simulations and experiments are performed,and the results demonstrate the framework’s feasibility and effectiveness,which avoids both dynamic and static obstacles and applies to various scenarios with multi-source interactive traffic participants.Moreover,we prove that the proposed method can guarantee real-time planning and safety requirements compared to drivers’manipulation.

Cooperative Target Tracking of Multiple Autonomous Surface Vehicles Under Switching Interaction Topologies

This paper is concerned with the cooperative target tracking of multiple autonomous surface vehicles(ASVs)under switching interaction topologies.For the target to be tracked,only its position can be measured/received by some of the ASVs,and its velocity is unavailable to all the ASVs.A distributed extended state observer taking into consideration switching topologies is designed to integrally estimate unknown target dynamics and neighboring ASVs'dynamics.Accordingly,a novel kinematic controller is designed,which takes full advantage of known information and avoids the approximation of some virtual control vectors.Moreover,a disturbance observer is presented to estimate unknown time-varying environmental disturbance.Furthermore,a distributed dynamic controller is designed to regulate the involved ASVs to cooperatively track the target.It enables each ASV to adjust its forces and moments according to the received information from its neighbors.The effectiveness of the derived results is demonstrated through cooperative target tracking performance analysis for a tracking system composed of five interacting ASVs.

MPC-based Motion Planning and Control Enables Smarter and Safer Autonomous Marine Vehicles:Perspectives and a Tutorial Survey

Autonomous marine vehicles(AMVs)have received considerable attention in the past few decades,mainly because they play essential roles in broad marine applications such as environmental monitoring and resource exploration.Recent advances in the field of communication technologies,perception capability,computational power and advanced optimization algorithms have stimulated new interest in the development of AMVs.In order to deploy the constrained AMVs in the complex dynamic maritime environment,it is crucial to enhance the guidance and control capabilities through effective and practical planning,and control algorithms.Model predictive control(MPC)has been exceptionally successful in different fields due to its ability to systematically handle constraints while optimizing control performance.This paper aims to provide a review of recent progress in the context of motion planning and control for AMVs from the perceptive of MPC.Finally,future research trends and directions in this substantial research area of AMVs are highlighted.

Human-Like Decision-Making of Autonomous Vehicles in Dynamic Traffic Scenarios

With the maturation of autonomous driving technology, the use of autonomous vehicles in a socially acceptable manner has become a growing demand of the public. Human-like autonomous driving is expected due to the impact of the differences between autonomous vehicles and human drivers on safety.Although human-like decision-making has become a research hotspot, a unified theory has not yet been formed, and there are significant differences in the implementation and performance of existing methods. This paper provides a comprehensive overview of human-like decision-making for autonomous vehicles. The following issues are discussed: 1) The intelligence level of most autonomous driving decision-making algorithms;2) The driving datasets and simulation platforms for testing and verifying human-like decision-making;3) The evaluation metrics of human-likeness;personalized driving;the application of decisionmaking in real traffic scenarios;and 4) The potential research direction of human-like driving. These research results are significant for creating interpretable human-like driving models and applying them in dynamic traffic scenarios. In the future, the combination of intuitive logical reasoning and hierarchical structure will be an important topic for further research. It is expected to meet the needs of human-like driving.

A Combined Reinforcement Learning and Model Predictive Control for Car-Following Maneuver of Autonomous Vehicles

Model predictive control is widely used in the design of autonomous driving algorithms.However,its parameters are sensitive to dynamically varying driving conditions,making it difficult to be implemented into practice.As a result,this study presents a self-learning algorithm based on reinforcement learning to tune a model predictive controller.Specifically,the proposed algorithm is used to extract features of dynamic traffic scenes and adjust the weight coefficients of the model predictive controller.In this method,a risk threshold model is proposed to classify the risk level of the scenes based on the scene features,and aid in the design of the reinforcement learning reward function and ultimately improve the adaptability of the model predictive controller to real-world scenarios.The proposed algorithm is compared to a pure model predictive controller in car-following case.According to the results,the proposed method enables autonomous vehicles to adjust the priority of performance indices reasonably in different scenarios according to risk variations,showing a good scenario adaptability with safety guaranteed.

Observer-Based Path Tracking Controller Design for Autonomous Ground Vehicles With Input Saturation

This paper investigates the problem of path tracking control for autonomous ground vehicles(AGVs),where the input saturation,system nonlinearities and uncertainties are considered.Firstly,the nonlinear path tracking system is formulated as a linear parameter varying(LPV)model where the variation of vehicle velocity is taken into account.Secondly,considering the noise effects on the measurement of lateral offset and heading angle,an observer-based control strategy is proposed,and by analyzing the frequency domain characteristics of the derivative of desired heading angle,a finite frequency H_∞index is proposed to attenuate the effects of the derivative of desired heading angle on path tracking error.Thirdly,sufficient conditions are derived to guarantee robust H_∞performance of the path tracking system,and the calculation of observer and controller gains is converted into solving a convex optimization problem.Finally,simulation examples verify the advantages of the control method proposed in this paper.

A Novel Ego Lanes Detection Method for Autonomous Vehicles

Autonomous vehicles are currently regarded as an interesting topic in the AI field.For such vehicles,the lane where they are traveling should be detected.Most lane detection methods identify the whole road area with all the lanes built on it.In addition to having a low accuracy rate and slow processing time,these methods require costly hardware and training datasets,and they fail under critical conditions.In this study,a novel detection algo-rithm for a lane where a car is currently traveling is proposed by combining simple traditional image processing with lightweight machine learning(ML)methods.First,a preparation phase removes all unwanted information to preserve the topographical representations of virtual edges within a one-pixel width around expected lanes.Then,a simple feature extraction phase obtains only the intersection point position and angle degree of each candidate edge.Subsequently,a proposed scheme that comprises consecutive lightweight ML models is applied to detect the correct lane by using the extracted features.This scheme is based on the density-based spatial clustering of applications with noise,random forest trees,a neural network,and rule-based methods.To increase accuracy and reduce processing time,each model supports the next one during detection.When a model detects a lane,the subsequent models are skipped.The models are trained on the Karlsruhe Institute of Technology and Toyota Technological Institute datasets.Results show that the proposed method is faster and achieves higher accuracy than state-of-the-art methods.This method is simple,can handle degradation conditions,and requires low-cost hardware and training datasets.

Stability Analysis on Speed Control System of Autonomous Underwater Vehicle

The stability of the motion control system is one of the decisive factors of the control quality for Autonomous Underwater Vehicle（AUV）.The divergence of control,which the unstable system may be brought about,is fatal to the operation of AUV.The stability analysis of the PD and S-surface speed controllers based on the Lyapunov＇s direct method is proposed in this paper.After decoupling the six degree-of-freedom（DOF）motions of the AUV,the axial dynamic behavior is discussed and the condition is deduced,in which the parameters selection within stability domain can guarantee the system asymptotically stable.The experimental results in a tank and on the sea have successfully verified the algorithm reliability,which can be served as a good reference for analyzing other AUV nonlinear control systems.

Dynamic Cell Modeling for Accurate SOC Estimation in Autonomous Electric Vehicles

This paper presents findings on dynamic cell modeling for state-of-charge (SOC) estimation in an autonomous electric vehicle (AEV). The studied cells are Lithium-Ion Polymer-based with a nominal capacity of around 8 Ah, optimized for power-needy applications. The AEV operates in a harsh environment with rate requirements up to ±25C and highly dynamic rate profiles, unlike portable-electronic applications with constant power output and fractional C rates. SOC estimation methods effective in portable electronics may not suffice for the AEV. Accurate SOC estimation necessitates a precise cell model. The proposed SOC estimation method utilizes a detailed Kalman-filtering approach. The cell model must include SOC as a state in the model state vector. Multiple cell models are presented, starting with a simple one employing “Coulomb counting” as the state equation and Shepherd’s rule as the output equation, lacking prediction of cell relaxation dynamics. An improved model incorporates filter states to account for relaxation and other dynamics in closed-circuit cell voltage, yielding better performance. The best overall results are achieved with a method combining nonlinear autoregressive filtering and dynamic radial basis function networks. The paper includes lab test results comparing physical cells with model predictions. The most accurate models obtained have an RMS estimation error lower than the quantization noise floor expected in the battery-management-system design. Importantly, these models enable precise SOC estimation, allowing the vehicle controller to utilize the battery pack’s full operating range without overcharging or undercharging concerns.

Influence of highway space alignment continuous degradation in 3- dimensional space on autonomous vehicle trajectory deviation based on PreScan simulation

The advent of autonomous vehicles(AVs)is expected to transform the current transportation system into a safe and reliable one.The existing infrastructures,operational criteria,and design method were developed to meet the requirements of human drivers.However,previous studies have shown that in the traditional horizontal and vertical combined design methods,where the two-dimensional alignment elements change,there are varying changes in curvature and torsion,which cause the continuous degradation of the spatial curve and torsion.This continuous degradation will inevitably cause changes in the trajectory of Autonomous Vehicles(AVs),thereby affecting driving safety.Therefore,studying the characteristics of autonomous vehicles trajectory deviation has theoretical significance for optimizing highway alignment safety design.Driving simulation tests were performed by using PreScan and Simulink to calibrate the lateral deviation.A machine learning approach called the Gradient Boosting Decision Tree(GBDT)algorithm was implemented to build a model and express the relationship between space alignment parameters and lane deviation.The results showed that the AV’s driving trajectory is significantly affected by the space alignment factors when the vehicle is driving in the inner lane,the downhill section,and the left-turn section.These findings will provide a novel perspective for road safety research based on autonomous vehicle driving trajectories.

Car-following strategy of intelligent connected vehicle using extended disturbance observer adjusted by reinforcement learning

Disturbance observer-based control method has achieved good results in the carfollowing scenario of intelligent and connected vehicle(ICV).However,the gain of conventional extended disturbance observer(EDO)-based control method is usually set manually rather than adjusted adaptively according to real time traffic conditions,thus declining the car-following performance.To solve this problem,a car-following strategy of ICV using EDO adjusted by reinforcement learning is proposed.Different from the conventional method,the gain of proposed strategy can be adjusted by reinforcement learning to improve its estimation accuracy.Since the“equivalent disturbance”can be compensated by EDO to a great extent,the disturbance rejection ability of the carfollowing method will be improved significantly.Both Lyapunov approach and numerical simulations are carried out to verify the effectiveness of the proposed method.

A Workable Solution for Reducing the Large Number of Vehicle and Pedestrian Accidents Occurring on a Yellow Light

Traffic intersections are incredibly dangerous for drivers and pedestrians. Statistics from both Canada and the U.S. show a high number of fatalities and serious injuries related to crashes at intersections. In Canada, during 2019, the National Collision Database shows that 28% of traffic fatalities and 42% of serious injuries occurred at intersections. Likewise, the U.S. National Highway Traffic Administration (NHTSA) found that about 40% of the estimated 5,811,000 accidents in the U.S. during the year studied were intersection-related crashes. In fact, a major survey by the car insurance industry found that nearly 85% of drivers could not identify the correct action to take when approaching a yellow traffic light at an intersection. One major reason for these accidents is the “yellow light dilemma,” the ambiguous situation where a driver should stop or proceed forward when unexpectedly faced with a yellow light. This situation is even further exacerbated by the tendency of aggressive drivers to inappropriately speed up on the yellow just to get through the traffic light. A survey of Canadian drivers conducted by the Traffic Injury Research Foundation found that 9% of drivers admitted to speeding up to get through a traffic light. Another reason for these accidents is the increased danger of making a left-hand turn on yellow. According to the National Highway Traffic Safety Association (NHTSA), left turns occur in approximately 22.2% of collisions—as opposed to just 1.2% for right turns. Moreover, a study by CNN found left turns are three times as likely to kill pedestrians than right turns. The reason left turns are so much more likely to cause an accident is because they take a driver against traffic and in the path of oncoming cars. Additionally, most of these left turns occur at the driver’s discretion—as opposed to the distressingly brief left-hand arrow at busy intersections. Drive Safe Now proposes a workable solution for reducing the number of accidents occurring during a yellow light at intersections. We believe this fairly simple solution will save lives, prevent injuries, reduce damage to public and private property, and decrease insurance costs.

Development of A Three-Dimensional Guidance System for Long-Range Maneuvering of A Miniature Autonomous Underwater Vehicle

The present paper introduces a three-dimensional guidance system developed for a miniature Autonomous Underwater Vehicle（AUV）. The guidance system determines the best trajectory for the vehicle based on target behavior and vehicle capabilities. The dynamic model of this novel AUV is derived based on its special characteristics such as the horizontal posture and the independent diving mechanism. To design the guidance strategy, the main idea is to select the desired depth, presumed proportional to the horizontal distance of the AUV and the target. By connecting the two with a straight line, this strategy helps the AUV move in a trajectory sufficiently close to this line. The adjacency of the trajectory to the line leads to reasonably short travelling distances and avoids unsafe areas. Autopilots are designed using sliding mode controller. Two different engagement geometries are considered to evaluate the strategy＇s performance： stationary target and moving target. The simulation results show that the strategy can provide sufficiently fast and smooth trajectories in both target situations.

Multi-constrained model predictive control for autonomous ground vehicle trajectory tracking

A multi-constrained model predictive control （ MPC ） algorithm for trajectory tracking of an autonomous ground vehicle is proposed and tested in this paper. First, to simplify the computa- tion, an active steering linear error model is applied in the MPC controller. Then, a control incre- ment constraint and a relaxing factor are taken into account in the objective function to ensure the smoothness of the trajectory, using a softening constraints technique. In addition, the controller can obtain optimal control sequences which satisfy both the actual kinematic constraints and the actuator constraints. The circular trajectory tracking performance of the proposed method is compared with that of another MPC controller. To verify the trajectory tracking capabilities of the designed control- ler at different desired speed, the simulation experiments are carried out at the speed of 3m/s, 5m/ s and 10m/s. The results demonstrate the MPC controller has a good speed adaptability.

Towards the Unified Principles for Level 5 Autonomous Vehicles

The rapid advance of autonomous vehicles(AVs)has motivated new perspectives and potential challenges for existing modes of transportation.Currently,driving assistance systems of Level 3 and below have been widely produced,and several applications of Level 4 systems to specific situations have also been gradually developed.By improving the automation level and vehicle intelligence,these systems can be further advanced towards fully autonomous driving.However,general development concepts for Level 5 AVs remain unclear,and the existing methods employed in the development processes of Levels 0-4 have been mainly based on task-driven function development related to specific scenarios.Therefore,it is difficult to identify the problems encountered by high-level AVs.The essential logical and physical mechanisms of vehicles have hindered further progression towards Level 5 systems.By exploring the physical mechanisms behind high-level autonomous driving systems and analyzing the essence of driving,we put forward a coordinated and balanced framework based on the brain-cerebellum-organ concept through reasoning and deduction.Based on a mixed mode relying on the crow inference and parrot imitation approach,we explore the research paradigm of autonomous learning and prior knowledge to realize the characteristics of self-learning,self-adaptation,and self-transcendence for AVs.From a systematic,unified,and balanced point of view and based on least action principles and unified safety field concepts,we aim to provide a novel research concept and develop an effective approach for the research and development of high-level AVs,specifically at Level 5.

Autonomous vehicles: challenges, opportunities, and future implications for transportation policies

This study investigates the challenges and opportunities pertaining to transportation policies that may arise as a result of emerging autonomous vehicle （AV） technologies. AV technologies can decrease the transportation cost and increase accessibility to low-income households and persons with mobility issues. This emerging technology also has far-reaching applications and implications beyond all current expectations. This paper provides a comprehensive review of the relevant literature and explores a broad spectrum of issues from safety to machine ethics. An indispensable part of a prospective AV development is communication over cars and infrastructure （connected vehicles）. A major knowledge gap exists in AV technology with respect to routing behaviors. Connected- vehicle technology provides a great opportunity to imple- ment an efficient and intelligent routing system. To this end, we propose a conceptual navigation model based on a fleet of AVs that are centrally dispatched over a network seeking system optimization literature on two fronts： （i） This study contributes to the it attempts to shed light on future opportunities as well as possible hurdles associated with AV technology; and （ii） it conceptualizes a navigation model for the AV which leads to highly efficient traffic circulations.

Adaptive Backstepping Terminal Sliding Mode Control Method Based on Recurrent Neural Networks for Autonomous Underwater Vehicle

The trajectory tracking control problem is addressed for autonomous underwater vehicle(AUV) in marine environ?ment, with presence of the influence of the uncertain factors including ocean current disturbance, dynamic modeling uncertainty, and thrust model errors. To improve the trajectory tracking accuracy of AUV, an adaptive backstepping terminal sliding mode control based on recurrent neural networks(RNN) is proposed. Firstly, considering the inaccu?rate of thrust model of thruster, a Taylor’s polynomial is used to obtain the thrust model errors. And then, the dynamic modeling uncertainty and thrust model errors are combined into the system model uncertainty(SMU) of AUV; through the RNN, the SMU and ocean current disturbance are classified, approximated online. Finally, the weights of RNN and other control parameters are adjusted online based on the backstepping terminal sliding mode controller. In addition, a chattering?reduction method is proposed based on sigmoid function. In chattering?reduction method, the sigmoid function is used to realize the continuity of the sliding mode switching function, and the sliding mode switching gain is adjusted online based on the exponential form of the sliding mode function. Based on the Lyapu?nov theory and Barbalat’s lemma, it is theoretically proved that the AUV trajectory tracking error can quickly converge to zero in the finite time. This research proposes a trajectory tracking control method of AUV, which can e ectively achieve high?precision trajectory tracking control of AUV under the influence of the uncertain factors. The feasibility and e ectiveness of the proposed method is demonstrated with trajectory tracking simulations and pool?experi?ments of AUV.