Reinforcement learning based adaptive control for uncertain mechanical systems with asymptotic tracking

This paper mainly focuses on the development of a learning-based controller for a class of uncertain mechanical systems modeled by the Euler-Lagrange formulation.The considered system can depict the behavior of a large class of engineering systems,such as vehicular systems,robot manipulators and satellites.All these systems are often characterized by highly nonlinear characteristics,heavy modeling uncertainties and unknown perturbations,therefore,accurate-model-based nonlinear control approaches become unavailable.Motivated by the challenge,a reinforcement learning(RL)adaptive control methodology based on the actor-critic framework is investigated to compensate the uncertain mechanical dynamics.The approximation inaccuracies caused by RL and the exogenous unknown disturbances are circumvented via a continuous robust integral of the sign of the error(RISE)control approach.Different from a classical RISE control law,a tanh(·)function is utilized instead of a sign(·)function to acquire a more smooth control signal.The developed controller requires very little prior knowledge of the dynamic model,is robust to unknown dynamics and exogenous disturbances,and can achieve asymptotic output tracking.Eventually,co-simulations through ADAMS and MATLAB/Simulink on a three degrees-of-freedom(3-DOF)manipulator and experiments on a real-time electromechanical servo system are performed to verify the performance of the proposed approach.

Asymptotic Tracking Control for Wind Turbines in Variable Speed Mode

This paper presents a variable speed control strategy for wind turbines in order to capture maximum wind power.Wind turbines are modeled as a two-mass drive-train system with generator torque control.Based on the obtained wind turbine model,variable speed control schemes are developed.Nonlinear tracking controllers are designed to achieve asymptotic tracking for a prescribed rotor speed reference signal so as to yield maximum wind power capture.Due to the difficulty of torsional angle measurement,an observer-based control scheme that uses only rotor speed information is further developed for global asymptotic output tracking.The effectiveness of the proposed control methods is illustrated by simulation results.

Adaptive Decentralized Asymptotic Tracking Control for Large-Scale Nonlinear Systems With Unknown Strong Interconnections

An adaptive decentralized asymptotic tracking control scheme is developed in this paper for a class of large-scale nonlinear systems with unknown strong interconnections,unknown time-varying parameters,and disturbances.First,by employing the intrinsic properties of Gaussian functions for the interconnection terms for the first time,all extra signals in the framework of decentralized control are filtered out,thereby removing all additional assumptions imposed on the interconnec-tions,such as upper bounding functions and matching conditions.Second,by introducing two integral bounded functions,asymptotic tracking control is realized.Moreover,the nonlinear filters with the compensation terms are introduced to circumvent the issue of“explosion of complexity”.It is shown that all the closed-loop signals are bounded and the tracking errors converge to zero asymptotically.In the end,a simulation example is carried out to demonstrate the effectiveness of the proposed approach.

Adaptive Barrier-Lyapunov-Functions Based Control Scheme of Nonlinear Pure-Feedback Systems with Full State Constraints and Asymptotic Tracking Performance

In this paper,the authors propose an adaptive Barrier-Lyapunov-Functions(BLFs)based control scheme for nonlinear pure-feedback systems with full state constraints.Due to the coexist of the non-affine structure and full state constraints,it is very difficult to construct a desired controller for the considered system.According to the mean value theorem,the authors transform the pure-feedback system into a system with strict-feedback structure,so that the well-known backstepping method can be applied.Then,in the backstepping design process,the BLFs are employed to avoid the violation of the state constraints,and neural networks(NNs)are directly used to online approximate the unknown packaged nonlinear terms.The presented controller ensures that all the signals in the closed-loop system are bounded and the tracking error asymptotically converges to zero.Meanwhile,it is shown that the constraint requirement on the system will not be violated during the operation.Finally,two simulation examples are provided to show the effectiveness of the proposed control scheme.

Event-based adaptive asymptotic tracking control of nonlinear time-varying systems with prescribed performance

This paper is concerned with the adaptive tracking control problem of nonlinear time-varyingsystems. Based on the backstepping technology, an event-based prescribed performance controlscheme is developed. And the time-varying uncertainties of the system are handled byutilising bound estimation method. The proposed controller not only ensures the prescribedtracking performance, but also reduces the communication burden. By using Lyapunov stabilityanalysis, it is proven that all of the closed-loop signals are bounded, and the tracking errorcan converge to zero. Simultaneously, Zeno behaviour is excluded. Finally, the simulation resultsare utilised to illustrate the effectiveness of the proposed adaptive control scheme.

Adaptive Asymptotic Tracking Control for Stochastic Nonlinear Systems with Unknown Backlash-Like Hysteresis

In this study,an adaptive asymptotic tracking control problem is considered for stochastic nonlinear systems with unknown backlash-like hysteresis.By utilizing backstepping technology and bound estimation approach,an adaptive asymptotic tracking control scheme is designed,where fuzzy systems are applied to approximate unknown function terms,the effect of hysteresis and stochastic disturbances is compensated appropriately.The proposed scheme ensures that the tracking error can asymptotically converge to zero in probability and all signals of the closed-loop system are bounded almost surely.Finally,the effectiveness of the control scheme is verified by giving a simulation example.

Asymptotic bounded consensus tracking of double-integrator multi-agent systems with bounded-jerk target based on sampled-data without velocity measurements

This paper investigates asymptotic bounded consensus tracking（ABCT） of double-integrator multi-agent systems（MASs） with an asymptotically-unbounded-acceleration and bounded-jerk target（AUABJT） available to partial agents based on sampled-data without velocity measurements. A sampled-data consensus tracking protocol（CTP） without velocity measurements is proposed to guarantee that double-integrator MASs track an AUABJT available to only partial agents.The eigenvalue analysis method together with the augmented matrix method is used to obtain the necessary and sufficient conditions for ABCT. A numerical example is provided to illustrate the effectiveness of theoretical results.

Adaptive coordinated control of engine speed and battery charging voltage

In this paper, the control problem of auxiliary power unit （APU） for hybrid electric vehicles is investigated. An adaptive controller is provided to achieve the coordinated control between the engine speed and the battery charging voltage. The proposed adaptive coordinated control laws for the throttle angle of the engine and the voltage of the power-converter can guarantee not only the asymptotic tracking performance of the engine speed and the regulation of the battery charging voltage, but also the robust stability of the closed loop system under external load changes. Simulation results are given to verify the performance of the proposed adaptive controller.

Adaptive asymptotic fault-tolerant tracking of uncertain nonlinear systems with unknown control directions

In the article,the issues of asymptotic adaptive tracking control for the uncertain nonlinear systems in the presence of actuator faults and unknown control directions are investigated.By using the properties of the Nussbaum function and backstepping technique,the problems resulting from the unknown signs of the nonlinear control functions are circumvented successfully.Moreover,a new adaptive asymptotic tracking control method is presented with the fault-tolerant control framework,which is capable of realising zero-tracking performance.The stability of the controlled system is ensured through fractional Lyapunov stability analysis.Finally,the validity of the raised scheme is verified by a simulation example.

Nonlinear asymptotic attitude tracking control of an underactuated 3-degree-of-freedom helicopter using neural network feedforward term

This paper proposes a new asymptotic attitude tracking controller for an underactuated 3-degree-of-freedom （DOF） laboratory helicopter system by using a nonlinear robust feedback and a neural network （NN） feedforward term. The nonlinear robust control law is developed through a modified inner-outer loop approach. The application of the NN-based feedforward is to compensate for the system uncertainties. The proposed control design strategy requires very limited knowledge of the system dynamic model, and achieves good robustness with respect to system parametric uncertainties. A Lyapunov-based stability analysis shows that the proposed algorithms can ensure asymptotic tracking of the helicopter＇s elevation and travel motion, while keeping the stability of the closed-loop system. Real-time experiment results demonstrate that the controller has achieved good tracking performance.

Adaptive fuzzy asymptotic control design for MIMO nonlinear systems with state constraints

This paper addresses the asymptotic control problem of uncertain multi-input and multi-output(MIMO)nonlinear systems.The considered MIMO systems contain unknown virtual control coefficients(UVCCs)and state constraints.Acreative Lyapunov function by associating with the lower bounds of UVCCs is presented to counteract the adverse effect deriving from UVCCs.The state constraints are ensured by utilising the barrier Lyapunov function.Moreover,the asymptotic tracking controller is recursively constructed by combining the backstepping technique with fuzzy logic systems.The remarkable character of the designed controller is that the asymptotic tracking performance can be achieved by introducing some smooth functions into adaptive backstepping procedure.In contrast to the existing results,the conditions on the UVCCs are relaxed.Finally,the new control design is illustrated by a practical example.