A new optimal adaptive backstepping control approach for nonlinear systems under deception attacks via reinforcement learning

In this paper,a new optimal adaptive backstepping control approach for nonlinear systems under deception attacks via reinforcement learning is presented in this paper.The existence of nonlinear terms in the studied system makes it very difficult to design the optimal controller using traditional methods.To achieve optimal control,RL algorithm based on critic–actor architecture is considered for the nonlinear system.Due to the significant security risks of network transmission,the system is vulnerable to deception attacks,which can make all the system state unavailable.By using the attacked states to design coordinate transformation,the harm brought by unknown deception attacks has been overcome.The presented control strategy can ensure that all signals in the closed-loop system are semi-globally ultimately bounded.Finally,the simulation experiment is shown to prove the effectiveness of the strategy.

Optimal Control of Nonlinear Systems Using Experience Inference Human-Behavior Learning

Safety critical control is often trained in a simulated environment to mitigate risk.Subsequent migration of the biased controller requires further adjustments.In this paper,an experience inference human-behavior learning is proposed to solve the migration problem of optimal controllers applied to real-world nonlinear systems.The approach is inspired in the complementary properties that exhibits the hippocampus,the neocortex,and the striatum learning systems located in the brain.The hippocampus defines a physics informed reference model of the realworld nonlinear system for experience inference and the neocortex is the adaptive dynamic programming(ADP)or reinforcement learning(RL)algorithm that ensures optimal performance of the reference model.This optimal performance is inferred to the real-world nonlinear system by means of an adaptive neocortex/striatum control policy that forces the nonlinear system to behave as the reference model.Stability and convergence of the proposed approach is analyzed using Lyapunov stability theory.Simulation studies are carried out to verify the approach.

Neuro-Based Higher Order Sliding Mode Control for Perturbed Nonlinear Systems

One of the great concerns when tackling nonlinear systems is how to design a robust controller that is able to deal with uncertainty.Many researchers have been working on developing such type of controllers.One of the most effi-cient techniques employed to develop such controllers is sliding mode control(SMC).However,the low order SMC suffers from chattering problem which harm the actuators of the control system and thus unsuitable to be used in many practical applications.In this paper,the drawbacks of low order traditional sliding mode control(FOTSMC)are resolved by presenting a novel adaptive radial basis function neural network–based generalized rth order sliding mode control strategy for nth order uncertain nonlinear systems.The proposed solution adopts neural networks for their excellent capability in function approximation and thus used to approximate the nonlinearities and uncertainties for systems under considera-tion.The approximation errors are completely considered in the developed approach.The proposed approach can be used with any order of sliding mode and thus can be generally used with various types of applications.The global sta-bility of the proposed control approach is proved through Lyapunov stability cri-terion.The proposed approach is validated and assessed through simulations on the nonlinear inverted pendulum system with severe modeling uncertainties.The simulations results show that the proposed approach provide superior perfor-mance compared with other approaches in the literature.

Simplified Method of Stability Analysis of Nonlinear Systems without Using of Lyapunov Concept

In this paper a new simplified method of stability study of dynamical nonlinear systems is proposed as an alternative to using Lyapunov’s method. Like the Lyapunov theorem, the new concept describes a sufficient condition for the systems to be globally stable. The proposed method is based on the assumption that, not only the state matrix contains information on the stability of the systems, but also the eigenvectors. So, first we will write the model of nonlinear systems in the state-space representation, then we use the eigenvectors of the state matrix as system stability indicators.

Finite-Time H∞ Control of Switched Nonlinear Systems under State-Dependent Switching

This paper investigates the finite-time H∞ control problem of switched nonlinear systems via state-dependent switching and state feedback control. Unlike the existing approach based on time-dependent switching strategy, in which the switching instants must be given in advance, the state-dependent switching strategy is used to design switching signals. Based on multiple Lyapunov-like functions method, several criteria for switched nonlinear systems to be finite-time H∞ control are derived. Finally, a numerical example with simulation results is provided to show the validity of the conclusions.

Global robust optimal sliding mode control for uncertain affine nonlinear systems

The problem of robustifying linear quadratic regulators （LQRs） for a class of uncertain affine nonlinear systems is considered. First, the exact linearization technique is used to transform an uncertain nonlinear system into a linear one and an optimal LQR is designed for the corresponding nominal system. Then, based on the integral sliding mode, a design approach to robustifying the optimal regulator is studied. As a result, the system exhibits global robustness to uncertainties and the ideal sliding mode dynamics is the same as that of the optimal LQR for the nominal system. A global robust optimal sliding mode control （GROSMC） is realized. Finally, a numerical simulation is demonstrated to show the effectiveness and superiority of the proposed algorithm compared with the conventional optimal LQR.

Parity Relation Based Fault Estimation for Nonlinear Systems: An LMI Approach

This paper proposes a parity relation based fault estimation for a class of nonlinear systems which can be modelled by Takagi-Sugeno （TS） fuzzy models. The design of a parity relation based residual generator is formulated in terms of a family of linear matrix inequalities （LMIs）. A numerical example is provided to illustrate the effectiveness of the proposed design techniques.

Construction of Control Lyapunov Functions for a Class of Nonlinear Systems

The construction of control Lyapunov functions for a class of nonlinear systems is considered. We develop a method by which a control Lyapunov function for the feedback linearizable part can be constructed systematically via Lyapunov equation. Moreover, by a control Lyapunov function of the feedback linearizable part and a Lyapunov function of the zero dynamics, a control Lyapunov function for the overall nonlinear system is established.

Integral terminal sliding mode control for nonlinear systems

This paper proposes a fast integral terminal sliding mode（ITSM） control method for a cascaded nonlinear dynamical system with mismatched uncertainties. Firstly, an integral terminal sliding mode surface is presented, which not only avoids the singularity in the traditional terminal sliding mode, but also addresses the mismatched problems in the nonlinear control system. Secondly, a new ITSM controller with finite convergence time based on the backstepping technique is derived for a cascaded nonlinear dynamical system with mismatched uncertainties. Thirdly, the convergence time of ITSM is analyzed, whose convergence speed is faster than those of two nonsingular terminal sliding modes.Finally, simulation results are presented in order to evaluate the effectiveness of ITSM control strategies for mismatched uncertainties.

Robust adaptive fuzzy tracking control for a class of strict-feedback nonlinear systems based on backstepping technique

In this paper, the robust adaptive fuzzy tracking control problem is discussed for a class of perturbed strict-feedback nonlinear systems. The fuzzy logic systems in Mamdani type are used to approximate unknown nonlinear functions. A design scheme of the robust adaptive fuzzy controller is proposed by use of the backstepping technique. The proposed controller guarantees semi-global uniform ultimate boundedness of all the signals in the derived closed-loop system and achieves the good tracking performance. The possible controller singularity problem which may occur in some existing adaptive control schemes with feedback linearization techniques can be avoided. In addition, the number of the on-line adaptive parameters is not more than the order of the designed system. Finally, two simulation examples are used to demonstrate the effectiveness of the proposed control scheme.

Robust Output Feedback Control for a Class of Nonlinear Systems with Input Unmodeled Dynamics

The robust global stabilization problem of a class of uncertain nonlinear systems with input unmodeled dynamics is considered using output feedback, where the uncertain nonlinear terms satisfy a far more relaxed condition than the existing triangulartype condition. Under the assumption that the input unmodeled dynamics is minimum-phase and of relative degree zero, a dynamic output compensator is explicitly constructed based on the nonseparation principle. An example illustrates the usefulness of the proposed method.

Adaptive Fuzzy Dynamic Surface Control for Uncertain Nonlinear Systems

In this paper, a robust adaptive fuzzy dynamic surface control for a class of uncertain nonlinear systems is proposed. A novel adaptive fuzzy dynamic surface model is built to approximate the uncertain nonlinear functions by only one fuzzy logic system. The approximation capability of this model is proved and the model is implemented to solve the problem that too many approximators are used in the controller design of uncertain nonlinear systems. The shortage of ＂explosion of complexity＂ in backstepping design procedure is overcome by using the proposed dynamic surface control method. It is proved by constructing appropriate Lyapunov candidates that all signals of closed-loop systems are semi-globally uniformly ultimate bounded. Also, this novel controller stabilizes the states of uncertain nonlinear systems faster than the adaptive sliding mode controller （SMC）. Two simulation examples are provided to illustrate the effectiveness of the control approach proposed in this paper.

Design of a fault diagnosis scheme for a class of singular nonlinear systems

A new fault detection and diagnosis approach is developed in this paper for a class of singular nonlinear systems via the use of adaptive updating rules. Both detection and diagnostic observers are established, where Lyapunov stability theory is used to obtain the required adaptive tuning rules for the estimation of the process faults. This has led to stable observation error systems for both fault detection and diagnosis. A simulated numerical example is included to demonstrate the use of the proposed approach and encouraging results have been obtained.

Global disturbance rejection of a class of nonlinear systems with unknown exosystems

An asymptotic rejection algorithm is proposed for a class of nonlinear systems that have not only additive nonlinear uncertainties but also unknown disturbances. The disturbances are generated from an unknown exosystem, and are assumed to be sinusoidal disturbances with unknown amplitude and frequency. By using the technique of backstepping and adaptive control, a nonlinear state feedback controller is designed. Under the proposed controller, the system＇s state variables asymptotically converge to zero, and the disturbances are rejected completely. The approach used is an integration of the robust stabilization technique, adaptive technique, and backstepping technique.

An Improved Control Algorithm for High-order Nonlinear Systems with Unmodelled Dynamics

In this paper, we consider a class of high-order nonlinear systems with unmodelled dynamics from the viewpoint of maintaining the desired control performance （e,g., asymptotical stability） and reducing the control effort. By introducing a new reseating transformation, adopting an effective reduced-order observer, and choosing an ingenious Lyapunov function and appropriate design parameters, this paper designs all improved output-feedback controller. The output-feedback controller guarantees the globally asymptotieal stability of the closed-loop system. Subsequently, taking a concrete system for an example, the smaller critical values for gain parameter and resealing transformation parameter are obtained to effectively reduce the control effort.

Optimal Neuro-Control Strategy for Nonlinear Systems With Asymmetric Input Constraints

In this paper,we present an optimal neuro-control scheme for continuous-time(CT)nonlinear systems with asymmetric input constraints.Initially,we introduce a discounted cost function for the CT nonlinear systems in order to handle the asymmetric input constraints.Then,we develop a Hamilton-Jacobi-Bellman equation(HJBE),which arises in the discounted cost optimal control problem.To obtain the optimal neurocontroller,we utilize a critic neural network(CNN)to solve the HJBE under the framework of reinforcement learning.The CNN's weight vector is tuned via the gradient descent approach.Based on the Lyapunov method,we prove that uniform ultimate boundedness of the CNN's weight vector and the closed-loop system is guaranteed.Finally,we verify the effectiveness of the present optimal neuro-control strategy through performing simulations of two examples.

Stabilization of a class of switched nonlinear systems

The stabilization of a class of switched nonlinear systems is investigated in the paper. The systems concerned are of （generalized） switched Byrnes-Isidori canonical form, which has all switched models in （generalized） Byrnes- Isidori canonical form. First, a stability result of switched systems is obtained. Then it is used to solve the stabilization problem of the switched nonlinear control systems. In addition, necessary and sufficient conditions are obtained for a switched affine nonlinear system to be feedback equivalent to （generalized） switched Byrnes-Isidori canonical systems are presented. Finally, as an application the stability of switched lorenz systems is investigated.

Tracking Control of Uncertain Nonlinear Systems With Unknown Constant Input Delay

A robust delay compensator has been developed for a class of uncertain nonlinear systems with an unknown constant input delay.The control law consists of feedback terms based on the integral of past control values and a novel filtered tracking error,capable of compensating for input delays.Suitable Lyapunov-Krasovskii functionals are used to prove global uniformly ultimately bounded(GUUB)tracking,provided certain sufficient gain conditions,dependent on the bound of the delay,are satisfied.Simulation results illustrate the performance and robustness of the controller for different values of input delay.

Non-intrusive hybrid interval method for uncertain nonlinear systems using derivative information

This paper proposes a new non-intrusive hybrid interval method using derivative information for the dynamic response analysis of nonlinear systems with uncertain-but- bounded parameters and/or initial conditions. This method provides tighter solution ranges compared to the existing polynomial approximation interval methods. Interval arith- metic using the Chebyshev basis and interval arithmetic using the general form modified affine basis for polynomials are developed to obtain tighter bounds for interval computation. To further reduce the overestimation caused by the ＂wrap- ping effect＂ of interval arithmetic, the derivative information of dynamic responses is used to achieve exact solutions when the dynamic responses are monotonic with respect to all the uncertain variables. Finally, two typical numerical examples with nonlinearity are applied to demonstrate the effective- ness of the proposed hybrid interval method, in particular, its ability to effectively control the overestimation for specific timepoints.

A Robust Fault Detection Approach for Nonlinear Systems

In this paper, we study the robust fault detection problem of nonlinear systems. Based on the Lyapunov method, a robust fault detection approach for a general class of nonlinear systems is proposed. A nonlinear observer is first provided, and a sufficient condition is given to make the observer locally stable. Then, a practical algorithm is presented to facilitate the realization of the proposed observer for robust fault detection. Finally, a numerical example is provided to show the effectiveness of the proposed approach.