Optimal Neuro-Control Strategy for Nonlinear Systems With Asymmetric Input Constraints

In this paper,we present an optimal neuro-control scheme for continuous-time(CT)nonlinear systems with asymmetric input constraints.Initially,we introduce a discounted cost function for the CT nonlinear systems in order to handle the asymmetric input constraints.Then,we develop a Hamilton-Jacobi-Bellman equation(HJBE),which arises in the discounted cost optimal control problem.To obtain the optimal neurocontroller,we utilize a critic neural network(CNN)to solve the HJBE under the framework of reinforcement learning.The CNN's weight vector is tuned via the gradient descent approach.Based on the Lyapunov method,we prove that uniform ultimate boundedness of the CNN's weight vector and the closed-loop system is guaranteed.Finally,we verify the effectiveness of the present optimal neuro-control strategy through performing simulations of two examples.

Multimodel-based flight control system reconfiguration control in the presence of input constraints

In this paper,an active fault accommodate strategy is proposed for the plant in the presence of actuator fault and input constraints,which is a combination of a direct adaptive control algorithm with multiple model switching.The μ-modification is introduced in the model reference architecture to construct the adaptive controller.The proof of stability is based on the candidate Lyapunov function,while appropriate switching of multiple models guarantees asymptotic tracking of the system states and the boundedness of all signals.Simulation results illustrate the efficiency of the proposed method.

Sliding-mode control for a rolling-missile with input constraints

This paper investigates the overload stabilization problem of the rolling-missile subject to parameters uncertainty and actuator saturation. In order to solve this problem, a sliding-mode control(SMC) scheme is technically employed by using the backstepping approach to make the dynamic system stable. In addition,SMC with the tanh-type switching function plays an important role in reducing intrinsic vibration. Furthermore, an auxiliary system(AS) is developed to compensate for nonlinear terms arising from input saturation. Finally, the simulation results provide a solution to demonstrate that the suggested SMC and the AS methodology have advantages of strong tracking capability, anti-interference ability and anti-saturation performance.

Distributed optimization for discrete-time multiagent systems with nonconvex control input constraints and switching topologies

This paper addresses the distributed optimization problem of discrete-time multiagent systems with nonconvex control input constraints and switching topologies.We introduce a novel distributed optimization algorithm with a switching mechanism to guarantee that all agents eventually converge to an optimal solution point,while their control inputs are constrained in their own nonconvex region.It is worth noting that the mechanism is performed to tackle the coexistence of the nonconvex constraint operator and the optimization gradient term.Based on the dynamic transformation technique,the original nonlinear dynamic system is transformed into an equivalent one with a nonlinear error term.By utilizing the nonnegative matrix theory,it is shown that the optimization problem can be solved when the union of switching communication graphs is jointly strongly connected.Finally,a numerical simulation example is used to demonstrate the acquired theoretical results.

Consensus of Multi-Agent Systems with Input Constraints Based on Distributed Predictive Control Scheme

Consensus control of multi-agent systems has attracted compelling attentions from various scientific communities for its promising applications.This paper presents a discrete-time consensus protocol for a class of multi-agent systems with switching topologies and input constraints based on distributed predictive control scheme.The consensus protocol is not only distributed but also depends on the errors of states between agent and its neighbors.We focus mainly on dealing with the input constraints and a distributed model predictive control scheme is developed to achieve stable consensus under the condition that both velocity and acceleration constraints are included simultaneously.The acceleration constraint is regarded as the changing rate of velocity based on some reasonable assumptions so as to simplify the analysis.Theoretical analysis shows that the constrained system steered by the proposed protocol achieves consensus asymptotically if the switching interaction graphs always have a spanning tree.Numerical examples are also provided to illustrate the validity of the algorithm.

New model reference adaptive control with input constraints

A new scheme of adaptive control is proposed for a class of linear time-invariant（ LTI） dynamical systems,especially in aerospace,with matched parametric uncertainties and input constraints. Based on a typical and conventional direct model reference adaptive control scheme,various modifications have been employed to achieve the goal. ＂C omposite model reference adaptive control＂of higher performance is seam-lessly combined with ＂positive μ-mod＂,which consequently results in a smooth tracking trajectory despite of the input constraints. In addition,bounded-gain forgetting is utilized to facilitate faster convergence of parameter estimates. The stability of the closed-loop systemcan be guaranteed by using Lyapunov theory.The merits and effectiveness of the proposed method are illustrated by a numerical example of the longitudinal dynamical systems of a fixed-wing airplane.

Multivariable Decoupling Predictive Control with Input Constraints and Its Application on Chemical Process

A constrained decoupling (generalized predictive control) GPC algorithm is proposed for MIMO (malti-input multi-output) system. This algorithm takes account of all constraints of inputs and their increments. By solving matrix equations, the multi-step predictive decoupling controllers are realized. This algorithm need not solve Diophantine functions, and weakens the cross-coupling of the variables. At last the simulation results demon- strate the effectiveness of this proposed strategy.

Robust predictive control of uncertain intergrating linear systems with input constraints

This paper presents a two-stage robust model predictive control (RMPC) aigorithm named as IRMFC for uncertain linear integrating plants described by a state-space model with input constraints. The global convergence of the resulted closed loop system is guaranteed under mild assumption. The simulation example shows its validity and better performance than conventional Min-Max RMPC strategies.

Application-Oriented Homogeneous Control Protocol Design for Multi-Agent Systems Under Input Constraints

An application-oriented homogeneous control protocol is proposed to solve the consensus problem of multi-agent system(MAS)modeled by higher-order integrator.This nonlinear control protocol is able to homogenize the linear system with a special degree called homogeneity degree.This homogeneous control protocol ensures asymptotically/finite-time stable multi-agent systems(MASs)(or fixed-time attractive to compact sets containing the origin)by selecting di®erent homogeneity degrees.If the linear control protocol for each agent is provided,the proposed nonlinear homogeneous control protocol in this paper can be easily implemented without requiring any tuning of the control parameters.A bounded homogeneous control protocol,which is a special form of the controller proposed,is also introduced to address the same problem with input constraints.Finally,numerical simulations are conducted to demonstrate the e®ectiveness of the proposed approach.

Attitude synchronization for multiple spacecraft with input constraints

The attitude synchronization problem for multiple spacecraft with input constraints is investigated in this paper. Two distributed control laws are presented and analyzed. First, by intro- ducing bounded function, a distributed asymptotically stable control law is proposed. Such a con- trol scheme can guarantee attitude synchronization and the control inputs of each spacecraft can be a priori bounded regardless of the number of its neighbors. Then, based on graph theory, homoge- neous method, and Lyapunov stability theory, a distributed finite-time control law is designed. Rig- orous proof shows that attitude synchronization of multiple spacecraft can be achieved in finite time, and the control scheme satisfies input saturation requirement. Finally, numerical simulations are presented to demonstrate the effectiveness and feasibility of the oroDosed schemes.

An online data driven actor-critic-disturbance guidance law for missile-target interception with input constraints

In this article,we develop an online robust actor-critic-disturbance guidance law for a missile-target interception system with limited normal acceleration capability.Firstly,the missiletarget engagement is formulated as a zero-sum pursuit-evasion game problem.The key is to seek the saddle point solution of the Hamilton Jacobi Isaacs(HJI)equation,which is generally intractable due to the nonlinearity of the problem.Then,based on the universal approximation capability of Neural Networks(NNs),we construct the critic NN,the actor NN and the disturbance NN,respectively.The Bellman error is adjusted by the normalized-least square method.The proposed scheme is proved to be Uniformly Ultimately Bounded(UUB)stable by Lyapunov method.Finally,the effectiveness and robustness of the developed method are illustrated through numerical simulations against different types of non-stationary targets and initial conditions.

Research on consensus of multi-agent systems with and without input saturation constraints

In recent years,with the continuous development of multi-agent technology represented by unmanned aerial vehicle(UAV)swarm,consensus control has become a hot spot in academic research.In this paper,we put forward a discrete-time consensus protocol and obtain the necessary and sufficient conditions for the second-order consensus of the second-order multi-agent system with a fixed structure under the condition of no saturation input.The theoretical derivation verifies that the two eigenvalues of the Laplacian of the communication network matrix and the sampling period have an important effect on achieving consensus.Then we construct and verify sufficient conditions to achieve consensus under the condition of input saturation constraints.The results show that consensus can be achieved if velocity,position gain,and sampling period satisfy a set of inequalities related to the eigenvalues of the Laplacian matrix.Finally,the accuracy and validity of the theoretical results are proved by numerical simulations.

Multi-agent graphical games with input constraints:an online learning solution

This paper studies an online iterative algorithm for solving discrete-time multi-agent dynamic graphical games with input constraints.In order to obtain the optimal strategy of each agent,it is necessary to solve a set of coupled Hamilton-Jacobi-Bellman(HJB)equations.It is very difficult to solve HJB equations by the traditional method.The relevant game problem will become more complex if the control input of each agent in the dynamic graphical game is constrained.In this paper,an online iterative algorithm is proposed to find the online solution to dynamic graphical game without the need for drift dynamics of agents.Actually,this algorithm is to find the optimal solution of Bellman equations online.This solution employs a distributed policy iteration process,using only the local information available to each agent.It can be proved that under certain conditions,when each agent updates its own strategy simultaneously,the whole multi-agent system will reach Nash equilibrium.In the process of algorithm implementation,for each agent,two layers of neural networks are used to fit the value function and control strategy,respectively.Finally,a simulation example is given to show the effectiveness of our method.

Adaptive output consensus for heterogeneous nonlinear multi-agent systems with multi-type input constraints under switching-directed topologies

This study concentrates on solving the output consensus problem for a class of heterogeneous uncertain nonstrict-feedback nonlinear multi-agent systems under switching-directed communication topologies,in which all followers are subjected to multi-type input constraints such as unknown asymmetric saturation,unknown dead-zone and their integration.A unified representation is presented to overcome the difficulties originating from multi-agent input constraints.Moreover,the uncertain system functions in a non-lower triangular form and the interaction terms among agents are dealt with by exploiting the fuzzy logic systems and their special property.Furthermore,by introducing a nonlinear filter to alleviate the problem of“explosion of complexity”during the backstepping design,a distributed common adaptive control protocol is proposed to ensure that the synchronization errors converge to a small neighborhood of the origin despite the existence of multiple input constraints and arbitrary switching communication topologies.Both stability analysis and simulation results are conducted to show the effectiveness and performance of the proposed control methodology.

Neural network-based adaptive decentralized learning control for interconnected systems with input constraints

In this paper,the neural network-based adaptive decentralized learning control is investigated for nonlinear interconnected systems with input constraints.Because the decentralized control of interconnected systems is related to the optimal control of each isolated subsystem,the decentralized control strategy can be established by a series of optimal control policies.A novel policy iteration algorithm is presented to solve the Hamilton–Jacobi–Bellman equation related to the optimal control problem.This algorithm is implemented under the actor-critic structure where both neural networks are simultaneously updated to approximate the optimal control policy and the optimal cost function,respectively.The additional stabilizing term is introduced and an improved weight updating law is derived,which relaxes the requirement of initial admissible control policy.Besides,the input constraints of interconnected systems are taken into account and the Hamilton–Jacobi–Bellman equation is solved in the presence of input constraints.The interconnected system states and the weight approximation errors of two neural networks are proven to be uniformly ultimately bounded by utilizing Lyapunov theory.Finally,the effectiveness of the proposed decentralized learning control method is verified by simulation results.

Polynomial networks based adaptive attitude tracking control for NSVs with input constraints and stochastic noises

This paper proposes a backstepping technique and Multi-dimensional Taylor Polynomial Networks(MTPN)based adaptive attitude tracking control strategy for Near Space Vehicles(NSVs)subjected to input constraints and stochastic input noises.Firstly,considering the control input has stochastic noises,and the attitude motion dynamical model of the NSVs is actually modeled as the Multi-Input Multi-Output(MIMO)stochastic nonlinear system form.Furthermore,the MTPN is used to estimate the unknown system uncertainties,and an auxiliary system is designed to compensate the influence of the saturation control input.Then,by using backstepping method and the output of the auxiliary system,a MTPN-based robust adaptive attitude control approach is proposed for the NSVs with saturation input nonlinearity,stochastic input noises,and system uncertainties.Stochastic Lyapunov stability theory is utilized to analysis the stability in the sense of probability of the entire closed-loop system.Additionally,by selecting appropriate parameters,the tracking errors will converge to a small neighborhood with a tunable radius.Finally,the numerical simulation results of the NSVs attitude motion show the satisfactory flight control performance under the proposed tracking control strategy.

Finite-Time Neural Funnel Control for Motor Servo Systems with Unknown Input Constraint

In this paper, a finite-time neural funnel control(FTNFC) scheme is proposed for motor servo systems with unknown input constraint. To deal with the non-smooth input saturation constraint problem, a smooth non-affine function of the control input signal is employed to approximate the saturation constraint, which is further transformed into an affine form according to the mean-value theorem. A fast terminal sliding mode manifold is constructed by using a novel funnel error variable to force the tracking error falling into a prescribe boundary within a finite time. Then, a simple sigmoid neural network is utilized to approximate the unknown system nonlinearity including the saturation.Different from the prescribed performance control(PPC), the proposed finite-time neural funnel control avoids using the inverse transformed function in the controller design, and could guarantee the prescribed tracking performance without knowing the saturation bounds in prior. The effectiveness and superior performance of the proposed method are verified by comparative simulation results.

Adaptive Control Based on Neural Networks for an Uncertain 2-DOF Helicopter System With Input Deadzone and Output Constraints

In this paper, a study of control for an uncertain2-degree of freedom(DOF) helicopter system is given. The2-DOF helicopter is subject to input deadzone and output constraints. In order to cope with system uncertainties and input deadzone, the neural network technique is introduced because of its capability in approximation. In order to update the weights of the neural network, an adaptive control method is utilized to improve the system adaptability. Furthermore, the integral barrier Lyapunov function(IBLF) is adopt in control design to guarantee the condition of output constraints and boundedness of the corresponding tracking errors. The Lyapunov direct method is applied in the control design to analyze system stability and convergence. Finally, numerical simulations are conducted to prove the feasibility and effectiveness of the proposed control based on the model of Quanser's 2-DOF helicopter.

考虑输出约束和输入饱和的弹仓自适应控制

针对存在参数不确定性和外部扰动的某链式回转弹仓的位置跟踪控制问题,提出一种自适应控制方案。该方案基于神经模糊系统(Neuro-Fuzzy System,NFS)、非线性扰动观测器(Nonlinear Disturbance Observer,NDO)及障碍Lyapunov函数(Barrier Lyapunov Function,BLF),在实现高精度控制的同时满足输出约束和输入饱和的工程条件。通过BLF的设计,保证弹仓的位移跟踪误差约束在给定范围内。结合神经网络的函数逼近能力和模糊逻辑系统的推理能力,用于估计系统中的不确定性,减小对模型的依赖;两者结合的NFS作为NDO的一部分,进一步补偿估计误差和外部扰动,提高控制性能。此外,控制器设计考虑了运动过程中的执行器输入饱和问题。仿真结果表明,所设计的控制器在3种典型工况以及系统参数变化情况下均可实现弹仓的高精度位置跟踪控制,满足系统的约束条件。

输入受限乘波体飞行器无估计预设性能控制

针对输入受限的乘波体飞行器跟踪控制问题,提出了一种无估计的预设性能控制方法。首先,针对可能发生的执行器饱和问题,设计了一种新型抗饱和补偿系统。然后,利用补偿系统状态构造新的预设性能转换误差,基于预设性能控制与反演控制的方法,为速度子系统与高度子系统设计了无需估计的低复杂度控制器。该设计方法的优越性在于无需状态估计与神经逼近,显著降低了控制的复杂度与计算量。基于Lyapunov稳定理论证明了所有转换误差与跟踪误差最终一致有界。最后,通过数值仿真验证了所提方法的有效性。