Distributed optimization for discrete-time multiagent systems with nonconvex control input constraints and switching topologies

This paper addresses the distributed optimization problem of discrete-time multiagent systems with nonconvex control input constraints and switching topologies.We introduce a novel distributed optimization algorithm with a switching mechanism to guarantee that all agents eventually converge to an optimal solution point,while their control inputs are constrained in their own nonconvex region.It is worth noting that the mechanism is performed to tackle the coexistence of the nonconvex constraint operator and the optimization gradient term.Based on the dynamic transformation technique,the original nonlinear dynamic system is transformed into an equivalent one with a nonlinear error term.By utilizing the nonnegative matrix theory,it is shown that the optimization problem can be solved when the union of switching communication graphs is jointly strongly connected.Finally,a numerical simulation example is used to demonstrate the acquired theoretical results.

Consensus of Multi-Agent Systems with Input Constraints Based on Distributed Predictive Control Scheme

Consensus control of multi-agent systems has attracted compelling attentions from various scientific communities for its promising applications.This paper presents a discrete-time consensus protocol for a class of multi-agent systems with switching topologies and input constraints based on distributed predictive control scheme.The consensus protocol is not only distributed but also depends on the errors of states between agent and its neighbors.We focus mainly on dealing with the input constraints and a distributed model predictive control scheme is developed to achieve stable consensus under the condition that both velocity and acceleration constraints are included simultaneously.The acceleration constraint is regarded as the changing rate of velocity based on some reasonable assumptions so as to simplify the analysis.Theoretical analysis shows that the constrained system steered by the proposed protocol achieves consensus asymptotically if the switching interaction graphs always have a spanning tree.Numerical examples are also provided to illustrate the validity of the algorithm.

New model reference adaptive control with input constraints

A new scheme of adaptive control is proposed for a class of linear time-invariant（ LTI） dynamical systems,especially in aerospace,with matched parametric uncertainties and input constraints. Based on a typical and conventional direct model reference adaptive control scheme,various modifications have been employed to achieve the goal. ＂C omposite model reference adaptive control＂of higher performance is seam-lessly combined with ＂positive μ-mod＂,which consequently results in a smooth tracking trajectory despite of the input constraints. In addition,bounded-gain forgetting is utilized to facilitate faster convergence of parameter estimates. The stability of the closed-loop systemcan be guaranteed by using Lyapunov theory.The merits and effectiveness of the proposed method are illustrated by a numerical example of the longitudinal dynamical systems of a fixed-wing airplane.

Optimal Neuro-Control Strategy for Nonlinear Systems With Asymmetric Input Constraints

In this paper,we present an optimal neuro-control scheme for continuous-time(CT)nonlinear systems with asymmetric input constraints.Initially,we introduce a discounted cost function for the CT nonlinear systems in order to handle the asymmetric input constraints.Then,we develop a Hamilton-Jacobi-Bellman equation(HJBE),which arises in the discounted cost optimal control problem.To obtain the optimal neurocontroller,we utilize a critic neural network(CNN)to solve the HJBE under the framework of reinforcement learning.The CNN's weight vector is tuned via the gradient descent approach.Based on the Lyapunov method,we prove that uniform ultimate boundedness of the CNN's weight vector and the closed-loop system is guaranteed.Finally,we verify the effectiveness of the present optimal neuro-control strategy through performing simulations of two examples.

Multimodel-based flight control system reconfiguration control in the presence of input constraints

In this paper,an active fault accommodate strategy is proposed for the plant in the presence of actuator fault and input constraints,which is a combination of a direct adaptive control algorithm with multiple model switching.The μ-modification is introduced in the model reference architecture to construct the adaptive controller.The proof of stability is based on the candidate Lyapunov function,while appropriate switching of multiple models guarantees asymptotic tracking of the system states and the boundedness of all signals.Simulation results illustrate the efficiency of the proposed method.

Sliding-mode control for a rolling-missile with input constraints

This paper investigates the overload stabilization problem of the rolling-missile subject to parameters uncertainty and actuator saturation. In order to solve this problem, a sliding-mode control(SMC) scheme is technically employed by using the backstepping approach to make the dynamic system stable. In addition,SMC with the tanh-type switching function plays an important role in reducing intrinsic vibration. Furthermore, an auxiliary system(AS) is developed to compensate for nonlinear terms arising from input saturation. Finally, the simulation results provide a solution to demonstrate that the suggested SMC and the AS methodology have advantages of strong tracking capability, anti-interference ability and anti-saturation performance.

Application-Oriented Homogeneous Control Protocol Design for Multi-Agent Systems Under Input Constraints

An application-oriented homogeneous control protocol is proposed to solve the consensus problem of multi-agent system(MAS)modeled by higher-order integrator.This nonlinear control protocol is able to homogenize the linear system with a special degree called homogeneity degree.This homogeneous control protocol ensures asymptotically/finite-time stable multi-agent systems(MASs)(or fixed-time attractive to compact sets containing the origin)by selecting di®erent homogeneity degrees.If the linear control protocol for each agent is provided,the proposed nonlinear homogeneous control protocol in this paper can be easily implemented without requiring any tuning of the control parameters.A bounded homogeneous control protocol,which is a special form of the controller proposed,is also introduced to address the same problem with input constraints.Finally,numerical simulations are conducted to demonstrate the e®ectiveness of the proposed approach.

Attitude synchronization for multiple spacecraft with input constraints

The attitude synchronization problem for multiple spacecraft with input constraints is investigated in this paper. Two distributed control laws are presented and analyzed. First, by intro- ducing bounded function, a distributed asymptotically stable control law is proposed. Such a con- trol scheme can guarantee attitude synchronization and the control inputs of each spacecraft can be a priori bounded regardless of the number of its neighbors. Then, based on graph theory, homoge- neous method, and Lyapunov stability theory, a distributed finite-time control law is designed. Rig- orous proof shows that attitude synchronization of multiple spacecraft can be achieved in finite time, and the control scheme satisfies input saturation requirement. Finally, numerical simulations are presented to demonstrate the effectiveness and feasibility of the oroDosed schemes.

An online data driven actor-critic-disturbance guidance law for missile-target interception with input constraints

In this article,we develop an online robust actor-critic-disturbance guidance law for a missile-target interception system with limited normal acceleration capability.Firstly,the missiletarget engagement is formulated as a zero-sum pursuit-evasion game problem.The key is to seek the saddle point solution of the Hamilton Jacobi Isaacs(HJI)equation,which is generally intractable due to the nonlinearity of the problem.Then,based on the universal approximation capability of Neural Networks(NNs),we construct the critic NN,the actor NN and the disturbance NN,respectively.The Bellman error is adjusted by the normalized-least square method.The proposed scheme is proved to be Uniformly Ultimately Bounded(UUB)stable by Lyapunov method.Finally,the effectiveness and robustness of the developed method are illustrated through numerical simulations against different types of non-stationary targets and initial conditions.

Multi-agent graphical games with input constraints:an online learning solution

This paper studies an online iterative algorithm for solving discrete-time multi-agent dynamic graphical games with input constraints.In order to obtain the optimal strategy of each agent,it is necessary to solve a set of coupled Hamilton-Jacobi-Bellman(HJB)equations.It is very difficult to solve HJB equations by the traditional method.The relevant game problem will become more complex if the control input of each agent in the dynamic graphical game is constrained.In this paper,an online iterative algorithm is proposed to find the online solution to dynamic graphical game without the need for drift dynamics of agents.Actually,this algorithm is to find the optimal solution of Bellman equations online.This solution employs a distributed policy iteration process,using only the local information available to each agent.It can be proved that under certain conditions,when each agent updates its own strategy simultaneously,the whole multi-agent system will reach Nash equilibrium.In the process of algorithm implementation,for each agent,two layers of neural networks are used to fit the value function and control strategy,respectively.Finally,a simulation example is given to show the effectiveness of our method.

Polynomial networks based adaptive attitude tracking control for NSVs with input constraints and stochastic noises

This paper proposes a backstepping technique and Multi-dimensional Taylor Polynomial Networks(MTPN)based adaptive attitude tracking control strategy for Near Space Vehicles(NSVs)subjected to input constraints and stochastic input noises.Firstly,considering the control input has stochastic noises,and the attitude motion dynamical model of the NSVs is actually modeled as the Multi-Input Multi-Output(MIMO)stochastic nonlinear system form.Furthermore,the MTPN is used to estimate the unknown system uncertainties,and an auxiliary system is designed to compensate the influence of the saturation control input.Then,by using backstepping method and the output of the auxiliary system,a MTPN-based robust adaptive attitude control approach is proposed for the NSVs with saturation input nonlinearity,stochastic input noises,and system uncertainties.Stochastic Lyapunov stability theory is utilized to analysis the stability in the sense of probability of the entire closed-loop system.Additionally,by selecting appropriate parameters,the tracking errors will converge to a small neighborhood with a tunable radius.Finally,the numerical simulation results of the NSVs attitude motion show the satisfactory flight control performance under the proposed tracking control strategy.

Neural network-based adaptive decentralized learning control for interconnected systems with input constraints

In this paper,the neural network-based adaptive decentralized learning control is investigated for nonlinear interconnected systems with input constraints.Because the decentralized control of interconnected systems is related to the optimal control of each isolated subsystem,the decentralized control strategy can be established by a series of optimal control policies.A novel policy iteration algorithm is presented to solve the Hamilton–Jacobi–Bellman equation related to the optimal control problem.This algorithm is implemented under the actor-critic structure where both neural networks are simultaneously updated to approximate the optimal control policy and the optimal cost function,respectively.The additional stabilizing term is introduced and an improved weight updating law is derived,which relaxes the requirement of initial admissible control policy.Besides,the input constraints of interconnected systems are taken into account and the Hamilton–Jacobi–Bellman equation is solved in the presence of input constraints.The interconnected system states and the weight approximation errors of two neural networks are proven to be uniformly ultimately bounded by utilizing Lyapunov theory.Finally,the effectiveness of the proposed decentralized learning control method is verified by simulation results.

Research on consensus of multi-agent systems with and without input saturation constraints

In recent years,with the continuous development of multi-agent technology represented by unmanned aerial vehicle(UAV)swarm,consensus control has become a hot spot in academic research.In this paper,we put forward a discrete-time consensus protocol and obtain the necessary and sufficient conditions for the second-order consensus of the second-order multi-agent system with a fixed structure under the condition of no saturation input.The theoretical derivation verifies that the two eigenvalues of the Laplacian of the communication network matrix and the sampling period have an important effect on achieving consensus.Then we construct and verify sufficient conditions to achieve consensus under the condition of input saturation constraints.The results show that consensus can be achieved if velocity,position gain,and sampling period satisfy a set of inequalities related to the eigenvalues of the Laplacian matrix.Finally,the accuracy and validity of the theoretical results are proved by numerical simulations.

Adaptive output consensus for heterogeneous nonlinear multi-agent systems with multi-type input constraints under switching-directed topologies

This study concentrates on solving the output consensus problem for a class of heterogeneous uncertain nonstrict-feedback nonlinear multi-agent systems under switching-directed communication topologies,in which all followers are subjected to multi-type input constraints such as unknown asymmetric saturation,unknown dead-zone and their integration.A unified representation is presented to overcome the difficulties originating from multi-agent input constraints.Moreover,the uncertain system functions in a non-lower triangular form and the interaction terms among agents are dealt with by exploiting the fuzzy logic systems and their special property.Furthermore,by introducing a nonlinear filter to alleviate the problem of“explosion of complexity”during the backstepping design,a distributed common adaptive control protocol is proposed to ensure that the synchronization errors converge to a small neighborhood of the origin despite the existence of multiple input constraints and arbitrary switching communication topologies.Both stability analysis and simulation results are conducted to show the effectiveness and performance of the proposed control methodology.

Control Design for Harmonic Disturbance Rejection for Robot Manipulators with Bounded Inputs

Currently most of control methods are of one degree of freedom（1-DOF） control structure for the robot systems which are affected by unmeasurable harmonic disturbances,at the same time in order to obtain perfect disturbance attenuation level,the controller gain must be increased.In practice,however,for robotic actuators,there are physical constraints that limit the amplitude of the available torques.This paper considers the problem of tracking control under input constraints for robot manipulators which are affected by unmeasurable harmonic disturbances.A new control scheme is proposed for the problem,which is composed of a parameter-dependent nonlinear observer and a tracking controller.The parameter-dependent nonlinear observer,designed based on the internal model principle,can achieve an estimation and compensation of a class of harmonic disturbances with unknown frequencies.The tracking controller,designed via adaptive control techniques,can make the systems asymptotically track the desired trajectories.In the control design,the continuous piecewise differentiable increasing function is used to limit control input amplitude,such that the control input saturation is avoided.The Lyapunov stability of closed loop systems is analyzed.To validate proposed control scheme,simulation results are provided for a two link horizontal robot manipulator.The simulation results show that the proposed control scheme ensures asymptotic tracking in presence of an uncertain external disturbance acting on the system.An important feature of the methodology consists of the fact that the designed controller is of 2-DOF control structure,namely,it has the ability to overcome the conflict between controller gain and robustness against external disturbances in the traditional 1 -DOF control structure framework.

Event-based performance guaranteed tracking control for constrained nonlinear system via adaptive dynamic programming method

An optimal tracking control problem for a class of nonlinear systems with guaranteed performance and asymmetric input constraints is discussed in this paper.The control policy is implemented by adaptive dynamic programming(ADP)algorithm under two event-based triggering mechanisms.It is often challenging to design an optimal control law due to the system deviation caused by asymmetric input constraints.First,a prescribed performance control technique is employed to guarantee the tracking errors within predetermined boundaries.Subsequently,considering the asymmetric input constraints,a discounted non-quadratic cost function is introduced.Moreover,in order to reduce controller updates,an event-triggered control law is developed for ADP algorithm.After that,to further simplify the complexity of controller design,this work is extended to a self-triggered case for relaxing the need for continuous signal monitoring by hardware devices.By employing the Lyapunov method,the uniform ultimate boundedness of all signals is proved to be guaranteed.Finally,a simulation example on a mass–spring–damper system subject to asymmetric input constraints is provided to validate the effectiveness of the proposed control scheme.

Constrained predictive control based on T-S fuzzy model for nonlinear systems

A constrained generalized predictive control （GPC） algorithm based on the T-S fuzzy model is presented for the nonlinear system. First, a Takagi-Sugeno （T-S） fuzzy model based on the fuzzy cluster algorithm and the orthogonalleast square method is constructed to approach the nonlinear system. Since its consequence is linear, it can divide the nonlinear system into a number of linear or nearly linear subsystems. For this T-S fuzzy model, a GPC algorithm with input constraints is presented. This strategy takes into account all the constraints of the control signal and its increment, and does not require the calculation of the Diophantine equations. So it needs only a small computer memory and the computational speed is high. The simulation results show a good performance for the nonlinear systems.

Gaussian Process Based Modeling and Control of Affine Systems with Control Saturation Constraints

Model-based methods require an accurate dynamic model to design the controller.However,the hydraulic parameters of nonlinear systems,complex friction,or actuator dynamics make it challenging to obtain accurate models.In this case,using the input-output data of the system to learn a dynamic model is an alternative approach.Therefore,we propose a dynamic model based on the Gaussian process(GP)to construct systems with control constraints.Since GP provides a measure of model confidence,it can deal with uncertainty.Unfortunately,most GP-based literature considers model uncertainty but does not consider the effect of constraints on inputs in closed-loop systems.An auxiliary system is developed to deal with the influence of the saturation constraints of input.Meanwhile,we relax the nonsingular assumption of the control coefficients to construct the controller.Some numerical results verify the rationality of the proposed approach and compare it with similar methods.

A neuro-observer-based optimal control for nonaffine nonlinear systems with control input saturations

In this study,an adaptive neuro-observer-based optimal control(ANOPC)policy is introduced for unknown nonaffine nonlinear systems with control input constraints.Hamilton–Jacobi–Bellman(HJB)framework is employed to minimize a non-quadratic cost function corresponding to the constrained control input.ANOPC consists of both analytical and algebraic parts.In the analytical part,first,an observer-based neural network(NN)approximates uncertain system dynamics,and then another NN structure solves the HJB equation.In the algebraic part,the optimal control input that does not exceed the saturation bounds is generated.The weights of two NNs associated with observer and controller are simultaneously updated in an online manner.The ultimately uniformly boundedness(UUB)of all signals of the whole closed-loop system is ensured through Lyapunov’s direct method.Finally,two numerical examples are provided to confirm the effectiveness of the proposed control strategy.

Formation flight of fixed-wing UAV swarms:A group-based hierarchical approach

This paper investigates a formation control problem of fixed-wing Unmanned Aerial Vehicle(UAV) swarms. A group-based hierarchical architecture is established among the UAVs, which decomposes all the UAVs into several distinct and non-overlapping groups. In each group, the UAVs form hierarchies with one UAV selected as the group leader. All group leaders execute coordinated path following to cooperatively handle the mission process among different groups, and the remaining followers track their direct leaders to achieve the inner-group coordination. More specifically, for a group leader, a virtual target moving along its desired path is assigned for the UAV, and an updating law is proposed to coordinate all the group leaders’ virtual targets;for a follower UAV, the distributed leader-following formation control law is proposed to make the follower’s heading angle coincide with its direct leader, while keeping the desired relative position with respect to its direct leader. The proposed control law guarantees the globally asymptotic stability of the whole closed-loop swarm system under the control input constraints of fixed-wing UAVs. Theoretical proofs and numerical simulations are provided, which corroborate the effectiveness of the proposed method.