Continuous Sliding Mode Controller with Disturbance Observer for Hypersonic Vehicles

In this paper, a continuous sliding mode controller with disturbance observer is proposed for the tracking control of hypersonic vehicles to suppress the chattering. The finite time disturbance observer is involved to make that the continuous sliding mode controller has the property of disturbance rejection. Due to continuous terms replacing the discontinuous term of traditional sliding mode control, switching modes of velocity and altitude firstly arrive at small regions with respect to disturbance observation errors. Switching modes keep zero and velocity and altitude asymptotically converge to their reference commands after disturbance observation errors disappear. Simulation results have proved the proposed method can guarantee the tracking of velocity and altitude with continuous sliding mode control laws, and also has the fast convergence rate and robustness. © 2014 Chinese Association of Automation.

Characteristic Model-based Discrete-time Sliding Mode Control for Spacecraft with Variable Tilt of Flexible Structures

In this paper, the finite-time attitude tracking control problem for the spacecrafts with variable tilt of flexible appendages in the conditions of exogenous disturbances and inertia uncertainties is addressed. First the characteristic modeling method is applied to the problem of the spacecraft modeling. Second, a novel adaptive sliding mode surface is designed based on the characteristic model. Furthermore, a discrete-time sliding mode control (DTSMC) law, which makes the tracking error converge into a predefined bound in finite time, is proposed by employing the parameters of characteristic model associated with the sliding mode surface to provide better performances, robustness, faster response, and higher control precision. The designed DTSMC includes the adaptive control architecture and is chattering-free. Finally, digital simulations of a sun synchronous orbit satellite (SSOS) are presented to illustrate effectiveness of the control strategies as well as to verify the practical feasibility of the rapid maneuver mission. © 2014 Chinese Association of Automation.

Learning-based control for discrete-time constrained nonzero-sum games

A generalized policy-iteration-based solution to a class of discrete-time multi-player nonzero-sum games concerning the control constraints was proposed.Based on initial admissible control policies,the iterative value function of each player converges to the optimum approximately,which is structured by the iterative control policies satisfying the Nash equilibrium.Afterwards,the stability analysis is shown to illustrate that the iterative control policies can stabilize the system and minimize the performance index function of each player.Meanwhile,neural networks are implemented to approximate the iterative control policies and value functions with the impact of control constraints.Finally,two numerical simulations of the discrete-time two-player non-zero-sum games for linear and non-linear systems are shown to illustrate the effectiveness of the proposed scheme.

A Data-Based Feedback Relearning Algorithm for Uncertain Nonlinear Systems

In this paper,a data-based feedback relearning algorithm is proposed for the robust control problem of uncertain nonlinear systems.Motivated by the classical on-policy and off-policy algorithms of reinforcement learning,the online feedback relearning(FR)algorithm is developed where the collected data includes the influence of disturbance signals.The FR algorithm has better adaptability to environmental changes(such as the control channel disturbances)compared with the off-policy algorithm,and has higher computational efficiency and better convergence performance compared with the on-policy algorithm.Data processing based on experience replay technology is used for great data efficiency and convergence stability.Simulation experiments are presented to illustrate convergence stability,optimality and algorithmic performance of FR algorithm by comparison.

Adaptive composite frequency control of power systems using reinforcement learning

With the incorporation of renewable energy,load frequency control(LFC)becomes more challenging due to uncertain power generation and changeable load demands.The electric vehicle(EV)has been a popular transportation and can also provide flexible options to play a role in frequency regulation.In this paper,a novel adaptive composite controller is designed to solve the LFC problem for the interconnected power system with electric vehicles and wind turbine.EVs are used as regulation resources to effectively compensate the power mismatch.First,the sliding mode controller is developed to reduce the random influences caused by the wind turbine generation system.Second,an auxiliary controller with reinforcement learning is proposed to produce adaptive control signals,which will be attached to the primary proportion-integration-differentiation control signal in a realtime manner.Finally,by considering random wind power,load disturbances and output constraints,the proposed scheme is verified on a two-area power system under four different cases.Simulation results demonstrate that the proposed adaptive composite frequency control scheme has a competitive performance with regard to dynamic performance.

Heuristic dynamic programming-based learning control for discrete-time disturbed multi-agent systems

Owing to extensive applications in many fields,the synchronization problem has been widely investigated in multi-agent systems.The synchronization for multi-agent systems is a pivotal issue,which means that under the designed control policy,the output of systems or the state of each agent can be consistent with the leader.The purpose of this paper is to investigate a heuristic dynamic programming(HDP)-based learning tracking control for discrete-time multi-agent systems to achieve synchronization while considering disturbances in systems.Besides,due to the difficulty of solving the coupled Hamilton–Jacobi–Bellman equation analytically,an improved HDP learning control algorithm is proposed to realize the synchronization between the leader and all following agents,which is executed by an action-critic neural network.The action and critic neural network are utilized to learn the optimal control policy and cost function,respectively,by means of introducing an auxiliary action network.Finally,two numerical examples and a practical application of mobile robots are presented to demonstrate the control performance of the HDP-based learning control algorithm.

基于安全自适应强化学习的自主避障控制方法

障碍规避是无人机等自主无人系统运动规划的重要环节,其核心是设计有效的避障控制方法.为了进一步提高决策优化性和控制效果,本文在最优控制的设定下,提出一种基于强化学习的自主避障控制方法,以自适应方式在线生成安全运行轨迹.首先,利用障碍函数法在代价函数中设计了一个光滑的奖惩函数,从而将避障问题转换为一个无约束的最优控制问题.然后,利用行为–评价神经网络和策略迭代法实现了自适应强化学习,其中评价网络利用状态跟随核函数逼近代价函数,行为网络给出近似最优的控制策略;同时,通过状态外推法获得模拟经验,使得评价网络能利用经验回放实现可靠的局部探索.最后,在简化的无人机系统和非线性数值系统上进行了仿真实验与方法对比,结果表明,提出的避障控制方法能实时生成较优的安全运行轨迹.

Analytical reentry guidance framework based on swarm intelligence optimization and altitude-energy profile

Aimed at improving the real-time performance of guidance instruction generation,an analytical hypersonic reentry guidance framework is presented.The key steps of the novel guidance framework are the parameterization of reentry guidance problems and the optimization of parameters.First,a quintic polynomial function of energy was designed to describe the altitude profile.Then,according to the altitude-energy profile,the altitude,velocity,flight path angle,and bank angle were obtained analytically,which naturally met the terminal constraints.In addition,the angle of the attack profile was determined using the velocity parameter.The swarm intelligent optimization algorithms were used to optimize the parameters.The path constraints were enforced by the penalty function method.Finally,extensive simulations were carried out in both nominal and dispersed cases,and the simulation results showed that the proposed guidance framework was effective,high-precision,and robust in different scenarios.

Neural network-based adaptive decentralized learning control for interconnected systems with input constraints

In this paper,the neural network-based adaptive decentralized learning control is investigated for nonlinear interconnected systems with input constraints.Because the decentralized control of interconnected systems is related to the optimal control of each isolated subsystem,the decentralized control strategy can be established by a series of optimal control policies.A novel policy iteration algorithm is presented to solve the Hamilton–Jacobi–Bellman equation related to the optimal control problem.This algorithm is implemented under the actor-critic structure where both neural networks are simultaneously updated to approximate the optimal control policy and the optimal cost function,respectively.The additional stabilizing term is introduced and an improved weight updating law is derived,which relaxes the requirement of initial admissible control policy.Besides,the input constraints of interconnected systems are taken into account and the Hamilton–Jacobi–Bellman equation is solved in the presence of input constraints.The interconnected system states and the weight approximation errors of two neural networks are proven to be uniformly ultimately bounded by utilizing Lyapunov theory.Finally,the effectiveness of the proposed decentralized learning control method is verified by simulation results.

Data-based intelligent modeling and control for nonlinear systems

With the ever increasing complexity of industrial systems,model-based control has encountered difficulties and is facing problems,while the interest in data-based control has been booming.This paper gives an overview of data-based control,which divides it into two subfields,intelligent modeling and direct controller design.In the two subfields,some important methods concerning data-based control are intensively investigated.Within the framework of data-based modeling,main modeling technologies and control strategies are discussed,and then fundamental concepts and various algorithms are presented for the design of a data-based controller.Finally,some remaining challenges are suggested.