Finite-Time Stabilization for Constrained Discrete-time Systems by Using Model Predictive Control

In this paper, a model predictive control(MPC)framework is proposed for finite-time stabilization of linear and nonlinear discrete-time systems subject to state and control constraints. The proposed MPC framework guarantees the finite-time convergence property by assigning the control horizon equal to the dimension of the overall system, and only penalizing the terminal cost in the optimization, where the stage costs are not penalized explicitly. A terminal inequality constraint is added to guarantee the feasibility and stability of the closed-loop system.Initial feasibility can be improved via augmentation. The finite-time convergence of the proposed MPC is proved theoretically,and is supported by simulation examples.

Sequential Inverse Optimal Control of Discrete-Time Systems

This paper presents a novel sequential inverse optimal control(SIOC)method for discrete-time systems,which calculates the unknown weight vectors of the cost function in real time using the input and output of an optimally controlled discrete-time system.The proposed method overcomes the limitations of previous approaches by eliminating the need for the invertible Jacobian assumption.It calculates the possible-solution spaces and their intersections sequentially until the dimension of the intersection space decreases to one.The remaining one-dimensional vector of the possible-solution space’s intersection represents the SIOC solution.The paper presents clear conditions for convergence and addresses the issue of noisy data by clarifying the conditions for the singular values of the matrices that relate to the possible-solution space.The effectiveness of the proposed method is demonstrated through simulation results.

Adaptive Multi-Step Evaluation Design With Stability Guarantee for Discrete-Time Optimal Learning Control

This paper is concerned with a novel integrated multi-step heuristic dynamic programming(MsHDP)algorithm for solving optimal control problems.It is shown that,initialized by the zero cost function,MsHDP can converge to the optimal solution of the Hamilton-Jacobi-Bellman(HJB)equation.Then,the stability of the system is analyzed using control policies generated by MsHDP.Also,a general stability criterion is designed to determine the admissibility of the current control policy.That is,the criterion is applicable not only to traditional value iteration and policy iteration but also to MsHDP.Further,based on the convergence and the stability criterion,the integrated MsHDP algorithm using immature control policies is developed to accelerate learning efficiency greatly.Besides,actor-critic is utilized to implement the integrated MsHDP scheme,where neural networks are used to evaluate and improve the iterative policy as the parameter architecture.Finally,two simulation examples are given to demonstrate that the learning effectiveness of the integrated MsHDP scheme surpasses those of other fixed or integrated methods.

Policy Iteration for Optimal Control of Discrete-Time Time-Varying Nonlinear Systems

Aimed at infinite horizon optimal control problems of discrete time-varying nonlinear systems,in this paper,a new iterative adaptive dynamic programming algorithm,which is the discrete-time time-varying policy iteration(DTTV)algorithm,is developed.The iterative control law is designed to update the iterative value function which approximates the index function of optimal performance.The admissibility of the iterative control law is analyzed.The results show that the iterative value function is non-increasingly convergent to the Bellman-equation optimal solution.To implement the algorithm,neural networks are employed and a new implementation structure is established,which avoids solving the generalized Bellman equation in each iteration.Finally,the optimal control laws for torsional pendulum and inverted pendulum systems are obtained by using the DTTV policy iteration algorithm,where the mass and pendulum bar length are permitted to be time-varying parameters.The effectiveness of the developed method is illustrated by numerical results and comparisons.

pth-Moment Stabilization of Hybrid Stochastic Differential Equations by Discrete-Time Feedback Control

The given unstable hybrid stochastic differential equation is stabilized in the sense of p th-moment exponential stability.We achieve the results by feedback controls based on the discrete-time state and mode observations.The upper bound on the duration between two consecutive observations is obtained as well.Finally,a numerical example is given to verify the validity of the theoretical conclusions.

Discrete-time Markov-based dynamic control approach for compressed sampling

To solve the problem that the signal sparsity level is time-varying and not known as a priori in most cases,a signal sparsity level prediction and optimal sampling rate determination scheme is proposed.The discrete-time Markov chain is used to model the signal sparsity level and analyze the transition between different states.According to the current state,the signal sparsity level state in the next sampling period and its probability are predicted.Furthermore,based on the prediction results,a dynamic control approach is proposed to find out the optimal sampling rate with the aim of maximizing the expected reward which considers both the energy consumption and the recovery accuracy.The proposed approach can balance the tradeoff between the energy consumption and the recovery accuracy.Simulation results show that the proposed dynamic control approach can significantly improve the sampling performance compared with the existing approach.

LMI-based robust control of uncertain discrete-time piecewise affine systems

The main contribution of this paper is to present stability synthesis results for discrete-time piecewise affine （PWA） systems with polytopic time-varying uncertainties and for discrete-time PWA systems with norm-bounded uncertainties respectively.The basic idea of the proposed approaches is to construct piecewise-quadratic （PWQ） Lyapunov functions to guarantee the stability of the closed-loop systems.The partition information of the PWA systems is taken into account and each polytopic operating region is outer approximated by an ellipsoid,then sufficient conditions for the robust stabilization are derived and expressed as a set of linear matrix inequalities （LMIs）.Two examples are given to illustrate the proposed theoretical results.

Approximation law for discrete-time variable structure control systems

Two approximation laws of sliding mode for discrete-time variable structure control systems are proposed to overcome the limitations of the exponential approximation law and the variable rate approximation law. By applying the proposed approximation laws of sliding mode to discrete-time variable structure control systems, the stability of origin can be guaranteed, and the chattering along the switching surface caused by discrete-time variable structure control can be restrained effectively. In designing of approximation laws, the problem that the system control input is restricted is also considered, which is very important in practical systems. Finally a simulation example shows the effectiveness of the two approximation laws proposed.

Adaptive Control and Function Projective Synchronization in 2D Discrete-Time Chaotic Systems

This study addresses the adaptive control and function projective synchronization problems between 2D Rulkov discrete-time system and Network discrete-time system. Based on backstepping design with three controllers, a systematic, concrete and automatic scheme is developed to investigate the function projective synchronization of discretetime chaotic systems. In addition, the adaptive control function is applied to achieve the state synchronization of two discrete-time systems. Numerical results demonstrate the effectiveness of the proposed control scheme.

Non-fragile guaranteed cost control of discrete-time fuzzy bilinear system

This paper focuses on the problem of non-fragile guaranteed cost control for a class of T-S discrete-time fuzzy bilinear systems（DFBS）.Based on the parallel distributed compensation（PDC） approach,the sufficient conditions are derived such that the closed-loop system is asymptotically stable and the cost function value is no more than a certain upper bound in the presence of the additive controller gain perturbations.The non-fragile guaranteed cost controller can be obtained by solving a set of bilinear matrix inequalities（BMIs）.The Van de Vusse model is utilized to demonstrate the validity and effectiveness of the proposed approach.

A novel reaching law approach of quasi-sliding-mode control for uncertain discrete-time systems

A novel discrete-time reaching law was proposed for uncertain discrete-time system,which contained process noise and measurement noise.The proposed method reserves all the advantages of discrete-time reaching law,which not only decreases the band width of sliding mode and strengthens the system robustness,but also improves the dynamic performance and stability capability of the system.Moreover,a discrete-time sliding mode control strategy based on Kalman filter method was designed,and Kalman filter was employed to eliminate the influence of system noise.Simulation results show that there is no chattering phenomenon in the output of controller and the state variables of controlled system,and the proposed algorithm is also feasible and has strong robustness to external disturbances.

Design of Discrete-time Repetitive Control System Based on Two-dimensional Model

This paper presents a novel design method for discrete-time repetitive control systems （RCS） based on two-dimensional （2D） discrete-time model. Firstly, the 2D model of an RCS is established by considering both the control action and the learning action in RCS. Then, through constructing a 2D state feedback controller, the design problem of the RCS is converted to the design problem of a 2D system. Then, using 2D system theory and linear matrix inequality （LMI） method, stability criterion is derived for the system without and with uncertainties, respectively. Parameters of the system can be determined by solving the LMI of the stability criterion. Finally, numerical simulations validate the effectiveness of the proposed method.

H_∞ Consensus Control of Discrete-Time Multi-Agent Systems Under Network Imperfections and External Disturbance

This paper presents a distributed control protocol for consensus control of multi-agent systems(MASs) under external disturbances and network imperfections, including communication delay and random packet dropout. To comply with the discrete nature of networked systems, in contrast to most of the existing work for MASs under network imperfections,the agents are modeled by discrete-time dynamics. The communication network is considered to be undirected, its delay is considered to be time-varying but bounded, and its packet dropout is modeled by a Bernoulli distributed white sequence.Sufficient conditions in terms of linear matrix inequalities(LMIs)for asymptotic mean-square consensus stability are derived under network imperfections without considering external disturbances.A desired disturbance attenuation level in the presence of both external disturbances and network imperfections is also provided.A simulation example is given to verify the effectiveness of the proposed approach in coping with network imperfection and disturbances.

Variable structure control with sliding mode prediction for discrete-time nonlinear systems

A new variable structure control algorithm based on sliding mode prediction for a class of discrete-time nonlinear systems is presented. By employing a special model to predict future sliding mode value, and combining feedback correction and receding horizon optimization methods which are extensively applied on predictive control strategy, a discrete-time variable structure control law is constructed. The closed-loop systems are proved to have robustness to uncertainties with unspecified boundaries. Numerical simulation and pendulum experiment results illustrate that the closed-loop systems possess desired performance, such as strong robustness, fast convergence and chattering elimination.

Static output feedback control for discrete-time fuzzy bilinear system

The problem of designing fuzzy static output feedback controller for T-S discrete-time fuzzy bilinear system （DFBS） is presented. Based on parallel distribution compensation method, some sufficient conditions are derived to guarantee the stability of the overall fuzzy system. The stabilization conditions are further formulated into linear matrix inequality （LMI） so that the desired controller can be easily obtained by using the Matlab LMI toolbox. In comparison with the existing results, the drawbacks, such as coordinate transformation, same output matrices, have been elim- inated. Finally, a simulation example shows that the approach is effective.

Recent Progress in Reinforcement Learning and Adaptive Dynamic Programming for Advanced Control Applications

Reinforcement learning(RL) has roots in dynamic programming and it is called adaptive/approximate dynamic programming(ADP) within the control community. This paper reviews recent developments in ADP along with RL and its applications to various advanced control fields. First, the background of the development of ADP is described, emphasizing the significance of regulation and tracking control problems. Some effective offline and online algorithms for ADP/adaptive critic control are displayed, where the main results towards discrete-time systems and continuous-time systems are surveyed, respectively.Then, the research progress on adaptive critic control based on the event-triggered framework and under uncertain environment is discussed, respectively, where event-based design, robust stabilization, and game design are reviewed. Moreover, the extensions of ADP for addressing control problems under complex environment attract enormous attention. The ADP architecture is revisited under the perspective of data-driven and RL frameworks,showing how they promote ADP formulation significantly.Finally, several typical control applications with respect to RL and ADP are summarized, particularly in the fields of wastewater treatment processes and power systems, followed by some general prospects for future research. Overall, the comprehensive survey on ADP and RL for advanced control applications has d emonstrated its remarkable potential within the artificial intelligence era. In addition, it also plays a vital role in promoting environmental protection and industrial intelligence.

Fractional delay compensated discrete-time SMC for networked control system

Time-varying network induced delay in the communication channel severely affects the performance of closed loop network control systems. In this paper, a novel idea of compensating the fractional time varying communication delay in the sliding Surface is presented. The fractional time delay in the sensor to controller and controller to actuator channel is approximated using the Thiran approximation technique to design the sliding surface. A discrete-time sliding mode control law is derived using the proposed surface that compensates fractional time delay in sensor to controller and controller to actuator channels for uncertain network control systems. The sufficient condition for closed loop stability of the system is derived using the Lyapunov function. The efficacy of the proposed strategy is supported by the simulation results.

Iterative Learning Control for Discrete-time Stochastic Systems with Quantized Information

An iterative learning control (ILC) algorithm using quantized error information is given in this paper for both linear and nonlinear discrete-time systems with stochastic noises. A logarithmic quantizer is used to guarantee an adaptive improvement in tracking performance. A decreasing learning gain is introduced into the algorithm to suppress the effects of stochastic noises and quantization errors. The input sequence is proved to converge strictly to the optimal input under the given index. Illustrative simulations are given to verify the theoretical analysis. © 2014 Chinese Association of Automation.

Decentralized H-infinity state feedback control for discrete-time singular large-scale systems

The decentralized H-infinity control problem for discrete-time singular large-scale systems is considered. Based on the bounded real lemma of discrete-time singular systems, a sufficient condition for the existence of decentralized H-infinity controller for discrete-time singular large-scale systems is presented in terms of the solvability to a certain system of linear matrix inequalities by linear matrix inequality (LMI) approach, and the feasible solutions to the system of LMIs provide a parameterized representation of a set of decentralized H-infinity controller. The given example shows the application of the method.

Robust reliable H_∞ control for discrete-time Markov jump linear systems with actuator failures

The robust reliable H∞ control problem for discrete-time Markovian jump systems with actuator failures is studied. A more practical model of actuator failures than outage is considered. Based on the state feedback method, the resulting closed-loop systems are reliable in that they remain robust stochastically stable and satisfy a certain level of H∞ disturbance attenuation not only when all actuators are operational, but also in case of some actuator failures, The solvability condition of controllers can be equivalent to a feasibility problem of coupled linear matrix inequalities （LMIs）. A numerical example is also given to illustrate the design procedures and their effectiveness.