Optimal Control of Unknown Discrete-Time Linear Systems with Additive Noise

The optimal control problem with a long run average cost is investigated for unknown linear discrete-time systems with additive noise.The authors propose a value iteration-based stochastic adaptive dynamic programming(VI-based SADP)algorithm,based on which the optimal controller is obtained.Different from the existing relevant work,the algorithm does not need to estimate the expectation(conditional expectation)and variance(conditional variance)of states or other relevant variables,and the convergence of the algorithm can be proved rigorously.A simulation example is given to verify the effectiveness of the proposed approach.

Event-Triggered Finite-Time H∞ Filtering for Discrete-Time Nonlinear Stochastic Systems

This paper addresses the problem of event-triggered finite-time H∞ filter design for a class of discrete-time nonlinear stochastic systems with exogenous disturbances. The stochastic Lyapunov-Krasoviskii functional method is adopted to design a filter such that the filtering error system is stochastic finite-time stable (SFTS) and preserves a prescribed performance level according to the pre-defined event-triggered criteria. Based on stochastic differential equations theory, some sufficient conditions for the existence of H∞ filter are obtained for the suggested system by employing linear matrix inequality technique. Finally, the desired H∞ filter gain matrices can be expressed in an explicit form.

Deterministic and Stochastic Fixed-Time Stability of Discrete-time Autonomous Systems

This paper studies deterministic and stochastic fixedtime stability of autonomous nonlinear discrete-time(DT)systems.Lyapunov conditions are first presented under which the fixed-time stability of deterministic DT systems is certified.Extensions to systems under deterministic perturbations as well as stochastic noise are then considered.For the former,sensitivity to perturbations for fixed-time stable DT systems is analyzed,and it is shown that fixed-time attractiveness results from the presented Lyapunov conditions.For the latter,sufficient Lyapunov conditions for fixed-time stability in probability of nonlinear stochastic DT systems are presented.The fixed upper bound of the settling-time function is derived for both fixed-time stable and fixed-time attractive systems,and a stochastic settling-time function fixed upper bound is derived for stochastic DT systems.Illustrative examples are given along with simulation results to verify the introduced results.

Stability Criterion with Less LMI Variables for Linear Discrete-time Systems with Additive Time-delays

In this correspondence paper, an equivalent stability criterion with minimal number of linear matrix inequality （LMI） variables is presented for a delay-dependent stability criterion reported recently in the International Journal of Automation and Computing for a class of linear discrete-time systems with additive time delays. The reported stability criterion for the additive timedelay systems has more number of matrix variables in the LMI and, hence, demand additional computational burden. The proposed equivalent stability criterion, unlike the reported one, does not involve free-weighing matrices and encompass only the matrix variables that are associated in the Lyapunov-Krasovskii functional, making the criterion mathematically less complex and computationally more effective.

Robust H_∞ control for discrete-time polytopic uncertain systems with linear fractional vertices

The robust H∞ control problem for discrete-time uncertain systems is investigated in this paper. The uncertain systems are modelled as a polytopic type with linear fractional uncertainty in the vertices. A new linear matrix inequality (LMI) characterization of the H∞ performance for discrete systems is given by introducing a matrix slack variable which decouples the matrix of a Lyapunov function candidate and the parametric matrices of the system. This feature enables one to derive sufficient conditions for discrete uncertain systems by using parameter-dependent Lyapunov functions with less conservativeness. Based on the result, H∞ performance analysis and controller design are carried out. A numerical example is included to demonstrate the effectiveness of the proposed results.

Stability analysis for linear discrete-time systems subject to actuator saturation

In this paper, stability of discrete-time linear systems subject to actuator saturation is analyzed by combining the saturation-dependent Lyapunov function method with Finsler’s lemma. New stability test conditions are proposed in the enlarged space containing both the state and its time difference which allow extra degree of freedom and lead to less conservative estimation of the domain of attraction. Furthermore, based on this result, a useful lemma and an iterative LMI-based optimization algorithm are also developed to maximize an estimation of domain of attraction. A numerical example illustrates the effectiveness of the proposed methods.

Robust Sliding Mode Control for Nonlinear Discrete-Time Delayed Systems Based on Neural Network

This paper presents a robust sliding mode controller for a class of unknown nonlinear discrete-time systems in the presence of fixed time delay. A neural-network approximation and the Lyapunov-Krasovskii functional theory into the sliding-mode technique is used and a neural-network based sliding mode control scheme is proposed. Because of the novality of Chebyshev Neural Networks (CNNs), that it requires much less computation time as compare to multi layer neural network (MLNN), is preferred to approximate the unknown system functions. By means of linear matrix inequalities, a sufficient condition is derived to ensure the asymptotic stability such that the sliding mode dynamics is restricted to the defined sliding surface. The proposed sliding mode control technique guarantees the system state trajectory to the designed sliding surface. Finally, simulation results illustrate the main characteristics and performance of the proposed approach.

Robust reliable H_∞ control for discrete-time Markov jump linear systems with actuator failures

The robust reliable H∞ control problem for discrete-time Markovian jump systems with actuator failures is studied. A more practical model of actuator failures than outage is considered. Based on the state feedback method, the resulting closed-loop systems are reliable in that they remain robust stochastically stable and satisfy a certain level of H∞ disturbance attenuation not only when all actuators are operational, but also in case of some actuator failures, The solvability condition of controllers can be equivalent to a feasibility problem of coupled linear matrix inequalities （LMIs）. A numerical example is also given to illustrate the design procedures and their effectiveness.

Reduced-Order Observer-Based Leader-Following Formation Control for Discrete-Time Linear Multi-Agent Systems

Formation control of discrete-time linear multi-agent systems using directed switching topology is considered in this work via a reduced-order observer, in which a formation control protocol is proposed under the assumption that each directed communication topology has a directed spanning tree. By utilizing the relative outputs of neighboring agents, a reduced-order observer is designed for each following agent. A multi-step control algorithm is established based on the Lyapunov method and the modified discrete-time algebraic Riccati equation. A sufficient condition is given to ensure that the discrete-time linear multi-agent system can achieve the expected leader-following formation.Finally, numerical examples are provided so as to demonstrate the effectiveness of the obtained results.

Indirect adaptive fuzzy control for a class of nonlinear discrete-time systems

An indirect adaptive fuzzy control scheme is developed for a class of nonlinear discrete-time systems. In this method, two fuzzy logic systems are used to approximate the unknown functions, and the parameters of membership functions in fuzzy logic systems are adjusted according to adaptive laws for the purpose of controlling the plant to track a reference trajectory. It is proved that the scheme can not only guarantee the boundedness of the input and output of the closed-loop system, but also make the tracking error converge to a small neighborhood of the origin. Simulation results indicate the effectiveness of this scheme.

Stabilization of Unknown Nonlinear Discrete-Time Delay Systems Based on Neural Network

This paper discusses about the stabilization of unknown nonlinear discrete-time fixed state delay systems. The unknown system nonlinearity is approximated by Chebyshev neural network (CNN), and weight update law is presented for approximating the system nonlinearity. Using appropriate Lyapunov-Krasovskii functional the stability of the nonlinear system is ensured by the solution of linear matrix inequalities. Finally, a relevant example is given to illustrate the effectiveness of the proposed control scheme.

State and Mode Feedback Control for Discrete-time Markovian Jump Linear Systems With Controllable MTPM

In this note, the state and mode feedback control problems for a class of discrete-time Markovian jump linear systems(MJLSs) with controllable mode transition probability matrix(MTPM) are investigated. In most achievements, controller design of MJLSs pays more attention to state/output feedback control for stability, while the system cost in practice is out of consideration. In this paper, we propose a control mechanism consisting of two parts: finite-path-dependent state feedback controller design with which uniform stability of MJLSs can be ensured, and mode feedback control which aims to decrease system cost. Differing from the traditional state/output feedback controller design, the main novelty is that the proposed control mechanism not only guarantees system stability, but also decreases system cost effectively by adjusting the occurrence probability of system modes. The effectiveness of the proposed mechanism is illustrated via numerical examples.

Robust H_∞ output feedback controller design for linear uncertain discrete-time switched systems via state reset

This paper studies the problem of robust H∞ output feedback controller via state-reset for linear uncertain discrete-time switched systems. Using multiple Lyapunov functions,we address an output feedback controller under arbitrary switching signals,in which an H∞ performance is required. The condition is shown in the form of linear matrix inequalities (LMI). Finally,a numerical example shows the feasibility of the designed controller and illustrates that the new sufficient condition has lower conservation and more optimized H∞ tfperformance.

On Asymptotic Stabilization of Linear Discrete-time Systems with Saturated State Feedback

As saturation is involved in the stabilizing feedback control of a linear discrete-time system, the original global-asymptotic stabilization (GAS) may drop to region-asymptotic stabilization (RAS). How to test if the saturated feedback system is GAS or RAS? The paper presents a criterion to answer this question, and describes an algorithm to calculate an invariant attractive ellipsoid for the RAS case. At last, the effectiveness of the approach is shown with examples.

LOCAL MAXIMUM PRINCIPLE FOR SINGULAR DISCRETE-TIME LINEAR SYSTEMS

In this paper a local maximum principle for the singular discrete-time linear systemMx(k)=φx(k-1)+Bu(k-1)is investigated.By using this local maximum principle we can discussthe linear-quadratic optimal regulator problem and the minimum energy problem for singulardiscrete-time linear systems.

Optimal fault detection for a class of discrete-time switched linear systems

This paper deals with the problem of optimal fault detection filter （FDF） design for a class of discrete-time switched linear systems under arbitrary switching. By using an observer-based FDF as a residual generator, the design of the FDF is formulated into an optimization problem through maximizing the H_/H∞ or H∞/H∞ performance index. With the aid of an operator optimization method, it is shown that a mode-dependent unified optimal solution can be derived by solving a coupled Riccati equation. A numerical example is given to show the effectiveness of the proposed method.

A new stability analysis and controller design method for discrete-time linear systems with saturation nonlinearities

The problems of stability analysis and controllers design for discrete-time linear systems subject to state saturation nonlinearities are investigated in this paper. Both full state saturation and partial state saturation are considered. It is well known to all that the controller design problem under state saturation is very difficult and complex to deal with. In order to overcome the difficulty, a new and tractable system is constructed, and it can be proved that the constructed system is with the same domain of attraction as the original system. With the aid of this property, to estimate the domain of attraction of the original system, an LMI-based method is presented for estimating the domain of attraction of the origin for the new constructed system under state saturation. Further, two optimization algorithms are developed for constructing dynamic output-feedback controllers and state feedback controllers, respectively, which guarantee that the domain of attraction of the origin for the closed-loop system is as ＇large＇ as possible. An example is provided to demonstrate the effectiveness of the new method.

On Optimal Fault Detection for Discrete-time Markovian Jump Linear Systems

这份报纸为分离时间的 Markovian 处理差错察觉的问题跳线性系统(MJLS ) 。把一个基于观察员的差错察觉过滤器(FDF ) 用作一个剩余发电机， FDF 的设计为最大化随机的 H/H 或 H/H 表演索引作为一个优化问题被提出。在一个操作符优化方法的帮助下，一个统一最佳的解决方案能被解决 a coupled Riccati 方程导出，这被显示出。数字例子被给显示出建议方法的有效性。

Delay-dependent guaranteed cost control for uncertain discrete-time Markovian jump linear systems with mode-dependent time-delays

In this paper,the problem of guaranteed cost control for a class of uncertain discrete-time Markovian jump linear systems with mode-dependent time-delays and a given quadratic cost function are investigated. Attention is focused on designing a memoryless state feedback control law such that the closed-loop system is robust stochastically stable and the closed-loop cost function value is not more than a specified upper bound,for all admissible uncertainties. The key features of the approach include the introduction of a new type of suitable stochastic Lyapunov functional and free weighting matrices techniques. Sufficient conditions for the existence of such controller are obtained in terms of a set of linear matrix inequalities. A numerical example is given to illustrate the less conservatism of the proposed techniques.