Stabilization of stochastic systems with hidden Markovian jumps

This paper considers the adaptive control of discrete-time hybrid stochastic systems with unknown randomly jumping parameters described by a finite-state hidden Markov chain. An intuitive yet longstanding conjecture in this area is that such hybrid systems can be adaptively stabilized whenever the rate of transition of the hidden Markov chain is small enough. This paper provides a rigorous positive answer to this conjecture by establishing the global stability of a gradient-algorithm-based adaptive linear-quadratic control.

A Double Sensitive Fault Detection Filter for Positive Markovian Jump Systems With A Hybrid Event-Triggered Mechanism

This paper is concerned with the double sensitive fault detection filter for positive Markovian jump systems. A new hybrid adaptive event-triggered mechanism is proposed by introducing a non-monotonic adaptive law. A linear adaptive event-triggered threshold is established by virtue of 1-norm inequality.Under such a triggering strategy, the original system can be transformed into an interval uncertain system. By using a stochastic copositive Lyapunov function, an asynchronous fault detection filter is designed for positive Markovian jump systems(PMJSs) in terms of linear programming. The presented filter satisfies both L_-gain(?_-gain) fault sensitivity and L_1(?_1)internal differential privacy sensitivity. The proposed approach is also extended to the discrete-time case. Finally, two examples are provided to illustrate the effectiveness of the proposed design.

Robust stability and H-infinity control for uncertain discrete-time Markovian jump singular systems

The robust stability and stabilization, and H-infinity control problems for discrete-time Markovian jump singular systems with parameter uncertainties are discussed. Based on the restricted system equivalent （r.s.e.） transformation and by introducing new state vectors, the singular system is transformed into a discrete-time Markovian jump standard linear system, and the linear matrix inequality （LMI） conditions for the discrete-time Markovian jump singular systems to be regular, causal, stochastically stable, and stochastically stable with 7- disturbance attenuation are obtained, respectively. With these conditions, the robust state feedback stochastic stabilization problem and H-infinity control problem are solved, and the LMI conditions are obtained. A numerical example illustrates the effectiveness of the method given in the oaoer.

Sliding Mode Control for Nonlinear Markovian Jump Systems Under Denial-of-Service Attacks

This paper investigates the sliding mode control(SMC) problem for a class of discrete-time nonlinear networked Markovian jump systems(MJSs) in the presence of probabilistic denial-of-service(Do S) attacks. The communication network via which the data is propagated is unsafe and the malicious adversary can attack the system during state feedback. By considering random Denial-of-Service attacks, a new sliding mode variable is designed, which takes into account the distribution information of the probabilistic attacks. Then, by resorting to Lyapunov theory and stochastic analysis methods, sufficient conditions are established for the existence of the desired sliding mode controller, guaranteeing both reachability of the designed sliding surface and stability of the resulting sliding motion.Finally, a simulation example is given to demonstrate the effectiveness of the proposed sliding mode control algorithm.

Robust H-infinity filter design for uncertaintime-delay singular stochastic systems withMarkovian jump

This paper deals with the problem of H-infinity filter design for uncertain time-delay singular stochastic systems with Markovian jump. Based on the extended It6 stochastic differential formula, sufficient conditions for the solvability of these problems are obtained. Furthermore, It is shown that a desired filter can be constructed by solving a set of linear matrix inequalities. Finally, a simulation example is given to demonstrate the effectiveness of the proposed method.

State estimation for neural neutral-type networks with mixed time-varying delays and Markovian jumping parameters

This paper is concerned with a delay-dependent state estimator for neutral-type neural networks with mixed timevarying delays and Markovian jumping parameters.The addressed neural networks have a finite number of modes,and the modes may jump from one to another according to a Markov process.By construction of a suitable Lyapunov-Krasovskii functional,a delay-dependent condition is developed to estimate the neuron states through available output measurements such that the estimation error system is globally asymptotically stable in a mean square.The criterion is formulated in terms of a set of linear matrix inequalities（LMIs）,which can be checked efficiently by use of some standard numerical packages.

Robust reliable H-infinity control for nonlinear uncertain stochastic time-delay systems with Markovian jumping parameters

This paper deals with the problems of robust reliable exponential stabilization and robust stochastic stabilization with H-infinity performance for a class of nonlinear uncertain time-delay stochastic systems with Markovian jumping parameters. The time delays are assumed to be dependent on the system modes. Delay-dependent conditions for the solvability of these problems are obtained via parameter-dependent Lyapunov functionals. Furthermore, it is shown that the desired state feedback controller can be designed by solving a set of linear matrix inequalities. Finally, the simulation is provided to demonstrate the effectiveness of the proposed methods.

Delay-dependent Stability Analysis for Markovian Jump Systems with Interval Time-varying-delays

This paper proposes improved stochastic stability conditions for Markovian jump systems with interval time-varying delays. In terms of linear matrix inequalities （LMIs）, less conservative delay-range-dependent stability conditions for Markovian jump systems are proposed by constructing a different Lyapunov-Krasovskii function. The resulting criteria have advantages over some previous ones in that they involve fewer matrix variables but have less conservatism. Numerical examples are provided to demonstrate the efficiency and reduced conservatism of the results in this paper.

Synchronization of Markovian jumping complex networks with event-triggered control

This paper investigates event-triggered synchronization for complex networks with Markovian jumping parameters.Nonlinear dynamics with Markovian jumping parameters is considered for each node in a complex network. By utilizing the proposed event-triggered strategy, and based on the Lyapunov functional method and linear matrix inequality technology,some sufficient conditions for synchronization of complex networks are derived whether the transition rate matrix for the Markov process is completely known or not. Finally, a numerical example is presented to illustrate the effectiveness of the proposed theoretical results.

Delay-dependent robust control for uncertain stochastic systems with Markovian switching and multiple delays

The exponential stability in mean square and stabiliza- tion problems for It＆ stochastic switched systems with multiple time-delays are investigated. The system possesses the norm- bounded uncertainties and Markovian jumping parameters. By using an effective descriptor model transformation of the system and applying Ito＇s differential formula and Moon＇s inequality for bounding cross terms, a new delay-dependent sufficient condi- tion is derived in terms of linear matrix inequalities, and its states feedback controller is designed. Numerical examples are given to illustrate the efficiency and less conservation of the results.

Guaranteed control performance robust LQG regulator for discrete-time Markovian jump systems with uncertain noise

Robust LQG problems of discrete-time Markovian jump systems with uncertain noises are investigated. The problem addressed is the construction of perturbation upper bounds on the uncertain noise covariances so as to guarantee that the deviation of the control performance remains within the precision prescribed in actual problems. Furthermore, this regulator is capable of minimizing the worst performance in an uncertain case. A numerical example is exploited to show the validity of the method.

STOCHASTIC STABILITY OF UNCERTAIN RECURRENT NEURAL NETWORKS WITH MARKOVIAN JUMPING PARAMETERS

In this paper, global robust stability of uncertain stochastic recurrent neural networks with Markovian jumping parameters is considered. A novel Linear matrix inequal- ity（LMI） based stability criterion is obtained to guarantee the asymptotic stability of uncertain stochastic recurrent neural networks with Markovian jumping parameters. The results are derived by using the Lyapunov functional technique, Lipchitz condition and S-procuture. Finally, numerical examples are given to demonstrate the correctness of the theoretical results. Our results are also compared with results discussed in [31] and [34] to show the effectiveness and conservativeness.

Stochastic asymptotical synchronization of chaotic Markovian jumping fuzzy cellular neural networks with mixed delays and the Wiener process based on sampled-data control

We investigate the stochastic asymptotical synchronization of chaotic Markovian jumping fuzzy cellular neural networks （MJFCNNs） with discrete, unbounded distributed delays, and the Wiener process based on sampled-data control using the linear matrix inequality （LMI） approach. The Lyapunov–Krasovskii functional combined with the input delay approach as well as the free-weighting matrix approach is employed to derive several sufficient criteria in terms of LMIs to ensure that the delayed MJFCNNs with the Wiener process is stochastic asymptotical synchronous. Restrictions （e.g., time derivative is smaller than one） are removed to obtain a proposed sampled-data controller. Finally, a numerical example is provided to demonstrate the reliability of the derived results.

Delay-dependent stabilization of singular Markovian jump systems with state delay

This paper deals with the delay-dependent stabilization problem for singular systems with Markovian jump parameters and time delays. A delay-dependent condition is established for the considered system to be regular, impulse free and stochastically stable. Based on the condition, a design algorithm of the desired state feedback controller which guarantees the resultant closed-loop system to be regular, impulse free and stochastically stable is proposed in terms of a set of strict linear matrix inequalities （LMIs）. Numerical examples show the effectiveness of the proposed methods.

Robust H_∞ filtering for discrete-time systems with Markovian switching and time-delays

The robust H∞ filtering problem for uncertain discrete-time Markovian jump linear systems with mode- dependent time-delays is investigated. Attention is focused on designing a Markovian jump linear filter that ensures robust stochastic stability while achieving a prescribed H∞ performance level of the resulting filtering error system, for all admissible uncertainties. The key features of the approach include the introduction of a new type of stochastic Lyapunov functional and some free weighting matrix variables. Sufficient conditions for the solvability of this problem are obtained in terms of a set of linear matrix inequalities. Numerical examples are provided to demonstrate the reduced conservatism of the proposed approach.

State and Mode Feedback Control for Discrete-time Markovian Jump Linear Systems With Controllable MTPM

In this note, the state and mode feedback control problems for a class of discrete-time Markovian jump linear systems(MJLSs) with controllable mode transition probability matrix(MTPM) are investigated. In most achievements, controller design of MJLSs pays more attention to state/output feedback control for stability, while the system cost in practice is out of consideration. In this paper, we propose a control mechanism consisting of two parts: finite-path-dependent state feedback controller design with which uniform stability of MJLSs can be ensured, and mode feedback control which aims to decrease system cost. Differing from the traditional state/output feedback controller design, the main novelty is that the proposed control mechanism not only guarantees system stability, but also decreases system cost effectively by adjusting the occurrence probability of system modes. The effectiveness of the proposed mechanism is illustrated via numerical examples.

Stability of stochastic neural networks with Markovian jumping parameters

The global asymptotical stability for a class of stochastic delayed neural networks （SDNNs） with Maxkovian jumping parameters is considered. By applying Lyapunov functional method and Ito＇s differential rule, new delay-dependent stability conditions are derived. All results are expressed in terms of linear matrix inequality （LMI）, and a numerical example is presented to illustrate the correctness and less conservativeness of the proposed method.

Robust H_∞ control for uncertain Markovian jump systems with mixed delays

We scrutinize the problem of robust H∞control for a class of Markovian jump uncertain systems with interval timevarying and distributed delays. The Markovian jumping parameters are modeled as a continuous-time finite-state Markov chain. The main aim is to design a delay-dependent robust H∞control synthesis which ensures the mean-square asymptotic stability of the equilibrium point. By constructing a suitable Lyapunov–Krasovskii functional（LKF）, sufficient conditions for delay-dependent robust H∞control criteria are obtained in terms of linear matrix inequalities（LMIs）. The advantage of the proposed method is illustrated by numerical examples. The results are also compared with the existing results to show the less conservativeness.

SYNCHRONIZATION OF SINGULAR MARKOVIAN JUMPING NEUTRAL COMPLEX DYNAMICAL NETWORKS WITH TIME-VARYING DELAYS VIA PINNING CONTROL

This article discusses the synchronization problem of singular neutral complex dynamical networks(SNCDN)with distributed delay and Markovian jump parameters via pinning control.Pinning control strategies are designed to make the singular neutral complex networks synchronized.Some delay-dependent synchronization criteria are derived in the form of linear matrix inequalities based on a modified Lyapunov-Krasovskii functional approach.By applying the Lyapunov stability theory,Jensen's inequality,Schur complement,and linear matrix inequality technique,some new delay-dependent conditions are derived to guarantee the stability of the system.Finally,numerical examples are presented to illustrate the effectiveness of the obtained results.

Robust fault detection for discrete-time Markovian jump systems with mode-dependent time-delays

This paper investigates a fault detection problem for a class of discrete-time Markovian jump systems with norm-bounded uncertainties and mode-dependent time-delays. Attention is focused on constructing the residual generator based on the filter of which its parameters matrices are dependent on the system mode, that is, the fault detection filter is a Markovian jump system as well. The design of fault detection filter is reduced to H-infinity filtering problem by using H-infinity control theory, which can guarantee the difference between the residual and the fault （or, more generally weighted fault） as small as possible in the context of enhancing the robustness of residual to modeling errors, control inputs and unknown inputs. Sufficient condition for the existence of the above filters is established by means of linear matrix inequalities, which can be readily solved by using standard numerical software. A numerical example is given to illustrate the feasibility of the proposed method.