Nonstationary Filtering for Markov Jumping Systems with Fading Channel and Multiplicative Noises

This paper studies the nonstationary filtering problem of Markov jump system under l2 - l∞ performance. Due to the difference in propagation channels, signal strength and phase will inevitably change randomly and cause the waste of signals resources. In response to this problem, a channel fading model with multiplicative noise is introduced. And then a nonstationary filter, which receives signals more efficiently is designed. Meanwhile Lyapunov function is constructed for error analysis. Finally, the gain matrix for filtering is obtained by solving the matrix inequality, and the results showed that the nonstationary filter converges to the stable point more quickly than the traditional asynchronous filter, the stability of the designed filter is verified.

Fault Estimation for a Class of Markov Jump Piecewise-Affine Systems: Current Feedback Based Iterative Learning Approach

In this paper, the issues of stochastic stability analysis and fault estimation are investigated for a class of continuoustime Markov jump piecewise-affine(PWA) systems against actuator and sensor faults. Firstly, a novel mode-dependent PWA iterative learning observer with current feedback is designed to estimate the system states and faults, simultaneously, which contains both the previous iteration information and the current feedback mechanism. The auxiliary feedback channel optimizes the response speed of the observer, therefore the estimation error would converge to zero rapidly. Then, sufficient conditions for stochastic stability with guaranteed performance are demonstrated for the estimation error system, and the equivalence relations between the system information and the estimated information can be established via iterative accumulating representation.Finally, two illustrative examples containing a class of tunnel diode circuit systems are presented to fully demonstrate the effectiveness and superiority of the proposed iterative learning observer with current feedback.

Improved H_∞ filtering for Markov jumping linear systems with non-accessible mode information

This paper is concerned with the H∞ filtering problems for both continuous- and discrete-time Markov jumping linear systems （MJLS） with non-accessible mode information. A new design method is proposed, which greatly reduces the overdesign introduced in the derivation process. The desired filters can be obtained from the solution of convex optimization problems in terms of linear matrix inequalities （LMIs）, which can be solved via efficient interior-point algorithms. Numerical examples are provided to illustrate the advantages of the proposed approach.

Noncooperative Model Predictive Game With Markov Jump Graph

In this paper,the distributed stochastic model predictive control(MPC)is proposed for the noncooperative game problem of the discrete-time multi-player systems(MPSs)with the undirected Markov jump graph.To reflect the reality,the state and input constraints have been considered along with the external disturbances.An iterative algorithm is designed such that model predictive noncooperative game could converge to the socalledε-Nash equilibrium in a distributed manner.Sufficient conditions are established to guarantee the convergence of the proposed algorithm.In addition,a set of easy-to-check conditions are provided to ensure the mean-square uniform bounded stability of the underlying MPSs.Finally,a numerical example on a group of spacecrafts is studied to verify the effectiveness of the proposed method.

Finite-time H_(∞) filtering for Markov jump systems with uniform quantization

This paper is concerned with finite-time H_(∞) filtering for Markov jump systems with uniform quantization. The objective is to design quantized mode-dependent filters to ensure that the filtering error system is not only mean-square finite-time bounded but also has a prescribed finite-time H_(∞) performance. First, the case where the switching modes of the filter align with those of the MJS is considered. A numerically tractable filter design approach is proposed utilizing a mode-dependent Lyapunov function, Schur’s complement, and Dynkin’s formula. Then, the study is extended to a scenario where the switching modes of the filter can differ from those of the MJS. To address this situation, a mode-mismatched filter design approach is developed by leveraging a hidden Markov model to describe the asynchronous mode switching and the double expectation formula. Finally, a spring system model subject to a Markov chain is employed to validate the effectiveness of the quantized filter design approaches.

Robust reliable H_∞ control for discrete-time Markov jump linear systems with actuator failures

The robust reliable H∞ control problem for discrete-time Markovian jump systems with actuator failures is studied. A more practical model of actuator failures than outage is considered. Based on the state feedback method, the resulting closed-loop systems are reliable in that they remain robust stochastically stable and satisfy a certain level of H∞ disturbance attenuation not only when all actuators are operational, but also in case of some actuator failures, The solvability condition of controllers can be equivalent to a feasibility problem of coupled linear matrix inequalities （LMIs）. A numerical example is also given to illustrate the design procedures and their effectiveness.

Exponential stability for uncertain neutral systems with Markov jumps

This paper deals with the global exponential stability problems for stochastic neutral Markov jump systems （MJSs） with uncertain parameters and multiple time-delays. The delays are respectively considered as constant and time varying cases, and the uncertainties are assumed to be norm bounded. By selecting appropriate Lyapunov-Krasovskii functions, it gives the sufficient condition such that the uncertain neutral MJSs are globally exponentially stochastically stable for all admissible uncertainties. The stability criteria are formulated in the form of linear matrix inequalities （LMIs）, which can be easily checked in practice. Finally, two numerical examples are exploited to illustrate the effectiveness of the developed techniques.

Controlling uncertain fuzzy neutral dynamic systems with Markov jumps

The robust H∞ control problems for stochastic fuzzy neutral Markov jump systems（MJSs） with parameters uncertainties and multiple time-delays are considered.The delays are respectively considered as constant and time varying,and the uncertain parameters are assumed to be norm bounded.By means of Takagi-Sugeno fuzzy models,the overall closed-loop fuzzy dynamics are constructed through selected membership functions.By selecting the appropriate Lyapunov-Krasovskii functions,the sufficient condition is given such that the uncertain fuzzy neutral MJSs are stochastically stability for all admissible uncertainties and satisfies the given H∞ control index.The stability and H∞ control criteria are formulated in the form of linear matrix inequalities,which can be easily checked in practice.Practical examples illustrate the effectiveness of the developed techniques.

Markovian risk process

A Markovian risk process is considered in this paper, which is the generalization of the classical risk model. It is proper that a risk process with large claims is modelled as the Markovian risk model. In such a model, the occurrence of claims is described by a point process {N（t）}t≥0 with N（t） being the number of jumps during the interval （0, t] for a Markov jump process. The ruin probability ψ（u） of a company facing such a risk model is mainly studied. An integral equation satisfied by the ruin probability function ψ（u） is obtained and the bounds for the convergence rate of the ruin probability ψ（u） are given by using a generalized renewal technique developed in the paper.

H_(∞) state estimation for Markov jump neural networks with transition probabilities subject to the persistent dwell-time switching rule

We investigate the problem of H_(∞) state estimation for discrete-time Markov jump neural networks. The transition probabilities of the Markov chain are assumed to be piecewise time-varying, and the persistent dwell-time switching rule,as a more general switching rule, is adopted to describe this variation characteristic. Afterwards, based on the classical Lyapunov stability theory, a Lyapunov function is established, in which the information about the Markov jump feature of the system mode and the persistent dwell-time switching of the transition probabilities is considered simultaneously.Furthermore, via using the stochastic analysis method and some advanced matrix transformation techniques, some sufficient conditions are obtained such that the estimation error system is mean-square exponentially stable with an H_(∞) performance level, from which the specific form of the estimator can be obtained. Finally, the rationality and effectiveness of the obtained results are verified by a numerical example.

Exponential passive filtering for a class of nonlinear jump systems

The exponential passive filtering problem for a class of nonlinear Markov jump systems with uncertainties and time-delays is studied. The uncertain parameters are assumed unknown but norm bounded, and the nonlinearities satisfy the quadratic condition. Based on the passive filtering theory, the sufficient condition for the existence of the mode-dependent passive filter is given by analyzing the reconstructed observer system. By using the appropriate Lyapnnov-Krasovskii function and applying linear matrix inequalities, the design scheme of the passive filter is derived and described as an optimization one. The presented exponential passive filter makes the error dynamic systems exponentially stochastically stable for all the admissible uncertainties, time-delays and nonlinearities, has the better abilities of state tracking and satisfies the given passive norm index. Simulation results demonstrate the validity of the proposed approach.

Robust H_∞ control for networked control systems

The robust H∞ control for networked control systems with both stochastic network-induced delay and data packet dropout is studied. When data are transmitted over network, the stochastic data packet dropout process can be described by a two-state Markov chain. The networked control systems with stochastic network-induced delay and data packet dropout are modeled as a discrete time Markov jump linear system with two operation modes. The sufficient condition of robust H∞ control for networked control systems stabilized by state feedback controller is presented in terms of linear matrix inequality. The state feedback controller can be constructed via the solution of a set of linear matrix inequalities. An example is given to verify the effectiveness of the method proposed.

Security Control for Uncertain Networked Control Systems under DoS Attacks and Fading Channels

This paper characterizes the joint effects of plant uncertainty,Denial-of-Service(DoS)attacks,and fading channel on the stabilization problem of networked control systems(NCSs).It is assumed that the controller remotely controls the plant and the control input is transmitted over a fading channel.Meanwhile,considering the sustained attack cycle and frequency of DoS attacks are random,the packet-loss caused by DoS attacks is modelled by a Markov process.The sampled-data NCS is transformed into a stochastic form with Markov jump and uncertain parameter.Then,based on Lyapunov functional method,linear matrix inequality(LMI)-based sufficient conditions are presented to ensure the stability of uncertain NCSs.The main contribution of this article lies in the construction of NCSs based on DoS attacks into Markov jump system(MJS)and the joint consideration of fading channel and plant uncertainty.

Constrained predictive control of nonlinear stochastic systems

The receding horizon control（RHC） problem is considered for nonlinear Markov jump systems which can be represented by Takagi-Sugeno fuzzy models subject to constraints both on control inputs and on observe outputs.In the given receding horizon,for each mode sequence of the T-S modeled nonlinear system with Markov jump parameter,the cost function is optimized by constraints on state trajectories,so that the optimization control input sequences are obtained in order to make the state into a terminal invariant set.Out of the receding horizon,the stability is guaranteed by searching a state feedback control law.Based on such stability analysis,a linear matrix inequality approach for designing receding horizon predictive controller for nonlinear systems subject to constraints both on the inputs and on the outputs is developed.The simulation shows the validity of this method.

Stochastic Stability of Discrete Time Positive Markov Jump Nonlinear Systems

This paper investigates the stochastic stability of discrete time positive Markov jump nonlinear systems(PMJNS).Some definitions on stochastic stability for discrete time PMJNS are introduced first.Then,using the multiply max-separable Lyapunov function method,some stochastic stability criterions of discrete time PMJNS are provided,and some corresponding criterions are also provided for discrete time positive Markov jump linear systems(PMJLS).Different from previous conclusions that require subsystems to be stable or marginally stable,the obtained results allow some subsystems to be unstable.Based on the proposed criterions,the stochastic stability behavior of discrete time positive Markov jump systems can be obtained just from the algebraic properties of the system function and the probability characteristics of the Markov chain.To illustrate the main results,two simulation examples are provided at the end.

Secure control for discrete-time hidden Markov jump systems subject to replay attacks via output feedback

This paper investigates the static output feedback secure control problem for discrete-time hidden Markov jump systems against replay attacks. The main purpose is to realise that closed-loopsystems are stochastically stable with or without replay attacks. Firstly, the tampered sensorsunder replay attacks can be identified via the proposed detection method. Then, an asynchronousstatic output feedback controller is designed, which can eliminate the negative impactcaused by replay attacks in view of the detection results. Based on the linear matrix inequalitytechnique, some sufficient conditions which ensure the closed-loop systems are stochasticallystable and meet a given H∞ performance are established. Finally, a numerical example and apractical example are given to verify the effectiveness and superiority of the proposed method.

Energy Sharing and Frequency Regulation in Energy Network via Mixed H_(2)/H_(∞) Control with Markovian Jump

In this paper,the problem of mixed optimization for energy sharing and frequency regulation in a typical energy network scenario where energy routers(ERs)interconnected AC microgrids(MGs)is investigated.Continuous-time Markov chains are introduced to describe the switching paths in the power dynamics of MGs.Such that the modelling of considered energy network system could be closer to the real-world engineering practice.Advanced parameter estimation techniques are integrated into the proposed method to achieve better modelling accuracy and controlling performance.Based on the parameters of MG power dynamics,the mixed H_(2)/H_(∞) controllers are obtained via stochastic control theory.The feasibility and efficacy of the proposed approach are evaluated in numerical examples.

H_∞ Control for Nonlinear Stochastic Markov Systems with Time-Delay and Multiplicative Noise

This paper is concerned with the H_∞ control problem for a class of nonlinear stochastic Markov jump systems with time-delay and system state-, control input-and external disturbancedependent noise. Firstly, by solving a set of Hamilton-Jacobi inequalities(HJIs), the exponential mean square H_∞ controller design of delayed nonlinear stochastic Markov systems is presented. Secondly,by using fuzzy T-S model approach, the H_∞ controller can be designed via solving a set of linear matrix inequalities(LMIs) instead of HJIs. Finally, two numerical examples are provided to show the effectiveness of the proposed design methods.

A novel suboptimal algorithm for state estimation of Markov jump linear systems

This paper is concerned with state estimation problem for Markov jump linear systems where the disturbances involved in the systems equations and measurement equations are assumed to be Gaussian noise sequences.Based on two properties of conditional expectation,orthogonal projective theorem is applied to the state estimation problem of the considered systems so that a novel suboptimal algorithm is obtained.The novelty of the algorithm lies in using orthogonal projective theorem instead of Kalman filters to estimate the state.A numerical comparison of the algorithm with the interacting multiple model algorithm is given to illustrate the effectiveness of the proposed algorithm.

From Markov Jump Systems to Two Species Competitive Lotka-Volterra Equations with Diffusion

In this paper, we start at a random evolution system on biological particles, which is described by a Markov jump system. Under a suitable scaling, we perform a proper approximation procedure. Then the so-called weak convergence of Markov processes and Martingales allow us to establish a （deterministic） two species competitive Lotka-Volterra equation.