Fault Estimation for a Class of Markov Jump Piecewise-Affine Systems: Current Feedback Based Iterative Learning Approach

In this paper, the issues of stochastic stability analysis and fault estimation are investigated for a class of continuoustime Markov jump piecewise-affine(PWA) systems against actuator and sensor faults. Firstly, a novel mode-dependent PWA iterative learning observer with current feedback is designed to estimate the system states and faults, simultaneously, which contains both the previous iteration information and the current feedback mechanism. The auxiliary feedback channel optimizes the response speed of the observer, therefore the estimation error would converge to zero rapidly. Then, sufficient conditions for stochastic stability with guaranteed performance are demonstrated for the estimation error system, and the equivalence relations between the system information and the estimated information can be established via iterative accumulating representation.Finally, two illustrative examples containing a class of tunnel diode circuit systems are presented to fully demonstrate the effectiveness and superiority of the proposed iterative learning observer with current feedback.

Variance minimization for continuous-time Markov decision processes: two approaches

This paper studies the limit average variance criterion for continuous-time Markov decision processes in Polish spaces. Based on two approaches, this paper proves not only the existence of solutions to the variance minimization optimality equation and the existence of a variance minimal policy that is canonical, but also the existence of solutions to the two variance minimization optimality inequalities and the existence of a variance minimal policy which may not be canonical. An example is given to illustrate all of our conditions.

Development of Optimal Maintenance Policies for Offshore Wind Turbine Gearboxes Based on the Non-homogeneous Continuous-Time Markov Process

Gearbox in offshore wind turbines is a component with the highest failure rates during operation. Analysis of gearbox repair policy that includes economic considerations is important for the effective operation of offshore wind farms. From their initial perfect working states, gearboxes degrade with time, which leads to decreased working efficiency. Thus, offshore wind turbine gearboxes can be considered to be multi-state systems with the various levels of productivity for different working states. To efficiently compute the time-dependent distribution of this multi-state system and analyze its reliability, application of the nonhomogeneous continuous-time Markov process(NHCTMP) is appropriate for this type of object. To determine the relationship between operation time and maintenance cost, many factors must be taken into account, including maintenance processes and vessel requirements. Finally, an optimal repair policy can be formulated based on this relationship.

Variance Optimization for Continuous-Time Markov Decision Processes

This paper considers the variance optimization problem of average reward in continuous-time Markov decision process (MDP). It is assumed that the state space is countable and the action space is Borel measurable space. The main purpose of this paper is to find the policy with the minimal variance in the deterministic stationary policy space. Unlike the traditional Markov decision process, the cost function in the variance criterion will be affected by future actions. To this end, we convert the variance minimization problem into a standard (MDP) by introducing a concept called pseudo-variance. Further, by giving the policy iterative algorithm of pseudo-variance optimization problem, the optimal policy of the original variance optimization problem is derived, and a sufficient condition for the variance optimal policy is given. Finally, we use an example to illustrate the conclusion of this paper.

非线性广义时滞Markov跳变系统的H_(∞)滑模控制

研究了一类转移速率部分未知的广义时滞Markov跳变系统的H_(∞)滑模控制问题.首先,对广义时滞Markov跳变系统设计了积分型滑模面,并求出对应的等效控制器.之后,构建Lyapunov泛函,通过线性矩阵不等式方法得到闭环系统随机容许且满足H_(∞)性能γ的充分条件,运用加减项方法以及引入自由权矩阵,使得到的结果降低了保守性;对滑模力学分析,设计了滑模控制器,使得系统能在有限时间内到达滑模面上.最后,通过数值算例与仿真验证了理论的可行性.

转移概率部分未知的离散时间Markov跳变系统Nash微分博弈

考虑到转移概率矩阵元素无法完全获悉,如何在转移概率部分未知的情境下研究离散时间Markov跳变系统Nash微分博弈是有待解决的问题之一,这一问题可以为转移概率部分未知的Markov跳变系统Nash微分博弈理论在管理问题上的应用提供理论支撑。基于此,本文首先研究单人博弈情形,即ε-次优控制问题,借助自由连接权矩阵和配方法,得到了ε-次优控制策略存在的充分性条件,并给出了成本函数上界的显式表达;然后延伸至双人博弈进行分析,得到了ε-次优Nash均衡策略存在的条件等价于求解双线性矩阵不等式和矩阵不等式的优化问题,并通过启发式算法求解优化问题得到ε-次优Nash均衡策略;最后通过数值算例证明了主要结论的有效性。

自适应事件触发机制下分布时滞Markov跳变网络化系统H_(∞)故障检测

传统事件触发机制中阈值的选择会对信号传输效率产生很大影响。针对此问题,研究了自适应事件触发机制下具有分布时滞的Markov网络化系统的故障检测问题。设计了一种模态相关的自适应事件触发机制,通过动态调整阈值,提高了网络资源利用率。考虑网络时延和数据丢包现象,同步设计触发器和故障检测滤波器。构造模态相关的Lyapunov泛数,根据积分不等式技术推导出使系统随机稳定且具有H_(∞)性能的充分条件。利用解耦方法和LMI技术求解出了故障检测滤波器参数。最后通过数值仿真验证了方案在节省网络资源上的优势。

采样控制下的Markov跳变系统稳定性与安全性分析

研究针对连续Markov跳变系统的稳定性和安全性问题通过状态采样控制器保证了其稳定性和安全性。首先,与通常只考虑Markov系统的稳定性不同的是,系统的安全性问题也被考虑了。其次,系统的安全性通过引入控制障碍函数的方法得到解决。因此,系统分析及计算变得极其复杂。最后,通过设计采样控制器保证了系统的稳定性和安全性,并提供了一个有效的数值例子验证了提出方法的有效性。

Exponential stability of impulsive jump linear systems with Markov process

The exponential stability is investigated for a class of continuous time linear systems with a finite state Markov chain form process and the impulsive jump at switching moments. The conditions, based on the average dwell time and the ratio of expectation of the total time running on all unstable subsystems to the expectation of the total time running on all stable subsystems,assure the exponential stability with a desired stability degree of the system irrespective of the impact of impulsive jump. The uniformly bounded result is realized for the case in which switched system is subjected to the impulsive effect of the excitation signal at some switching moments.

Robust reliable H_∞ control for discrete-time Markov jump linear systems with actuator failures

The robust reliable H∞ control problem for discrete-time Markovian jump systems with actuator failures is studied. A more practical model of actuator failures than outage is considered. Based on the state feedback method, the resulting closed-loop systems are reliable in that they remain robust stochastically stable and satisfy a certain level of H∞ disturbance attenuation not only when all actuators are operational, but also in case of some actuator failures, The solvability condition of controllers can be equivalent to a feasibility problem of coupled linear matrix inequalities （LMIs）. A numerical example is also given to illustrate the design procedures and their effectiveness.

Exponential stability for uncertain neutral systems with Markov jumps

This paper deals with the global exponential stability problems for stochastic neutral Markov jump systems （MJSs） with uncertain parameters and multiple time-delays. The delays are respectively considered as constant and time varying cases, and the uncertainties are assumed to be norm bounded. By selecting appropriate Lyapunov-Krasovskii functions, it gives the sufficient condition such that the uncertain neutral MJSs are globally exponentially stochastically stable for all admissible uncertainties. The stability criteria are formulated in the form of linear matrix inequalities （LMIs）, which can be easily checked in practice. Finally, two numerical examples are exploited to illustrate the effectiveness of the developed techniques.

THE EQUILIBRIUM PROBLEM AND CAPACITY FOR JUMP MARKOV PROCESSES

Let X=(Omega,F,F-t,X(t),theta(t),P-x) be a jump Markov process with q-pair q(x)-q(x, A). In this paper, the equilibrium principle is established and equilibrium functions, energy, capacity and related problems is investigated in terms of the q-pair q(x)-q(x, A).

Controlling uncertain fuzzy neutral dynamic systems with Markov jumps

The robust H∞ control problems for stochastic fuzzy neutral Markov jump systems（MJSs） with parameters uncertainties and multiple time-delays are considered.The delays are respectively considered as constant and time varying,and the uncertain parameters are assumed to be norm bounded.By means of Takagi-Sugeno fuzzy models,the overall closed-loop fuzzy dynamics are constructed through selected membership functions.By selecting the appropriate Lyapunov-Krasovskii functions,the sufficient condition is given such that the uncertain fuzzy neutral MJSs are stochastically stability for all admissible uncertainties and satisfies the given H∞ control index.The stability and H∞ control criteria are formulated in the form of linear matrix inequalities,which can be easily checked in practice.Practical examples illustrate the effectiveness of the developed techniques.

欺骗攻击下Markov跳变系统的不匹配量化自适应安全控制

本文研究了欺骗攻击下Markov跳变系统的不匹配量化自适应安全控制策略.在控制器端设置了一个多通道结构的量化器,且每个通道具有随时间变化的不匹配度,设计了一个自适应更新率来估计网络攻击的未知界限.接着,设计了一个由三部分组成的自适应安全控制器,基于Lyapunov理论和顶点分离技术,闭环系统随机有界稳定并满足所需的H∞性能指标.最后,通过仿真实验验证了所提策略的有效性.

Robust Finite-Time <i>H</i>_∞Filtering for Discrete-Time Markov Jump Stochastic Systems

This study is concerned with the problem of finite-time H∞ filter design for uncertain discrete-time Markov Jump stochastic systems. Our attention is focused on the design of mode-dependent H∞ filter to ensure the finite-time stability of the filtering error system and preserve a prescribed H∞ performance level for all admissible uncertainties. Sufficient conditions of filtering design for the system under consideration are developed and the corresponding filter parameters can be achieved in terms of linear matrix inequalities (LMI). Finally, a numerical example is provided to illustrate the validity of the proposed method.

Finite-time H_(∞) filtering for Markov jump systems with uniform quantization

This paper is concerned with finite-time H_(∞) filtering for Markov jump systems with uniform quantization. The objective is to design quantized mode-dependent filters to ensure that the filtering error system is not only mean-square finite-time bounded but also has a prescribed finite-time H_(∞) performance. First, the case where the switching modes of the filter align with those of the MJS is considered. A numerically tractable filter design approach is proposed utilizing a mode-dependent Lyapunov function, Schur’s complement, and Dynkin’s formula. Then, the study is extended to a scenario where the switching modes of the filter can differ from those of the MJS. To address this situation, a mode-mismatched filter design approach is developed by leveraging a hidden Markov model to describe the asynchronous mode switching and the double expectation formula. Finally, a spring system model subject to a Markov chain is employed to validate the effectiveness of the quantized filter design approaches.

H_(∞) state estimation for Markov jump neural networks with transition probabilities subject to the persistent dwell-time switching rule

We investigate the problem of H_(∞) state estimation for discrete-time Markov jump neural networks. The transition probabilities of the Markov chain are assumed to be piecewise time-varying, and the persistent dwell-time switching rule,as a more general switching rule, is adopted to describe this variation characteristic. Afterwards, based on the classical Lyapunov stability theory, a Lyapunov function is established, in which the information about the Markov jump feature of the system mode and the persistent dwell-time switching of the transition probabilities is considered simultaneously.Furthermore, via using the stochastic analysis method and some advanced matrix transformation techniques, some sufficient conditions are obtained such that the estimation error system is mean-square exponentially stable with an H_(∞) performance level, from which the specific form of the estimator can be obtained. Finally, the rationality and effectiveness of the obtained results are verified by a numerical example.

Noncooperative Model Predictive Game With Markov Jump Graph

In this paper,the distributed stochastic model predictive control(MPC)is proposed for the noncooperative game problem of the discrete-time multi-player systems(MPSs)with the undirected Markov jump graph.To reflect the reality,the state and input constraints have been considered along with the external disturbances.An iterative algorithm is designed such that model predictive noncooperative game could converge to the socalledε-Nash equilibrium in a distributed manner.Sufficient conditions are established to guarantee the convergence of the proposed algorithm.In addition,a set of easy-to-check conditions are provided to ensure the mean-square uniform bounded stability of the underlying MPSs.Finally,a numerical example on a group of spacecrafts is studied to verify the effectiveness of the proposed method.

Nonstationary Filtering for Markov Jumping Systems with Fading Channel and Multiplicative Noises

This paper studies the nonstationary filtering problem of Markov jump system under l2 - l∞ performance. Due to the difference in propagation channels, signal strength and phase will inevitably change randomly and cause the waste of signals resources. In response to this problem, a channel fading model with multiplicative noise is introduced. And then a nonstationary filter, which receives signals more efficiently is designed. Meanwhile Lyapunov function is constructed for error analysis. Finally, the gain matrix for filtering is obtained by solving the matrix inequality, and the results showed that the nonstationary filter converges to the stable point more quickly than the traditional asynchronous filter, the stability of the designed filter is verified.

多信道攻击下Markov跳变系统的异步动态事件触发与量化控制

针对具有多信道随机欺骗攻击的Markov跳变系统,首次提出一种新颖的基于动态事件触发机制(DETM)和量化的异步输出反馈控制器.为了减少网络中的通信负担,采用DETM和量化相结合的控制方法.为了提高信道的非脆弱性,设计基于隐马尔可夫模型(HMM)的多信道传输策略.同时,考虑由伯努利变量描述的随机多信道欺骗攻击.为了刻画系统与控制器之间模态不匹配现象,设计基于HMM的异步控制律.通过构造模态依赖的Lyapunov函数,建立闭环系统随机稳定和严格耗散充分条件.最后,通过应用质量–弹簧–阻尼器机械系统实例验证所提出设计方法的有效性和实用性.