Computing large deviation prefactors of stochastic dynamical systems based on machine learning

We present a large deviation theory that characterizes the exponential estimate for rare events in stochastic dynamical systems in the limit of weak noise.We aim to consider a next-to-leading-order approximation for more accurate calculation of the mean exit time by computing large deviation prefactors with the aid of machine learning.More specifically,we design a neural network framework to compute quasipotential,most probable paths and prefactors based on the orthogonal decomposition of a vector field.We corroborate the higher effectiveness and accuracy of our algorithm with two toy models.Numerical experiments demonstrate its powerful functionality in exploring the internal mechanism of rare events triggered by weak random fluctuations.

Deterministic and Stochastic Fixed-Time Stability of Discrete-time Autonomous Systems

This paper studies deterministic and stochastic fixedtime stability of autonomous nonlinear discrete-time(DT)systems.Lyapunov conditions are first presented under which the fixed-time stability of deterministic DT systems is certified.Extensions to systems under deterministic perturbations as well as stochastic noise are then considered.For the former,sensitivity to perturbations for fixed-time stable DT systems is analyzed,and it is shown that fixed-time attractiveness results from the presented Lyapunov conditions.For the latter,sufficient Lyapunov conditions for fixed-time stability in probability of nonlinear stochastic DT systems are presented.The fixed upper bound of the settling-time function is derived for both fixed-time stable and fixed-time attractive systems,and a stochastic settling-time function fixed upper bound is derived for stochastic DT systems.Illustrative examples are given along with simulation results to verify the introduced results.

Rapid stabilization of stochastic quantum systems in a unified framework

Rapid stabilization of general stochastic quantum systems is investigated based on the rapid stability of stochastic differential equations.We introduce a Lyapunov-LaSalle-like theorem for a class of nonlinear stochastic systems first,based on which a unified framework of rapidly stabilizing stochastic quantum systems is proposed.According to the proposed unified framework,we design the switching state feedback controls to achieve the rapid stabilization of singlequbit systems,two-qubit systems,and N-qubit systems.From the unified framework,the state space is divided into two state subspaces,and the target state is located in one state subspace,while the other system equilibria are located in the other state subspace.Under the designed state feedback controls,the system state can only transit through the boundary between the two state subspaces no more than two times,and the target state is globally asymptotically stable in probability.In particular,the system state can converge exponentially in(all or part of)the state subspace where the target state is located.Moreover,the effectiveness and rapidity of the designed state feedback controls are shown in numerical simulations by stabilizing GHZ states for a three-qubit system.

Stochastic Models to Mitigate Sparse Sensor Attacks in Continuous-Time Non-Linear Cyber-Physical Systems

Cyber-Physical Systems are very vulnerable to sparse sensor attacks.But current protection mechanisms employ linear and deterministic models which cannot detect attacks precisely.Therefore,in this paper,we propose a new non-linear generalized model to describe Cyber-Physical Systems.This model includes unknown multivariable discrete and continuous-time functions and different multiplicative noises to represent the evolution of physical processes and randomeffects in the physical and computationalworlds.Besides,the digitalization stage in hardware devices is represented too.Attackers and most critical sparse sensor attacks are described through a stochastic process.The reconstruction and protectionmechanisms are based on aweighted stochasticmodel.Error probability in data samples is estimated through different indicators commonly employed in non-linear dynamics(such as the Fourier transform,first-return maps,or the probability density function).A decision algorithm calculates the final reconstructed value considering the previous error probability.An experimental validation based on simulation tools and real deployments is also carried out.Both,the new technology performance and scalability are studied.Results prove that the proposed solution protects Cyber-Physical Systems against up to 92%of attacks and perturbations,with a computational delay below 2.5 s.The proposed model shows a linear complexity,as recursive or iterative structures are not employed,just algebraic and probabilistic functions.In conclusion,the new model and reconstructionmechanism can protect successfully Cyber-Physical Systems against sparse sensor attacks,even in dense or pervasive deployments and scenarios.

Event-Triggered Finite-Time H∞ Filtering for Discrete-Time Nonlinear Stochastic Systems

This paper addresses the problem of event-triggered finite-time H∞ filter design for a class of discrete-time nonlinear stochastic systems with exogenous disturbances. The stochastic Lyapunov-Krasoviskii functional method is adopted to design a filter such that the filtering error system is stochastic finite-time stable (SFTS) and preserves a prescribed performance level according to the pre-defined event-triggered criteria. Based on stochastic differential equations theory, some sufficient conditions for the existence of H∞ filter are obtained for the suggested system by employing linear matrix inequality technique. Finally, the desired H∞ filter gain matrices can be expressed in an explicit form.

STOCHASTIC OPTIMAL CONTROL OF HYSTERETIC SYSTEMS UNDER EXTERNALLY AND PARAMETRICALLY RANDOM EXCITATIONS

A stochastic optimal control method for nonlinear hysteretic systems under externally and/or parametrically random excitations is presented and illustrated with an example of hysteretic column system. A hysteretic system subject to random excitation is first replaced by a nonlinear non-hysteretic stochastic system. An It$\hat {\rm o}$ stochastic differential equation for the total energy of the system as a one-dimensional controlled diffusion process is derived by using the stochastic averaging method of energy envelope. A dynamical programming equation is then established based on the stochastic dynamical programming principle and solved to yield the optimal control force. Finally, the responses of uncontrolled and controlled systems are evaluated to determine the control efficacy. It is shown by numerical results that the proposed stochastic optimal control method is more effective and efficient than other optimal control methods.

Robust H-infinity filter design for uncertaintime-delay singular stochastic systems withMarkovian jump

This paper deals with the problem of H-infinity filter design for uncertain time-delay singular stochastic systems with Markovian jump. Based on the extended It6 stochastic differential formula, sufficient conditions for the solvability of these problems are obtained. Furthermore, It is shown that a desired filter can be constructed by solving a set of linear matrix inequalities. Finally, a simulation example is given to demonstrate the effectiveness of the proposed method.

Robust reliable guaranteed cost control for nonlinear singular stochastic systems with time delay

To study the design problem of robust reliable guaranteed cost controller for nonlinear singular stochastic systems, the Takagi-Sugeno （T-S） fuzzy model is used to represent a nonlinear singular stochastic system with norm-bounded parameter uncertainties and time delay. Based on the linear matrix inequality （LMI） techniques and stability theory of stochastic differential equations, a stochastic Lyapunov function method is adopted to design a state feedback fuzzy controller. The resulting closed-loop fuzzy system is robustly reliable stochastically stable, and the corresponding quadratic cost function is guaranteed to be no more than a certain upper bound for all admissible uncertainties, as well as different actuator fault cases. A sufficient condition of existence and design method of robust reliable guaranteed cost controller is presented. Finally, a numerical simulation is given to illustrate the effectiveness of the proposed method.

Robust control for a class of nonlinear networked systems with stochastic communication delays via sliding mode conception

This paper deals with the robust control problem for a class of uncertain nonlinear networked systems with stochastic communication delays via sliding mode conception （SMC）. A sequence of variables obeying Bernoulli distribution are employed to model the randomly occurring communication delays which could be different for different state variables. A discrete switching function that is different from those in the existing literature is first proposed. Then, expressed as the feasibility of a linear matrix inequality （LMI） with an equality constraint, sufficient conditions are derived in order to ensure the globally mean-square asymptotic stability of the system dynamics on the sliding surface. A discrete-time SMC controller is then synthesized to guarantee the discrete-time sliding mode reaching condition with the specified sliding surface. Finally, a simulation example is given to show the effectiveness of the proposed method.

Robust reliable H-infinity control for nonlinear uncertain stochastic time-delay systems with Markovian jumping parameters

This paper deals with the problems of robust reliable exponential stabilization and robust stochastic stabilization with H-infinity performance for a class of nonlinear uncertain time-delay stochastic systems with Markovian jumping parameters. The time delays are assumed to be dependent on the system modes. Delay-dependent conditions for the solvability of these problems are obtained via parameter-dependent Lyapunov functionals. Furthermore, it is shown that the desired state feedback controller can be designed by solving a set of linear matrix inequalities. Finally, the simulation is provided to demonstrate the effectiveness of the proposed methods.

Delay-dependent robust stability and H_∞ analysis of stochastic systems with time-varying delay

This paper investigates the robust stochastic stability and H∞ analysis for stochastic systems with time-varying delay and Markovian jump. By using the freeweighting matrix technique, i.e., He＇s technique, and a stochastic Lyapunov-Krasovskii functional, new delay-dependent criteria in terms of linear matrix inequalities are derived for the the robust stochastic stability and the H∞ disturbance attenuation. Three numerical examples axe given. The results show that the proposed method is efficient and much less conservative than the existing results in the literature.

Shape control on probability density function in stochastic systems

A novel strategy of probability density function （PDF） shape control is proposed in stochastic systems. The control er is designed whose parameters are optimal y obtained through the improved particle swarm optimization algorithm. The parameters of the control er are viewed as the space position of a particle in particle swarm optimization algorithm and updated continual y until the control er makes the PDF of the state variable as close as possible to the expected PDF. The proposed PDF shape control technique is compared with the equivalent linearization technique through simulation experiments. The results show the superiority and the effectiveness of the proposed method. The control er is excellent in making the state PDF fol ow the expected PDF and has the very smal error between the state PDF and the expected PDF, solving the control problem of the PDF shape in stochastic systems effectively.

Stochastic bounded consensus of second-order multi-agent systems in noisy environment

This paper investigates the stochastic bounded consensus of leader-following second-order multi-agent systems in a noisy environment. It is assumed that each agent received the information of its neighbors corrupted by noises and time delays. Based on the graph theory, stochastic tools, and the Lyapunov function method, we derive the sufficient conditions under which the systems would reach stochastic bounded consensus in mean square with the protocol we designed. Finally, a numerical simulation is illustrated to check the effectiveness of the proposed algorithms.

Delay-dependent robust control for uncertain stochastic systems with Markovian switching and multiple delays

The exponential stability in mean square and stabiliza- tion problems for It＆ stochastic switched systems with multiple time-delays are investigated. The system possesses the norm- bounded uncertainties and Markovian jumping parameters. By using an effective descriptor model transformation of the system and applying Ito＇s differential formula and Moon＇s inequality for bounding cross terms, a new delay-dependent sufficient condi- tion is derived in terms of linear matrix inequalities, and its states feedback controller is designed. Numerical examples are given to illustrate the efficiency and less conservation of the results.

Guaranteed Quadratic Stabilization of Certain Time-Varying Large-Scale Delay It Stochastic Systems

In this paper, we investigate the decentralized stabilization of some time-varying uncertain large-scale stochastic systems with delays under matching conditions. A type of decentralized controllers with guaranteed stabilization and sub-optimality are also given.

On stabilization for a class of nonlinear stochastic time-delay systems:a matrix inequality approach

This paper treats the feedback stabilization of nonlinear stochastic time-delay systems with state and control-dependent noise. Some locally （globally） robustly stabilizable conditions are given in terms of matrix inequalities that are independent of the delay size. When it is applied to linear stochastic time-delay systems, sufficient conditions for the state-feedback stabilization are presented via linear matrix inequalities. Several previous results are extended to more general systems with both state and control-dependent noise, and easy computation algorithms are also given.

L-leap:accelerating the stochastic simulation of chemically reacting systems

Presented here is an L-leap method for accelerating stochastic simulation of well-stirred chemically reacting systems, in which the number of reactions occurring in a reaction channel with the largest propensity function is calculated from the leap condition and the number of reactions occurring in the other reaction channels are generated by using binomial random variables during a leap. The L-leap method can better satisfy the leap condition. Numerical simulation results indicate that the L-leap method can obtain better performance than established methods.

Controller design for stochastic nonlinear systems with matched conditions

This paper is concerned with the global boundedness problem for a class of stochastic nonlinear systems with matched conditions. The uncertainties in the systems are due to parameter variations and external stochastic disturbance. Only the matched conditions and the possible bound of the uncertainties are demanded. Based on the stochastic Lyapunov stability theory, an explicit controller is constructed in the gradient direction, which renders responses of the closed-loop systems be globally bounded in probability. When the systems degrade to linear systems, the controller becomes linear. Illustrative examples are given to show the effectiveness of the proposed method.

Stochastic bounded consensus tracking of leader-follower multi-agent systems with measurement noises and sampled-data

This paper is concerned with the stochastic bounded consensus tracking problems of leader-follower multi-agent systems, where the control input of an agent can only use the information measured at the sampling instants from its neighbours or the virtual leader with a time-varying reference state, and the measurements are corrupted by random noises. The probability limit theory and the algebra graph theory are employed to derive the necessary and sufficient conditions guaranteeing the mean square bounded consensus tracking. It is shown that the maximum allowable upper boundary of the sampling period simultaneously depends on the constant feedback gains and the network topology. Furthermore, the effects of the sampling period on the tracking performance are analysed. It turns out that from the view point of the sampling period, there is a trade-off between the tracking speed and the static tracking error. Simulations are provided to demonstrate the effectiveness of the theoretical results.

Linearized Controller Design for the Output Probability Density Functions of Non-Gaussian Stochastic Systems

This paper presents a linearized approach for the controller design of the shape of output probability density functions for general stochastic systems. A square root approximation to an output probability density function is realized by a set of B-spline functions. This generally produces a nonlinear state space model for the weights of the B-spline approximation. A linearized model is therefore obtained and embedded into a performance function that measures the tracking error of the output probability density function with respect to a given distribution. By using this performance function as a Lyapunov function for the closed loop system, a feedback control input has been obtained which guarantees closed loop stability and realizes perfect tracking. The algorithm described in this paper has been tested on a simulated example and desired results have been achieved.