Computing large deviation prefactors of stochastic dynamical systems based on machine learning

We present a large deviation theory that characterizes the exponential estimate for rare events in stochastic dynamical systems in the limit of weak noise.We aim to consider a next-to-leading-order approximation for more accurate calculation of the mean exit time by computing large deviation prefactors with the aid of machine learning.More specifically,we design a neural network framework to compute quasipotential,most probable paths and prefactors based on the orthogonal decomposition of a vector field.We corroborate the higher effectiveness and accuracy of our algorithm with two toy models.Numerical experiments demonstrate its powerful functionality in exploring the internal mechanism of rare events triggered by weak random fluctuations.

Pure State Feedback Switching Control Based on the Online Estimated State for Stochastic Open Quantum Systems

For the n-qubit stochastic open quantum systems,based on the Lyapunov stability theorem and LaSalle’s invariant set principle,a pure state switching control based on on-line estimated state feedback(short for OQST-SFC)is proposed to realize the state transition the pure state of the target state including eigenstate and superposition state.The proposed switching control consists of a constant control and a control law designed based on the Lyapunov method,in which the Lyapunov function is the state distance of the system.The constant control is used to drive the system state from an initial state to the convergence domain only containing the target state,and a Lyapunov-based control is used to make the state enter the convergence domain and then continue to converge to the target state.At the same time,the continuous weak measurement of quantum system and the quantum state tomography method based on the on-line alternating direction multiplier(QST-OADM)are used to obtain the system information and estimate the quantum state which is used as the input of the quantum system controller.Then,the pure state feedback switching control method based on the on-line estimated state feedback is realized in an n-qubit stochastic open quantum system.The complete derivation process of n-qubit QST-OADM algorithm is given;Through strict theoretical proof and analysis,the convergence conditions to ensure any initial state of the quantum system to converge the target pure state are given.The proposed control method is applied to a 2-qubit stochastic open quantum system for numerical simulation experiments.Four possible different position cases between the initial estimated state and that of the controlled system are studied and discussed,and the performances of the state transition under the corresponding cases are analyzed.

Deterministic and Stochastic Fixed-Time Stability of Discrete-time Autonomous Systems

This paper studies deterministic and stochastic fixedtime stability of autonomous nonlinear discrete-time(DT)systems.Lyapunov conditions are first presented under which the fixed-time stability of deterministic DT systems is certified.Extensions to systems under deterministic perturbations as well as stochastic noise are then considered.For the former,sensitivity to perturbations for fixed-time stable DT systems is analyzed,and it is shown that fixed-time attractiveness results from the presented Lyapunov conditions.For the latter,sufficient Lyapunov conditions for fixed-time stability in probability of nonlinear stochastic DT systems are presented.The fixed upper bound of the settling-time function is derived for both fixed-time stable and fixed-time attractive systems,and a stochastic settling-time function fixed upper bound is derived for stochastic DT systems.Illustrative examples are given along with simulation results to verify the introduced results.

Rapid stabilization of stochastic quantum systems in a unified framework

Rapid stabilization of general stochastic quantum systems is investigated based on the rapid stability of stochastic differential equations.We introduce a Lyapunov-LaSalle-like theorem for a class of nonlinear stochastic systems first,based on which a unified framework of rapidly stabilizing stochastic quantum systems is proposed.According to the proposed unified framework,we design the switching state feedback controls to achieve the rapid stabilization of singlequbit systems,two-qubit systems,and N-qubit systems.From the unified framework,the state space is divided into two state subspaces,and the target state is located in one state subspace,while the other system equilibria are located in the other state subspace.Under the designed state feedback controls,the system state can only transit through the boundary between the two state subspaces no more than two times,and the target state is globally asymptotically stable in probability.In particular,the system state can converge exponentially in(all or part of)the state subspace where the target state is located.Moreover,the effectiveness and rapidity of the designed state feedback controls are shown in numerical simulations by stabilizing GHZ states for a three-qubit system.

Stochastic Models to Mitigate Sparse Sensor Attacks in Continuous-Time Non-Linear Cyber-Physical Systems

Cyber-Physical Systems are very vulnerable to sparse sensor attacks.But current protection mechanisms employ linear and deterministic models which cannot detect attacks precisely.Therefore,in this paper,we propose a new non-linear generalized model to describe Cyber-Physical Systems.This model includes unknown multivariable discrete and continuous-time functions and different multiplicative noises to represent the evolution of physical processes and randomeffects in the physical and computationalworlds.Besides,the digitalization stage in hardware devices is represented too.Attackers and most critical sparse sensor attacks are described through a stochastic process.The reconstruction and protectionmechanisms are based on aweighted stochasticmodel.Error probability in data samples is estimated through different indicators commonly employed in non-linear dynamics(such as the Fourier transform,first-return maps,or the probability density function).A decision algorithm calculates the final reconstructed value considering the previous error probability.An experimental validation based on simulation tools and real deployments is also carried out.Both,the new technology performance and scalability are studied.Results prove that the proposed solution protects Cyber-Physical Systems against up to 92%of attacks and perturbations,with a computational delay below 2.5 s.The proposed model shows a linear complexity,as recursive or iterative structures are not employed,just algebraic and probabilistic functions.In conclusion,the new model and reconstructionmechanism can protect successfully Cyber-Physical Systems against sparse sensor attacks,even in dense or pervasive deployments and scenarios.

Event-Triggered Finite-Time H∞ Filtering for Discrete-Time Nonlinear Stochastic Systems

This paper addresses the problem of event-triggered finite-time H∞ filter design for a class of discrete-time nonlinear stochastic systems with exogenous disturbances. The stochastic Lyapunov-Krasoviskii functional method is adopted to design a filter such that the filtering error system is stochastic finite-time stable (SFTS) and preserves a prescribed performance level according to the pre-defined event-triggered criteria. Based on stochastic differential equations theory, some sufficient conditions for the existence of H∞ filter are obtained for the suggested system by employing linear matrix inequality technique. Finally, the desired H∞ filter gain matrices can be expressed in an explicit form.

Iterative Learning Control for Discrete-time Stochastic Systems with Quantized Information

An iterative learning control (ILC) algorithm using quantized error information is given in this paper for both linear and nonlinear discrete-time systems with stochastic noises. A logarithmic quantizer is used to guarantee an adaptive improvement in tracking performance. A decreasing learning gain is introduced into the algorithm to suppress the effects of stochastic noises and quantization errors. The input sequence is proved to converge strictly to the optimal input under the given index. Illustrative simulations are given to verify the theoretical analysis. © 2014 Chinese Association of Automation.

STOCHASTIC OPTIMAL CONTROL OF HYSTERETIC SYSTEMS UNDER EXTERNALLY AND PARAMETRICALLY RANDOM EXCITATIONS

A stochastic optimal control method for nonlinear hysteretic systems under externally and/or parametrically random excitations is presented and illustrated with an example of hysteretic column system. A hysteretic system subject to random excitation is first replaced by a nonlinear non-hysteretic stochastic system. An It$\hat {\rm o}$ stochastic differential equation for the total energy of the system as a one-dimensional controlled diffusion process is derived by using the stochastic averaging method of energy envelope. A dynamical programming equation is then established based on the stochastic dynamical programming principle and solved to yield the optimal control force. Finally, the responses of uncontrolled and controlled systems are evaluated to determine the control efficacy. It is shown by numerical results that the proposed stochastic optimal control method is more effective and efficient than other optimal control methods.

Robust H-infinity filter design for uncertaintime-delay singular stochastic systems withMarkovian jump

This paper deals with the problem of H-infinity filter design for uncertain time-delay singular stochastic systems with Markovian jump. Based on the extended It6 stochastic differential formula, sufficient conditions for the solvability of these problems are obtained. Furthermore, It is shown that a desired filter can be constructed by solving a set of linear matrix inequalities. Finally, a simulation example is given to demonstrate the effectiveness of the proposed method.

Shape control on probability density function in stochastic systems

A novel strategy of probability density function （PDF） shape control is proposed in stochastic systems. The control er is designed whose parameters are optimal y obtained through the improved particle swarm optimization algorithm. The parameters of the control er are viewed as the space position of a particle in particle swarm optimization algorithm and updated continual y until the control er makes the PDF of the state variable as close as possible to the expected PDF. The proposed PDF shape control technique is compared with the equivalent linearization technique through simulation experiments. The results show the superiority and the effectiveness of the proposed method. The control er is excellent in making the state PDF fol ow the expected PDF and has the very smal error between the state PDF and the expected PDF, solving the control problem of the PDF shape in stochastic systems effectively.

Robust reliable guaranteed cost control for nonlinear singular stochastic systems with time delay

To study the design problem of robust reliable guaranteed cost controller for nonlinear singular stochastic systems, the Takagi-Sugeno （T-S） fuzzy model is used to represent a nonlinear singular stochastic system with norm-bounded parameter uncertainties and time delay. Based on the linear matrix inequality （LMI） techniques and stability theory of stochastic differential equations, a stochastic Lyapunov function method is adopted to design a state feedback fuzzy controller. The resulting closed-loop fuzzy system is robustly reliable stochastically stable, and the corresponding quadratic cost function is guaranteed to be no more than a certain upper bound for all admissible uncertainties, as well as different actuator fault cases. A sufficient condition of existence and design method of robust reliable guaranteed cost controller is presented. Finally, a numerical simulation is given to illustrate the effectiveness of the proposed method.

An Algebraic Detection Approach for Control Systems under Multiple Stochastic Cyber-attacks

In order to compromise a target control system successfully, hackers possibly attempt to launch multiple cyberattacks aiming at multiple communication channels of the control system. However, the problem of detecting multiple cyber-attacks has been hardly investigated so far. Therefore, this paper deals with the detection of multiple stochastic cyber-attacks aiming at multiple communication channels of a control system. Our goal is to design a detector for the control system under multiple cyberattacks. Based on frequency-domain transformation technique and auxiliary detection tools, an algebraic detection approach is proposed. By applying the presented approach, residual information caused by different attacks is obtained respectively and anomalies in the control system are detected. Sufficient and necessary conditions guaranteeing the detectability of the multiple stochastic cyber-attacks are obtained. The presented detection approach is simple and straightforward. Finally, two simulation examples are provided, and the simulation results show that the detection approach is effective and feasible. © 2014 Chinese Association of Automation.

Robust control for a class of nonlinear networked systems with stochastic communication delays via sliding mode conception

This paper deals with the robust control problem for a class of uncertain nonlinear networked systems with stochastic communication delays via sliding mode conception （SMC）. A sequence of variables obeying Bernoulli distribution are employed to model the randomly occurring communication delays which could be different for different state variables. A discrete switching function that is different from those in the existing literature is first proposed. Then, expressed as the feasibility of a linear matrix inequality （LMI） with an equality constraint, sufficient conditions are derived in order to ensure the globally mean-square asymptotic stability of the system dynamics on the sliding surface. A discrete-time SMC controller is then synthesized to guarantee the discrete-time sliding mode reaching condition with the specified sliding surface. Finally, a simulation example is given to show the effectiveness of the proposed method.

Robust reliable H-infinity control for nonlinear uncertain stochastic time-delay systems with Markovian jumping parameters

This paper deals with the problems of robust reliable exponential stabilization and robust stochastic stabilization with H-infinity performance for a class of nonlinear uncertain time-delay stochastic systems with Markovian jumping parameters. The time delays are assumed to be dependent on the system modes. Delay-dependent conditions for the solvability of these problems are obtained via parameter-dependent Lyapunov functionals. Furthermore, it is shown that the desired state feedback controller can be designed by solving a set of linear matrix inequalities. Finally, the simulation is provided to demonstrate the effectiveness of the proposed methods.

Delay-dependent robust stability and H_∞ analysis of stochastic systems with time-varying delay

This paper investigates the robust stochastic stability and H∞ analysis for stochastic systems with time-varying delay and Markovian jump. By using the freeweighting matrix technique, i.e., He＇s technique, and a stochastic Lyapunov-Krasovskii functional, new delay-dependent criteria in terms of linear matrix inequalities are derived for the the robust stochastic stability and the H∞ disturbance attenuation. Three numerical examples axe given. The results show that the proposed method is efficient and much less conservative than the existing results in the literature.

Stochastic bounded consensus of second-order multi-agent systems in noisy environment

This paper investigates the stochastic bounded consensus of leader-following second-order multi-agent systems in a noisy environment. It is assumed that each agent received the information of its neighbors corrupted by noises and time delays. Based on the graph theory, stochastic tools, and the Lyapunov function method, we derive the sufficient conditions under which the systems would reach stochastic bounded consensus in mean square with the protocol we designed. Finally, a numerical simulation is illustrated to check the effectiveness of the proposed algorithms.

Delay-dependent robust control for uncertain stochastic systems with Markovian switching and multiple delays

The exponential stability in mean square and stabiliza- tion problems for It＆ stochastic switched systems with multiple time-delays are investigated. The system possesses the norm- bounded uncertainties and Markovian jumping parameters. By using an effective descriptor model transformation of the system and applying Ito＇s differential formula and Moon＇s inequality for bounding cross terms, a new delay-dependent sufficient condi- tion is derived in terms of linear matrix inequalities, and its states feedback controller is designed. Numerical examples are given to illustrate the efficiency and less conservation of the results.

Fixed-Time Lyapunov Criteria and State-Feedback Controller Design for Stochastic Nonlinear Systems

This paper investigates the fixed-time stability theorem and state-feedback controller design for stochastic nonlinear systems.We propose an improved fixed-time Lyapunov theorem with a more rigorous and reasonable proof procedure.In particular,an important corollary is obtained,which can give a less conservative upper-bound estimate of the settling time.Based on the backstepping technique and the addition of a power integrator method,a state-feedback controller is skillfully designed for a class of stochastic nonlinear systems.It is proved that the proposed controller can render the closed-loop system fixed-time stable in probability with the help of the proposed fixed-time stability criteria.Finally,the effectiveness of the proposed controller is demonstrated by simulation examples and comparisons.

Guaranteed Quadratic Stabilization of Certain Time-Varying Large-Scale Delay It Stochastic Systems

In this paper, we investigate the decentralized stabilization of some time-varying uncertain large-scale stochastic systems with delays under matching conditions. A type of decentralized controllers with guaranteed stabilization and sub-optimality are also given.

On stabilization for a class of nonlinear stochastic time-delay systems:a matrix inequality approach

This paper treats the feedback stabilization of nonlinear stochastic time-delay systems with state and control-dependent noise. Some locally （globally） robustly stabilizable conditions are given in terms of matrix inequalities that are independent of the delay size. When it is applied to linear stochastic time-delay systems, sufficient conditions for the state-feedback stabilization are presented via linear matrix inequalities. Several previous results are extended to more general systems with both state and control-dependent noise, and easy computation algorithms are also given.