Pure State Feedback Switching Control Based on the Online Estimated State for Stochastic Open Quantum Systems

For the n-qubit stochastic open quantum systems,based on the Lyapunov stability theorem and LaSalle’s invariant set principle,a pure state switching control based on on-line estimated state feedback(short for OQST-SFC)is proposed to realize the state transition the pure state of the target state including eigenstate and superposition state.The proposed switching control consists of a constant control and a control law designed based on the Lyapunov method,in which the Lyapunov function is the state distance of the system.The constant control is used to drive the system state from an initial state to the convergence domain only containing the target state,and a Lyapunov-based control is used to make the state enter the convergence domain and then continue to converge to the target state.At the same time,the continuous weak measurement of quantum system and the quantum state tomography method based on the on-line alternating direction multiplier(QST-OADM)are used to obtain the system information and estimate the quantum state which is used as the input of the quantum system controller.Then,the pure state feedback switching control method based on the on-line estimated state feedback is realized in an n-qubit stochastic open quantum system.The complete derivation process of n-qubit QST-OADM algorithm is given;Through strict theoretical proof and analysis,the convergence conditions to ensure any initial state of the quantum system to converge the target pure state are given.The proposed control method is applied to a 2-qubit stochastic open quantum system for numerical simulation experiments.Four possible different position cases between the initial estimated state and that of the controlled system are studied and discussed,and the performances of the state transition under the corresponding cases are analyzed.

A NOTE ON THE GENERAL STABILIZATION OF DISCRETE FEEDBACK CONTROL FOR NON-AUTONOMOUS HYBRID NEUTRAL STOCHASTIC SYSTEMS WITH A DELAY

Discrete feedback control was designed to stabilize an unstable hybrid neutral stochastic differential delay system(HNSDDS) under a highly nonlinear constraint in the H_∞ and exponential forms.Nevertheless,the existing work just adapted to autonomous cases,and the obtained results were mainly on exponential stabilization.In comparison with autonomous cases,non-autonomous systems are of great interest and represent an important challenge.Accordingly,discrete feedback control has here been adjusted with a time factor to stabilize an unstable non-autonomous HNSDDS,in which new Lyapunov-Krasovskii functionals and some novel technologies are adopted.It should be noted,in particular,that the stabilization can be achieved not only in the routine H_∞ and exponential forms,but also the polynomial form and even a general form.

Stochastic Maximum Principle for Optimal Advertising Models with Delay and Non-Convex Control Spaces

In this paper we study optimal advertising problems that model the introduction of a new product into the market in the presence of carryover effects of the advertisement and with memory effects in the level of goodwill. In particular, we let the dynamics of the product goodwill to depend on the past, and also on past advertising efforts. We treat the problem by means of the stochastic Pontryagin maximum principle, that here is considered for a class of problems where in the state equation either the state or the control depend on the past. Moreover the control acts on the martingale term and the space of controls U can be chosen to be non-convex but now the space of controls U can be chosen to be non-convex. The maximum principle is thus formulated using a first-order adjoint Backward Stochastic Differential Equations (BSDEs), which can be explicitly computed due to the specific characteristics of the model, and a second-order adjoint relation.

Stochastic sampled-data multi-objective control of active suspension systems for in-wheel motor driven electric vehicles

This paper addresses the sampled-data multi-objective active suspension control problem for an in-wheel motor driven electric vehicle subject to stochastic sampling periods and asynchronous premise variables.The focus is placed on the scenario that the dynamical state of the half-vehicle active suspension system is transmitted over an in-vehicle controller area network that only permits the transmission of sampled data packets.For this purpose,a stochastic sampling mechanism is developed such that the sampling periods can randomly switch among different values with certain mathematical probabilities.Then,an asynchronous fuzzy sampled-data controller,featuring distinct premise variables from the active suspension system,is constructed to eliminate the stringent requirement that the sampled-data controller has to share the same grades of membership.Furthermore,novel criteria for both stability analysis and controller design are derived in order to guarantee that the resultant closed-loop active suspension system is stochastically stable with simultaneous𝐻2 and𝐻∞performance requirements.Finally,the effectiveness of the proposed stochastic sampled-data multi-objective control method is verified via several numerical cases studies in both time domain and frequency domain under various road disturbance profiles.

A Mean-Field Game for a Forward-Backward Stochastic System With Partial Observation and Common Noise

This paper considers a linear-quadratic(LQ) meanfield game governed by a forward-backward stochastic system with partial observation and common noise,where a coupling structure enters state equations,cost functionals and observation equations.Firstly,to reduce the complexity of solving the meanfield game,a limiting control problem is introduced.By virtue of the decomposition approach,an admissible control set is proposed.Applying a filter technique and dimensional-expansion technique,a decentralized control strategy and a consistency condition system are derived,and the related solvability is also addressed.Secondly,we discuss an approximate Nash equilibrium property of the decentralized control strategy.Finally,we work out a financial problem with some numerical simulations.

Iterative Learning Control for Discrete-time Stochastic Systems with Quantized Information

An iterative learning control (ILC) algorithm using quantized error information is given in this paper for both linear and nonlinear discrete-time systems with stochastic noises. A logarithmic quantizer is used to guarantee an adaptive improvement in tracking performance. A decreasing learning gain is introduced into the algorithm to suppress the effects of stochastic noises and quantization errors. The input sequence is proved to converge strictly to the optimal input under the given index. Illustrative simulations are given to verify the theoretical analysis. © 2014 Chinese Association of Automation.

A CLASS OF STATIONARY MODELS OF SINGULAR STOCHASTIC CONTROL

A class of stationary models of singular stochastic control has been studied, in which the state is extended to solution of a class of S.D.E. from Wiener process. The existence of optimal control has been proved in all cases under some weaker conditions, and the structure of optimal control may be characterized.

A NEW STOCHASTIC OPTIMAL CONTROL STRATEGY FOR HYSTERETIC MR DAMPERS

A new stochastic optimal control strategy for randomly excited quasi-integrable Hamiltonian systems using magneto-rheological (MR) dampers is proposed. The dynamic be- havior of an MR damper is characterized by the Bouc-Wen hysteretic model. The control force produced by the MR damper is separated into a passive part incorporated in the uncontrolled system and a semi-active part to be determined. The system combining the Bouc-Wen hysteretic force is converted into an equivalent non-hysteretic nonlinear stochastic control system. Then It?o stochastic di?erential equations are derived from the equivalent system by using the stochastic averaging method. A dynamical programming equation for the controlled di?usion processes is established based on the stochastic dynamical programming principle. The non-clipping nonlin- ear optimal control law is obtained for a certain performance index by minimizing the dynamical programming equation. Finally, an example is given to illustrate the application and e?ectiveness of the proposed control strategy.

Fault tolerant control based on stochastic distribution via RBF neural networks

A new fault tolerant control（FTC） via a controller reconfiguration approach for general stochastic nonlinear systems is studied.Different from the formulation of classical FTC methods,it is supposed that the measured information for the FTC is the probability density functions（PDFs） of the system output rather than its measured value.A radial basis functions（RBFs） neural network technique is proposed so that the output PDFs can be formulated in terms of the dynamic weighings of the RBFs neural network.As a result,the nonlinear FTC problem subject to dynamic relation between the input and the output PDFs can be transformed into a nonlinear FTC problem subject to dynamic relation between the control input and the weights of the RBFs neural network approximation to the output PDFs.The FTC design consists of two steps.The first step is fault detection and diagnosis（FDD）,which can produce an alarm when there is a fault in the system and also locate which component has a fault.The second step is to adapt the controller to the faulty case so that the system is able to achieve its target.A linear matrix inequality（LMI） based feasible FTC method is applied such that the fault can be detected and diagnosed.An illustrated example is included to demonstrate the efficiency of the proposed algorithm,and satisfactory results have been obtained.

On stochastic optimal control of partially observable nonlinear quasi Hamiltonian systems

A stochastic optimal control strategy for partially observable nonlinear quasi Hamiltonian systems is proposed. The optimal control forces consist of two parts. The first part is determined by the conditions under which the stochastic optimal control problem of a partially observable nonlinear system is converted into that of a completely observable linear system. The second part is determined by solving the dynamical programming equation derived by applying the stochastic averaging method and stochastic dynamical programming principle to the completely observable linear control system. The response of the optimally controlled quasi Hamiltonian system is predicted by solving the averaged Fokker-Planck-Kolmogorov equation associated with the optimally controlled completely observable linear system and solving the Riccati equation for the estimated error of system states. An example is given to illustrate the procedure and effectiveness of the proposed control strategy.

Robust H_∞ control for neutral stochastic uncertain systems with time-varying delay

The problem of robust H_∞ control for uncertain neutral stochastic systems with time-varying delay is discussed.The parameter uncertaintie is assumed to be time varying norm-bounded.First,the stochastic robust stabilization of the stochastic system without disturbance input is investigated by nonlinear matrix inequality method.Then,a full-order stochastic dynamic output feedback controller is designed by solving a bilinear matrix inequality（BMI）,which ensures a prescribed stochastic robust H_∞ performance level for the resulting closed-loop system with nonzero disturbance input and for all admissible uncertainties.An illustrative example is provided to show the feasibility of the controller and the potential of the proposed technique.

Impulsive control of stochastic system under the sense of stochastic asymptotical stability

This paper studies the stochastic asymptotical stability of stochastic impulsive differential equations, and establishes a comparison theory to ensure the trivial solution＇s stochastic asymptotical stability. From the comparison theory, it can find out whether the stochastic impulsive differential system is stable just by studying the stability of a deterministic comparison system. As a general application of this theory, it controls the chaos of stochastic Lii system using impulsive control method, and numerical simulations are employed to verify the feasibility of this method.

STOCHASTIC OPTIMAL CONTROL OF HYSTERETIC SYSTEMS UNDER EXTERNALLY AND PARAMETRICALLY RANDOM EXCITATIONS

A stochastic optimal control method for nonlinear hysteretic systems under externally and/or parametrically random excitations is presented and illustrated with an example of hysteretic column system. A hysteretic system subject to random excitation is first replaced by a nonlinear non-hysteretic stochastic system. An It$\hat {\rm o}$ stochastic differential equation for the total energy of the system as a one-dimensional controlled diffusion process is derived by using the stochastic averaging method of energy envelope. A dynamical programming equation is then established based on the stochastic dynamical programming principle and solved to yield the optimal control force. Finally, the responses of uncontrolled and controlled systems are evaluated to determine the control efficacy. It is shown by numerical results that the proposed stochastic optimal control method is more effective and efficient than other optimal control methods.

EXISTENCE OF SOLUTION AND APPROXIMATE CONTROLLABILITY OF A SECOND-ORDER NEUTRAL STOCHASTIC DIFFERENTIAL EQUATION WITH STATE DEPENDENT DELAY

This paper has two sections which deals with a second order stochastic neutral partial differential equation with state dependent delay. In the first section the existence and uniqueness of mild solution is obtained by use of measure of non-compactness. In the second section the conditions for approximate controllability are investigated for the distributed second order neutral stochastic differential system with respect to the approximate controllability of the corresponding linear system in a Hilbert space. Our method is an extension of co-author N. Sukavanam’s novel approach in [22]. Thereby, we remove the need to assume the invertibility of a controllability operator used by authors in [5], which fails to exist in infinite dimensional spaces if the associated semigroup is compact. Our approach also removes the need to check the invertibility of the controllability Gramian operator and associated limit condition used by the authors in [20], which are practically difficult to verify and apply. An example is provided to illustrate the presented theory.

Optimal control strategies for stochastically excited quasi partially integrable Hamiltonian systems

In this paper two different control strategies designed to alleviate the response of quasi partially integrable Hamiltonian systems subjected to stochastic excitation are proposed. First, by using the stochastic averaging method for quasi partially integrable Hamiltonian systems, an n-DOF controlled quasi partially integrable Hamiltonian system with stochastic excitation is converted into a set of partially averaged It^↑o stochastic differential equations. Then, the dynamical programming equation associated with the partially averaged It^↑o equations is formulated by applying the stochastic dynamical programming principle. In the first control strategy, the optimal control law is derived from the dynamical programming equation and the control constraints without solving the dynamical programming equation. In the second control strategy, the optimal control law is obtained by solving the dynamical programming equation. Finally, both the responses of controlled and uncontrolled systems are predicted through solving the Fokker-Plank-Kolmogorov equation associated with fully averaged It^↑o equations. An example is worked out to illustrate the application and effectiveness of the two proposed control strategies.

Robust reliable guaranteed cost control for nonlinear singular stochastic systems with time delay

To study the design problem of robust reliable guaranteed cost controller for nonlinear singular stochastic systems, the Takagi-Sugeno （T-S） fuzzy model is used to represent a nonlinear singular stochastic system with norm-bounded parameter uncertainties and time delay. Based on the linear matrix inequality （LMI） techniques and stability theory of stochastic differential equations, a stochastic Lyapunov function method is adopted to design a state feedback fuzzy controller. The resulting closed-loop fuzzy system is robustly reliable stochastically stable, and the corresponding quadratic cost function is guaranteed to be no more than a certain upper bound for all admissible uncertainties, as well as different actuator fault cases. A sufficient condition of existence and design method of robust reliable guaranteed cost controller is presented. Finally, a numerical simulation is given to illustrate the effectiveness of the proposed method.

STOCHASTIC OPTIMAL CONTROL OF STRONGLY NONLINEAR SYSTEMS UNDER WIDE-BAND RANDOM EXCITATION WITH ACTUATOR SATURATION

A bounded optimal control strategy for strongly non-linear systems under non-white wide-band random excitation with actuator saturation is proposed. First, the stochastic averaging method is introduced for controlled strongly non-linear systems under wide-band random excitation using generalized harmonic functions. Then, the dynamical programming equation for the saturated control problem is formulated from the partially averaged Itō equation based on the dynamical programming principle. The optimal control consisting of the unbounded optimal control and the bounded bang-bang control is determined by solving the dynamical programming equation. Finally, the response of the optimally controlled system is predicted by solving the reduced Fokker-Planck-Kolmogorov （FPK） equation associated with the completed averaged Itō equation. An example is given to illustrate the proposed control strategy. Numerical results show that the proposed control strategy has high control effectiveness and efficiency and the chattering is reduced significantly comparing with the bang-bang control strategy.

Robust reliable H-infinity control for nonlinear uncertain stochastic time-delay systems with Markovian jumping parameters

This paper deals with the problems of robust reliable exponential stabilization and robust stochastic stabilization with H-infinity performance for a class of nonlinear uncertain time-delay stochastic systems with Markovian jumping parameters. The time delays are assumed to be dependent on the system modes. Delay-dependent conditions for the solvability of these problems are obtained via parameter-dependent Lyapunov functionals. Furthermore, it is shown that the desired state feedback controller can be designed by solving a set of linear matrix inequalities. Finally, the simulation is provided to demonstrate the effectiveness of the proposed methods.

Shape control on probability density function in stochastic systems

A novel strategy of probability density function （PDF） shape control is proposed in stochastic systems. The control er is designed whose parameters are optimal y obtained through the improved particle swarm optimization algorithm. The parameters of the control er are viewed as the space position of a particle in particle swarm optimization algorithm and updated continual y until the control er makes the PDF of the state variable as close as possible to the expected PDF. The proposed PDF shape control technique is compared with the equivalent linearization technique through simulation experiments. The results show the superiority and the effectiveness of the proposed method. The control er is excellent in making the state PDF fol ow the expected PDF and has the very smal error between the state PDF and the expected PDF, solving the control problem of the PDF shape in stochastic systems effectively.

Stochastic Iterative Learning Control With Faded Signals

Stochastic iterative learning control(ILC) is designed for solving the tracking problem of stochastic linear systems through fading channels. Consequently, the signals used in learning control algorithms are faded in the sense that a random variable is multiplied by the original signal. To achieve the tracking objective, a two-dimensional Kalman filtering method is used in this study to derive a learning gain matrix varying along both time and iteration axes. The learning gain matrix minimizes the trace of input error covariance. The asymptotic convergence of the generated input sequence to the desired input value is strictly proved in the mean-square sense. Both output and input fading are accounted for separately in turn, followed by a general formulation that both input and output fading coexists.Illustrative examples are provided to verify the effectiveness of the proposed schemes.