The Maximum Principle for Fully Coupled Forward-backward Stochastic Control System

The maximum principle for fully coupled forward-backward stochastic control system in the global form is proved, under the assumption that the forward diffusion coefficient does not contain the control variable, but the control domain is not necessarily convex.

A Mean-Field Game for a Forward-Backward Stochastic System With Partial Observation and Common Noise

This paper considers a linear-quadratic(LQ) meanfield game governed by a forward-backward stochastic system with partial observation and common noise,where a coupling structure enters state equations,cost functionals and observation equations.Firstly,to reduce the complexity of solving the meanfield game,a limiting control problem is introduced.By virtue of the decomposition approach,an admissible control set is proposed.Applying a filter technique and dimensional-expansion technique,a decentralized control strategy and a consistency condition system are derived,and the related solvability is also addressed.Secondly,we discuss an approximate Nash equilibrium property of the decentralized control strategy.Finally,we work out a financial problem with some numerical simulations.

A NOTE ON THE GENERAL STABILIZATION OF DISCRETE FEEDBACK CONTROL FOR NON-AUTONOMOUS HYBRID NEUTRAL STOCHASTIC SYSTEMS WITH A DELAY

Discrete feedback control was designed to stabilize an unstable hybrid neutral stochastic differential delay system(HNSDDS) under a highly nonlinear constraint in the H_∞ and exponential forms.Nevertheless,the existing work just adapted to autonomous cases,and the obtained results were mainly on exponential stabilization.In comparison with autonomous cases,non-autonomous systems are of great interest and represent an important challenge.Accordingly,discrete feedback control has here been adjusted with a time factor to stabilize an unstable non-autonomous HNSDDS,in which new Lyapunov-Krasovskii functionals and some novel technologies are adopted.It should be noted,in particular,that the stabilization can be achieved not only in the routine H_∞ and exponential forms,but also the polynomial form and even a general form.

Stochastic Maximum Principle for Optimal Advertising Models with Delay and Non-Convex Control Spaces

In this paper we study optimal advertising problems that model the introduction of a new product into the market in the presence of carryover effects of the advertisement and with memory effects in the level of goodwill. In particular, we let the dynamics of the product goodwill to depend on the past, and also on past advertising efforts. We treat the problem by means of the stochastic Pontryagin maximum principle, that here is considered for a class of problems where in the state equation either the state or the control depend on the past. Moreover the control acts on the martingale term and the space of controls U can be chosen to be non-convex but now the space of controls U can be chosen to be non-convex. The maximum principle is thus formulated using a first-order adjoint Backward Stochastic Differential Equations (BSDEs), which can be explicitly computed due to the specific characteristics of the model, and a second-order adjoint relation.

Stochastic sampled-data multi-objective control of active suspension systems for in-wheel motor driven electric vehicles

This paper addresses the sampled-data multi-objective active suspension control problem for an in-wheel motor driven electric vehicle subject to stochastic sampling periods and asynchronous premise variables.The focus is placed on the scenario that the dynamical state of the half-vehicle active suspension system is transmitted over an in-vehicle controller area network that only permits the transmission of sampled data packets.For this purpose,a stochastic sampling mechanism is developed such that the sampling periods can randomly switch among different values with certain mathematical probabilities.Then,an asynchronous fuzzy sampled-data controller,featuring distinct premise variables from the active suspension system,is constructed to eliminate the stringent requirement that the sampled-data controller has to share the same grades of membership.Furthermore,novel criteria for both stability analysis and controller design are derived in order to guarantee that the resultant closed-loop active suspension system is stochastically stable with simultaneous𝐻2 and𝐻∞performance requirements.Finally,the effectiveness of the proposed stochastic sampled-data multi-objective control method is verified via several numerical cases studies in both time domain and frequency domain under various road disturbance profiles.

GENERAL COUPLED MEAN-FIELD REFLECTED FORWARD-BACKWARD STOCHASTIC DIFFERENTIAL EQUATIONS

In this paper we consider general coupled mean-field reflected forward-backward stochastic differential equations(FBSDEs),whose coefficients not only depend on the solution but also on the law of the solution.The first part of the paper is devoted to the existence and the uniqueness of solutions for such general mean-field reflected backward stochastic differential equations(BSDEs)under Lipschitz conditions,and for the one-dimensional case a comparison theorem is studied.With the help of this comparison result,we prove the existence of the solution for our mean-field reflected forward-backward stochastic differential equation under continuity assumptions.It should be mentioned that,under appropriate assumptions,we prove the uniqueness of this solution as well as that of a comparison theorem for mean-field reflected FBSDEs in a non-trivial manner.

A Mean-Field Optimal Control for Fully Coupled Forward-Backward Stochastic Control Systems with Lévy Processes

This paper is concerned with a class of mean-field type stochastic optimal control systems,which are governed by fully coupled mean-field forward-backward stochastic differential equations with Teugels martingales associated to Lévy processes.In these systems,the coefficients contain not only the state processes but also their marginal distribution,and the cost function is of mean-field type as well.The necessary and sufficient conditions for such optimal problems are obtained.Furthermore,the applications to the linear quadratic stochastic optimization control problem are investigated.

MAXIMUM PRINCIPLE FOR FORWARD-BACKWARD STOCHASTIC CONTROL SYSTEM WITH RANDOM JUMPS AND APPLICATIONS TO FINANCE

Both necessary and sufficient maximum principles for optimal control of stochastic systemwith random jumps consisting of forward and backward state variables are proved.The control variableis allowed to enter both diffusion and jump coefficients.The result is applied to a mean-varianceportfolio selection mixed with a recursive utility functional optimization problem.Explicit expressionof the optimal portfolio selection strategy is obtained in the state feedback form.

Forward-backward Stochastic Differential Equations and Backward Linear Quadratic Stochastic Optimal Control Problem

In this paper, we use the solutions of forward-backward stochastic differential equations to get the optimal control for backward stochastic linear quadratic optimal control problem. And we also give the linear feedback regulator for the optimal control problem by using the solutions of a group of Riccati equations.

A Mean-Field Stochastic Maximum Principle for Optimal Control of Forward-Backward Stochastic Differential Equations with Jumps via Malliavin Calculus

This paper considers a mean-field type stochastic control problem where the dynamics is governed by a forward and backward stochastic differential equation (SDE) driven by Lévy processes and the information available to the controller is possibly less than the overall information. All the system coefficients and the objective performance functional are allowed to be random, possibly non-Markovian. Malliavin calculus is employed to derive a maximum principle for the optimal control of such a system where the adjoint process is explicitly expressed.

A CLASS OF STATIONARY MODELS OF SINGULAR STOCHASTIC CONTROL

A class of stationary models of singular stochastic control has been studied, in which the state is extended to solution of a class of S.D.E. from Wiener process. The existence of optimal control has been proved in all cases under some weaker conditions, and the structure of optimal control may be characterized.

Iterative Learning Control for Discrete-time Stochastic Systems with Quantized Information

An iterative learning control(ILC) algorithm using quantized error information is given in this paper for both linear and nonlinear discrete-time systems with stochastic noises. A logarithmic quantizer is used to guarantee an adaptive improvement in tracking performance. A decreasing learning gain is introduced into the algorithm to suppress the effects of stochastic noises and quantization errors. The input sequence is proved to converge strictly to the optimal input under the given index. Illustrative simulations are given to verify the theoretical analysis.

A NEW STOCHASTIC OPTIMAL CONTROL STRATEGY FOR HYSTERETIC MR DAMPERS

A new stochastic optimal control strategy for randomly excited quasi-integrable Hamiltonian systems using magneto-rheological (MR) dampers is proposed. The dynamic be- havior of an MR damper is characterized by the Bouc-Wen hysteretic model. The control force produced by the MR damper is separated into a passive part incorporated in the uncontrolled system and a semi-active part to be determined. The system combining the Bouc-Wen hysteretic force is converted into an equivalent non-hysteretic nonlinear stochastic control system. Then It?o stochastic di?erential equations are derived from the equivalent system by using the stochastic averaging method. A dynamical programming equation for the controlled di?usion processes is established based on the stochastic dynamical programming principle. The non-clipping nonlin- ear optimal control law is obtained for a certain performance index by minimizing the dynamical programming equation. Finally, an example is given to illustrate the application and e?ectiveness of the proposed control strategy.

Fault tolerant control based on stochastic distribution via RBF neural networks

A new fault tolerant control（FTC） via a controller reconfiguration approach for general stochastic nonlinear systems is studied.Different from the formulation of classical FTC methods,it is supposed that the measured information for the FTC is the probability density functions（PDFs） of the system output rather than its measured value.A radial basis functions（RBFs） neural network technique is proposed so that the output PDFs can be formulated in terms of the dynamic weighings of the RBFs neural network.As a result,the nonlinear FTC problem subject to dynamic relation between the input and the output PDFs can be transformed into a nonlinear FTC problem subject to dynamic relation between the control input and the weights of the RBFs neural network approximation to the output PDFs.The FTC design consists of two steps.The first step is fault detection and diagnosis（FDD）,which can produce an alarm when there is a fault in the system and also locate which component has a fault.The second step is to adapt the controller to the faulty case so that the system is able to achieve its target.A linear matrix inequality（LMI） based feasible FTC method is applied such that the fault can be detected and diagnosed.An illustrated example is included to demonstrate the efficiency of the proposed algorithm,and satisfactory results have been obtained.

Robust H_∞ control for neutral stochastic uncertain systems with time-varying delay

The problem of robust H_∞ control for uncertain neutral stochastic systems with time-varying delay is discussed.The parameter uncertaintie is assumed to be time varying norm-bounded.First,the stochastic robust stabilization of the stochastic system without disturbance input is investigated by nonlinear matrix inequality method.Then,a full-order stochastic dynamic output feedback controller is designed by solving a bilinear matrix inequality（BMI）,which ensures a prescribed stochastic robust H_∞ performance level for the resulting closed-loop system with nonzero disturbance input and for all admissible uncertainties.An illustrative example is provided to show the feasibility of the controller and the potential of the proposed technique.

Impulsive control of stochastic system under the sense of stochastic asymptotical stability

This paper studies the stochastic asymptotical stability of stochastic impulsive differential equations, and establishes a comparison theory to ensure the trivial solution＇s stochastic asymptotical stability. From the comparison theory, it can find out whether the stochastic impulsive differential system is stable just by studying the stability of a deterministic comparison system. As a general application of this theory, it controls the chaos of stochastic Lii system using impulsive control method, and numerical simulations are employed to verify the feasibility of this method.

STOCHASTIC OPTIMAL CONTROL OF HYSTERETIC SYSTEMS UNDER EXTERNALLY AND PARAMETRICALLY RANDOM EXCITATIONS

A stochastic optimal control method for nonlinear hysteretic systems under externally and/or parametrically random excitations is presented and illustrated with an example of hysteretic column system. A hysteretic system subject to random excitation is first replaced by a nonlinear non-hysteretic stochastic system. An It$\hat {\rm o}$ stochastic differential equation for the total energy of the system as a one-dimensional controlled diffusion process is derived by using the stochastic averaging method of energy envelope. A dynamical programming equation is then established based on the stochastic dynamical programming principle and solved to yield the optimal control force. Finally, the responses of uncontrolled and controlled systems are evaluated to determine the control efficacy. It is shown by numerical results that the proposed stochastic optimal control method is more effective and efficient than other optimal control methods.

EXISTENCE OF SOLUTION AND APPROXIMATE CONTROLLABILITY OF A SECOND-ORDER NEUTRAL STOCHASTIC DIFFERENTIAL EQUATION WITH STATE DEPENDENT DELAY

This paper has two sections which deals with a second order stochastic neutral partial differential equation with state dependent delay. In the first section the existence and uniqueness of mild solution is obtained by use of measure of non-compactness. In the second section the conditions for approximate controllability are investigated for the distributed second order neutral stochastic differential system with respect to the approximate controllability of the corresponding linear system in a Hilbert space. Our method is an extension of co-author N. Sukavanam’s novel approach in [22]. Thereby, we remove the need to assume the invertibility of a controllability operator used by authors in [5], which fails to exist in infinite dimensional spaces if the associated semigroup is compact. Our approach also removes the need to check the invertibility of the controllability Gramian operator and associated limit condition used by the authors in [20], which are practically difficult to verify and apply. An example is provided to illustrate the presented theory.

Optimal control strategies for stochastically excited quasi partially integrable Hamiltonian systems

In this paper two different control strategies designed to alleviate the response of quasi partially integrable Hamiltonian systems subjected to stochastic excitation are proposed. First, by using the stochastic averaging method for quasi partially integrable Hamiltonian systems, an n-DOF controlled quasi partially integrable Hamiltonian system with stochastic excitation is converted into a set of partially averaged It^↑o stochastic differential equations. Then, the dynamical programming equation associated with the partially averaged It^↑o equations is formulated by applying the stochastic dynamical programming principle. In the first control strategy, the optimal control law is derived from the dynamical programming equation and the control constraints without solving the dynamical programming equation. In the second control strategy, the optimal control law is obtained by solving the dynamical programming equation. Finally, both the responses of controlled and uncontrolled systems are predicted through solving the Fokker-Plank-Kolmogorov equation associated with fully averaged It^↑o equations. An example is worked out to illustrate the application and effectiveness of the two proposed control strategies.