Linear Quadratic Optimal Control for Systems Governed by First-Order Hyperbolic Partial Differential Equations

This paper focuses on linear-quadratic(LQ)optimal control for a class of systems governed by first-order hyperbolic partial differential equations(PDEs).Different from most of the previous works,an approach of discretization-then-continuousization is proposed in this paper to cope with the infinite-dimensional nature of PDE systems.The contributions of this paper consist of the following aspects:(1)The differential Riccati equations and the solvability condition of the LQ optimal control problems are obtained via the discretization-then-continuousization method.(2)A numerical calculation way of the differential Riccati equations and a practical design way of the optimal controller are proposed.Meanwhile,the relationship between the optimal costate and the optimal state is established by solving a set of forward and backward partial difference equations(FBPDEs).(3)The correctness of the method used in this paper is verified by a complementary continuous method and the comparative analysis with the existing operator results is presented.It is shown that the proposed results not only contain the classic results of the standard LQ control problem of systems governed by ordinary differential equations as a special case,but also support the existing operator results and give a more convenient form of computation.

STOCHASTIC DIFFERENTIAL EQUATIONS AND STOCHASTIC LINEAR QUADRATIC OPTIMAL CONTROL PROBLEM WITH LEVY PROCESSES

In this paper, tile authors first study two kinds of stochastic differential equations （SDEs） with Levy processes as noise source. Based on the existence and uniqueness of the solutions of these SDEs and multi-dimensional backward stochastic differential equations （BSDEs） driven by Levy pro- cesses, the authors proceed to study a stochastic linear quadratic （LQ） optimal control problem with a Levy process, where the cost weighting matrices of the state and control are allowed to be indefinite. One kind of new stochastic Riccati equation that involves equality and inequality constraints is derived from the idea of square completion and its solvability is proved to be sufficient for the well-posedness and the existence of optimal control which can be of either state feedback or open-loop form of the LQ problems. Moreover, the authors obtain the existence and uniqueness of the solution to the Riccati equation for some special cases. Finally, two examples are presented to illustrate these theoretical results.

Fully Coupled Forward-Backward Stochastic Functional Differential Equations and Applications to Quadratic Optimal Control

This paper considers the fully coupled forward-backward stochastic functional differential equations(FBSFDEs) with stochastic functional differential equations as the forward equations and the generalized anticipated backward stochastic differential equations as the backward equations. The authors will prove the existence and uniqueness theorem for FBSFDEs. As an application, we deal with a quadratic optimal control problem for functional stochastic systems, and get the explicit form of the optimal control by virtue of FBSFDEs.

Linear quadratic optimal control of conditional McKean-Vlasov equation with random coefficients and applications

We consider the optimal control problem for a linear conditional McKeanVlasov equation with quadratic cost functional.The coefficients of the system and the weighting matrices in the cost functional are allowed to be adapted processes with respect to the common noise filtration.Semi closed-loop strategies are introduced,and following the dynamic programming approach in(Pham and Wei,Dynamic programming for optimal control of stochastic McKean-Vlasov dynamics,2016),we solve the problem and characterize time-consistent optimal control by means of a system of decoupled backward stochastic Riccati differential equations.We present several financial applications with explicit solutions,and revisit,in particular,optimal tracking problems with price impact,and the conditional mean-variance portfolio selection in an incomplete market model.

Mean-field stochastic linear quadratic optimal control problems: closed-loop solvability

An optimal control problem is studied for a linear mean-field stochastic differential equation with a quadratic cost functional.The coefficients and the weighting matrices in the cost functional are all assumed to be deterministic.Closedloop strategies are introduced,which require to be independent of initial states;and such a nature makes it very useful and convenient in applications.In this paper,the existence of an optimal closed-loop strategy for the system(also called the closedloop solvability of the problem)is characterized by the existence of a regular solution to the coupled two(generalized)Riccati equations,together with some constraints on the adapted solution to a linear backward stochastic differential equation and a linear terminal value problem of an ordinary differential equation.

A Posteriori Error Estimates of Mixed Methods for Quadratic Optimal Control Problems Governed by Parabolic Equations

In this paper,we discuss the a posteriori error estimates of the mixed finite element method for quadratic optimal control problems governed by linear parabolic equations.The state and the co-state are discretized by the high order Raviart-Thomas mixed finite element spaces and the control is approximated by piecewise constant functions.We derive a posteriori error estimates for both the state and the control approximation.Such estimates,which are apparently not available in the literature,are an important step towards developing reliable adaptive mixed finite element approximation schemes for the control problem.

Linear quadratic optimal controller for cable-driven parallel robots

In recent years, various cable-driven parallel robots have been investigated for their advantages, such as low structural weight, high acceleration, and large work- space, over serial and conventional parallel systems. However, the use of cables lowers the stiffness of these robots, which in turn may decrease motion accuracy. A linear quadratic （LQ） optimal controller can provide all the states of a system for the feedback, such as position and velocity. Thus, the application of such an optimal controller in cable-driven parallel robots can result in more efficient and accurate motion compared to the performance of classical controllers such as the proportional-integral-derivative controller. This paper presents an approach to apply the LQ optimal controller on cabledriven parallel robots. To employ the optimal control theory, the static and dynamic modeling of a 3-DOF planar cable-driven parallel robot （Feriba-3） is developed. The synthesis of the LQ optimal control is described, and the significant experimental results are presented and discussed.

Optimal Decoupling Control Method and Its Application to a Ball Mill Coal-pulverizing System

Abstract-The conventional optimal tracking control method cannot realize decoupling control of linear systems with a strong coupling property. To solve this problem, in this paper, an optimal decoupling control method is proposed, which can simultaneousiy provide optimal performance. The optimal decoupling controller is composed of an inner-loop decoupling controller and an outer-loop optimal tracking controller. First, by introducing one virtual control variable, the original differential equation on state is converted to a generalized system on output. Then, by introducing the other virtual control variable, and viewing the coupling terms as the measurable disturbances, the generalized system is open-loop decoupled. Finally, for the decoupled system, the optimal tracking control method is used. It is proved that the decoupling control is optimal for a certain performance index. Simulations on a ball mill coal-pulverizing system are conducted. The results show the effectiveness and superiority of the proposed method as compared with the conventional optimal quadratic tracking （LQT） control method.

Superconvergence analysis of fully discrete finite element methods for semilinear parabolic optimal control problems

We study the superconvergence property of fully discrete finite element approximation for quadratic optimal control problems governed by semilinear parabolic equations with control constraints. The time discretization is based on difference methods, whereas the space discretization is done using finite element methods. The state and the adjoint state are approximated by piecewise linear functions and the control is approximated by piecewise constant functions. First, we define a fully discrete finite element approximation scheme for the semilinear parabolic control problem. Second, we derive the superconvergence properties for the control, the state and the adjoint state. Finally, we do some numerical experiments for illustrating our theoretical results.

Application of the hybrid genetic particle swarm algorithm to design the linear quadratic regulator controller for the accelerator power supply

Purpose The purpose of this paper is to study a new method to improve the performance of the magnet power supply in the experimental ring of HIRFL-CSR.Methods A hybrid genetic particle swarm optimization algorithm is introduced,and the algorithm is applied to the optimal design of the LQR controller of pulse width modulated power supply.The fitness function of hybrid genetic particle swarm optimization is a multi-objective function,which combined the current and voltage,so that the dynamic performance of the closed-loop system can be better.The hybrid genetic particle swarm algorithm is applied to determine LQR controlling matrices Q and R.Results The simulation results show that adoption of this method leads to good transient responses,and the computational time is shorter than in the traditional trial and error methods.Conclusions The results presented in this paper show that the proposed method is robust,efficient and feasible,and the dynamic and static performance of the accelerator PWM power supply has been considerably improved.

Linear quadratic stochastic integral games and related topics

This paper studies linear quadratic games problem for stochastic Volterra integral equations(SVIEs in short) where necessary and sufficient conditions for the existence of saddle points are derived in two different ways.As a consequence,the open problems raised by Chen and Yong(2007) are solved.To characterize the saddle points more clearly,coupled forward-backward stochastic Volterra integral equations and stochastic Fredholm-Volterra integral equations are introduced.Compared with deterministic game problems,some new terms arising from the procedure of deriving the later equations reflect well the essential nature of stochastic systems.Moreover,our representations and arguments are even new in the classical SDEs case.

TWO KINDS OF HARMONIC PROBLEMS IN CONTROL SYSTEMS

This paper discusses the harmonic problems in control systems from two aspects:Oneis the harmonic control among different subsystems,and the other is the harmonic control amongmultiple inputs.Some intrinsic problems in such systems are discussed.It is pointed out that somesubsystems must be unstable to stabilize the whole interconnected system by an example.Especiallyfor discrete-time multi-input systems,a necessary and sufficient condition is presented for the strictdecrease of the quadratic optimal performance index with the control input extensions.This showsan essential difference between single-input and multi-input control systems.Finally,some futureresearch directions are discussed in harmonic control of interconnected systems,allocation of multi-control inputs,fault-tolerant control,and fault-diagnosis.

Stochastic H_2/H_∞ Control with Random Coefcients

Abstract This paper is concerned with the mixed H2/H∞ control for stochastic systems with random coefficients, which is actually a control combining the H2 optimization with the H∞ robust performance as the name of H2/H∞ reveals. Based on the classical theory of linear-quadratic （LQ, for short） optimal control, the sufficient and necessary conditions for the existence and uniqueness of the solution to the indefinite backward stochastic Riccati equation （BSRE, for short） associated with H∞ robustness are derived. Then the sufficient and necessary conditions for the existence of the H2/H∞ control are given utilizing a pair of coupled stochastic Pdccati equations.

Real-time optimization power-split strategy for hybrid electric vehicles

Energy management strategies based on optimal control theory can achieve minimum fuel consumption for hybrid electric vehicles, but the requirement for driving cycles known in prior leads to a real-time problem. A real-time optimization power-split strategy is proposed based on linear quadratic optimal control. The battery state of charge sustainability and fuel economy are ensured by designing a quadratic performance index combined with two rules. The engine power and motor power of this strategy are calculated in real-time based on current system state and command, and not related to future driving conditions. The simulation results in ADVISOR demonstrate that, under the conditions of various driving cycles, road slopes and vehicle parameters, the proposed strategy significantly improves fuel economy, which is very close to that of the optimal control based on Pontryagin's minimum principle, and greatly reduces computation complexity.