Optimal Control of Nonlinear Systems Using Experience Inference Human-Behavior Learning

Safety critical control is often trained in a simulated environment to mitigate risk.Subsequent migration of the biased controller requires further adjustments.In this paper,an experience inference human-behavior learning is proposed to solve the migration problem of optimal controllers applied to real-world nonlinear systems.The approach is inspired in the complementary properties that exhibits the hippocampus,the neocortex,and the striatum learning systems located in the brain.The hippocampus defines a physics informed reference model of the realworld nonlinear system for experience inference and the neocortex is the adaptive dynamic programming(ADP)or reinforcement learning(RL)algorithm that ensures optimal performance of the reference model.This optimal performance is inferred to the real-world nonlinear system by means of an adaptive neocortex/striatum control policy that forces the nonlinear system to behave as the reference model.Stability and convergence of the proposed approach is analyzed using Lyapunov stability theory.Simulation studies are carried out to verify the approach.

Numerical Solution of a Class of Nonlinear Optimal Control Problems Using Linearization and Discretization

In this paper, a new approach using linear combination property of intervals and discretization is proposed to solve a class of nonlinear optimal control problems, containing a nonlinear system and linear functional, in three phases. In the first phase, using linear combination property of intervals, changes nonlinear system to an equivalent linear system, in the second phase, using discretization method, the attained problem is converted to a linear programming problem, and in the third phase, the latter problem will be solved by linear programming methods. In addition, efficiency of our approach is confirmed by some numerical examples.

Feedback Linearization Optimal Control Approach for Bilinear Systems in CSTR Chemical Reactor

This paper considers the optimal control problem for the bilinear system based on state feedback. Based on the concept of relative order of the output with respect to the input, first we change a bilinear system to a pseudo linear system model through the coordinate transformation. Then based on the theory of linear quadratic optimal control, the optimal controller is designed by solving the Riccati equation and introducing state feedback with state prediction. At last, the simulation results in CSTR Chemical reactor show the effectiveness of the method.

Parametric variational solution of linear-quadratic optimal control problems with control inequality constraints

A parametric variational principle and the corresponding numerical algo- rithm are proposed to solve a linear-quadratic （LQ） optimal control problem with control inequality constraints. Based on the parametric variational principle, this control prob- lem is transformed into a set of Hamiltonian canonical equations coupled with the linear complementarity equations, which are solved by a linear complementarity solver in the discrete-time domain. The costate variable information is also evaluated by the proposed method. The parametric variational algorithm proposed in this paper is suitable for both time-invariant and time-varying systems. Two numerical examples are used to test the validity of the proposed method. The proposed algorithm is used to astrodynamics to solve a practical optimal control problem for rendezvousing spacecrafts with a finite low thrust. The numerical simulations show that the parametric variational algorithm is ef- fective for LQ optimal control problems with control inequality constraints.

Feedforward and feedback optimal control for linear time-varying systems with persistent disturbances

The optimal control problem was studied for linear time-varying systems,which was affected by external persistent disturbances with known dynamic characteristics but unknown initial conditions. To damp the effect of disturbances in an optimal fashion,we obtained a new feedforward and feedback optimal control law and gave the control algorithm by solving a Riccati differential equation and a matrix differential equation. Simulation results showed that the achieved optimal control law was realizable,efficient and robust to reject the external disturbances.

Global Optimization for Solving Linear Non-Quadratic Optimal Control Problems

This paper presents a global optimization approach to solving linear non-quadratic optimal control problems. The main work is to construct a differential flow for finding a global minimizer of the Hamiltonian function over a Euclid space. With the Pontryagin principle, the optimal control is characterized by a function of the adjoint variable and is obtained by solving a Hamiltonian differential boundary value problem. For computing an optimal control, an algorithm for numerical practice is given with the description of an example.

Nonlinear Control of Induction Motor： A Combination of Nonlinear Observer Design and Input-Output Linearization Technique

This paper deals with a nonlinear control strategy of induction motor that combines an input-output linearization control technique and a nonlinear observer design. It is well known that induction motors are the most widely used motors in electrical appliances, industrial control and automation. However, it is also known that induction motor control is a complex task that is due to its nonlinear characteristics. Two main features of the proposed approach are worth to be mentioned. Firstly, a nonlinear control is carried out using a nonlinear feedback linearization technique involving non available state variable measurements of the induction motor system. Secondly, a nonlinear observer is designed to estimate these pertinent but unmeasurable state variables of the machine. The circle-criterion approach is performed to compute the observer gain matrices as a solution of LMI （linear matrix inequalities） that ensure the stability conditions, in the sense of Lyapunov, of the estimated state error dynamics of the designed observer. Simulation results are presented to validate the effectiveness of the proposed approach.

Least Squares Solution for Discrete Time Nonlinear Stochastic Optimal Control Problem with Model-Reality Differences

In this paper, an efficient computational approach is proposed to solve the discrete time nonlinear stochastic optimal control problem. For this purpose, a linear quadratic regulator model, which is a linear dynamical system with the quadratic criterion cost function, is employed. In our approach, the model-based optimal control problem is reformulated into the input-output equations. In this way, the Hankel matrix and the observability matrix are constructed. Further, the sum squares of output error is defined. In these point of views, the least squares optimization problem is introduced, so as the differences between the real output and the model output could be calculated. Applying the first-order derivative to the sum squares of output error, the necessary condition is then derived. After some algebraic manipulations, the optimal control law is produced. By substituting this control policy into the input-output equations, the model output is updated iteratively. For illustration, an example of the direct current and alternating current converter problem is studied. As a result, the model output trajectory of the least squares solution is close to the real output with the smallest sum squares of output error. In conclusion, the efficiency and the accuracy of the approach proposed are highly presented.

Linear optimal control of transient growth in turbulent channel flows

The suppression of linear transient growth in turbulent channel flows via linear optimal controls is investigated. The control algorithms are the LQR control based on full information of flow fields and the LQG control based on the information measured at walls. The influence of these controls on the development of small-scale and large-scale perturbations are considered respectively. It is found that the energy amplification of large-scale perturbations is suppressed significantly by both LQR and LQG control, while small-scale perturbations can be only affect by LQR control. Effects of the weighting parameters and control price on the control performance of both controls are analysed. It turns out that the different weighting parameters in cost function do not qualitatively change the evalution of control performance. As control price raises, the effectiveness of both controls decreases distinctly. For small-scale perturbations, the upper limit of the effective range of control price is lower than that for large-scale perturbations. As Reynolds number increases, it indicates that both LQR and LQG control get more effective on suppressing the energy amplification of large-scale perturbations.

Existence and Uniqueness of the Optimal Control in Hilbert Spaces for a Class of Linear Systems

We analyze the existence and uniqueness of the optimal control for a class of exactly controllable linear systems. We are interested in the minimization of time, energy and final manifold in transfer problems. The state variables space X and, respectively, the control variables space U, are considered to be Hilbert spaces. The linear operator T(t) which defines the solution of the linear control system is a strong semigroup. Our analysis is based on some results from the theory of linear operators and functional analysis. The results obtained in this paper are based on the properties of linear operators and on some theorems from functional analysis.

Optimal Control for Time-Delay Bilinear Systems with Sinusoidal Disturbances

This paper considers the optimal control problem for time-delay bilinear systems affected by sinusoidal disturbances with known frequency and measurable amplitude and phase. Firstly, using the differential homeomorphism, a time-delay bilinear system affected by sinusoidal disturbances is changed to a time-delay pseudo linear system through the coordinate transformation. Then the system with time-delay in control variable is transformed to a linear controllable system without delay using model transformation. At last based on the theory of linear quadratic optimal control, an optimal control law which is used to eliminate the influence of the disturbances is derived from a Riccati equation and Matrix equations. The simulation results show the effectiveness of the method.

Application of Linear Model Predictive Control and Input-Output Linearization to Constrained Control of 3D Cable Robots

Cable robots are structurally the same as parallel robots but with the basic difference that cables can only pull the platform and cannot push it. This feature makes control of cable robots a lot more challenging compared to parallel robots. This paper introduces a controller for cable robots under force constraint. The controller is based on input-output linearization and linear model predictive control. Performance of input-output linearizing (IOL) controllers suffers due to constraints on input and output variables. This problem is successfully tackled by augmenting IOL controllers with linear model predictive controller (LMPC). The effecttiveness of the proposed method is illustrated by numerical simulation.

Indefinite Linear Quadratic Optimal Control Problem for Singular Linear Discrete-time System: Krein Space Method

有限时间地平线不定线性二次(LQ ) 为单个线性分离变化时间的系统的最佳的控制问题被讨论。为单个系统的不定的 LQ 最佳的控制问题能在一个合理假设下面为标准州空间的系统被转变到那。不定的 LQ 最佳的控制问题对为向后的随机的系统的设计的双，这被显示出。因此，最佳的 LQ 控制器能被计算 Kalman 过滤器的获得矩阵获得。为不定的 LQ 问题保证一个唯一的答案的必要、足够的条件被给。这个问题的一个明确的解决方案以 Riccati 差别方程的答案被获得。

Domain Decomposition of an Optimal Control Problem for Semi-Linear Elliptic Equations on Metric Graphs with Application to Gas Networks

We consider optimal control problems for the flow of gas in a pipe network. The equations of motions are taken to be represented by a semi-linear model derived from the fully nonlinear isothermal Euler gas equations. We formulate an optimal control problem on a given network and introduce a time discretization thereof. We then study the well-posedness of the corresponding time-discrete optimal control problem. In order to further reduce the complexity, we consider an instantaneous control strategy. The main part of the paper is concerned with a non-overlapping domain decomposition of the semi-linear elliptic optimal control problem on the graph into local problems on a small part of the network, ultimately on a single edge.

Linear Quadratic Optimal Control for Systems Governed by First-Order Hyperbolic Partial Differential Equations

This paper focuses on linear-quadratic(LQ)optimal control for a class of systems governed by first-order hyperbolic partial differential equations(PDEs).Different from most of the previous works,an approach of discretization-then-continuousization is proposed in this paper to cope with the infinite-dimensional nature of PDE systems.The contributions of this paper consist of the following aspects:(1)The differential Riccati equations and the solvability condition of the LQ optimal control problems are obtained via the discretization-then-continuousization method.(2)A numerical calculation way of the differential Riccati equations and a practical design way of the optimal controller are proposed.Meanwhile,the relationship between the optimal costate and the optimal state is established by solving a set of forward and backward partial difference equations(FBPDEs).(3)The correctness of the method used in this paper is verified by a complementary continuous method and the comparative analysis with the existing operator results is presented.It is shown that the proposed results not only contain the classic results of the standard LQ control problem of systems governed by ordinary differential equations as a special case,but also support the existing operator results and give a more convenient form of computation.

Optimal Control of Reinforced Plate Based on the Minimum Energy

An optimal control method based on the minimum energy of the vibration system is proposed for piezoelectric damping control of the reinforced aircraft plate.Subsequently,the dynamic equations of the piezoelectric damping reinforced plate system and the state space equations are derived.The method to determine the weight matrix of the system is presented based on the minimum energy of the vibration system.In order to obtain the optimal controller,the control parameters of the feedback controller are obtained by using the optimal method.A piezoelectric vibration optimal control experiment platform is designed to control the vibration of reinforced aircraft plate.The experimental results show that the method has good control performances.

Fuzzy Optimal Control Design for Ship Steering

This paper presents a method to design a control scheme for nonlinear systems using fuzzy optimal control.In the design process,the nonlinear system is first converted into local subsystems using sector non linearity approach of Takagi Sugeno(T S)fuzzy modeling.For each local subsystem,an optimal control is designed.Then,the parameters of local controllers are defuzzified to construct a global optimal controller.To prove the effectiveness of this control scheme,simulations are performed using the mathematical model of Esso Osaka tanker ship for set point regulation with and without disturbance and reference tracking.In addition,the simulation results are compared with that of a PID controller for further verification and validation.It has been shown that the proposed optimal controller can be used for the nonlinear ship steering with good rise time,zero steady state error and fast settling time.

TIME AND NORM OPTIMAL CONTROLS:A SURVEY OF RECENT RESULTS AND OPEN PROBLEMS

We present in this paper a survey of recent results on the relation between time and norm optimality for linear systems and the infinite dimensional version of Pontryagin＇s maximum principle. In particular, we discuss optimality （or nonoptimality） of singular controls satisfying the maximum principle and smoothness of the costate in function of smoothness of the target.

A New Approach for a Class of Optimal Control Problems of Volterra Integral Equations

In this paper, we propose a new approach for a class of optimal control problems governed by Volterra integral equations which is based on linear combination property of intervals. We convert the nonlinear terms in constraints of problem to the corresponding linear terms. Discretization method is also applied to convert the new problems to the discrete-time problem. In addition, some numerical examples are presented to illustrate the effectiveness of the proposed approach.

Optimal Control of Unknown Discrete-Time Linear Systems with Additive Noise

The optimal control problem with a long run average cost is investigated for unknown linear discrete-time systems with additive noise.The authors propose a value iteration-based stochastic adaptive dynamic programming(VI-based SADP)algorithm,based on which the optimal controller is obtained.Different from the existing relevant work,the algorithm does not need to estimate the expectation(conditional expectation)and variance(conditional variance)of states or other relevant variables,and the convergence of the algorithm can be proved rigorously.A simulation example is given to verify the effectiveness of the proposed approach.