Adaptive Linear Quadratic Regulator for Continuous-Time Systems With Uncertain Dynamics

In this paper, adaptive linear quadratic regulator(LQR) is proposed for continuous-time systems with uncertain dynamics. The dynamic state-feedback controller uses inputoutput data along the system trajectory to continuously adapt and converge to the optimal controller. The result differs from previous results in that the adaptive optimal controller is designed without the knowledge of the system dynamics and an initial stabilizing policy. Further, the controller is updated continuously using input-output data, as opposed to the commonly used switched/intermittent updates which can potentially lead to stability issues. An online state derivative estimator facilitates the design of a model-free controller. Gradient-based update laws are developed for online estimation of the optimal gain. Uniform exponential stability of the closed-loop system is established using the Lyapunov-based analysis, and a simulation example is provided to validate the theoretical contribution.

Tracking Control of Uncertain Nonlinear Systems With Unknown Constant Input Delay

A robust delay compensator has been developed for a class of uncertain nonlinear systems with an unknown constant input delay.The control law consists of feedback terms based on the integral of past control values and a novel filtered tracking error,capable of compensating for input delays.Suitable Lyapunov-Krasovskii functionals are used to prove global uniformly ultimately bounded(GUUB)tracking,provided certain sufficient gain conditions,dependent on the bound of the delay,are satisfied.Simulation results illustrate the performance and robustness of the controller for different values of input delay.

Asymptotic tracking by a reinforcement learning-based adaptive critic controller

Adaptive critic(AC) based controllers are typically discrete and/or yield a uniformly ultimately bounded stability result because of the presence of disturbances and unknown approximation errors.A continuous-time AC controller is developed that yields asymptotic tracking of a class of uncertain nonlinear systems with bounded disturbances.The proposed AC-based controller consists of two neural networks(NNs)-an action NN,also called the actor,which approximates the plant dynamics and generates appropriate control actions;and a critic NN,which evaluates the performance of the actor based on some performance index.The reinforcement signal from the critic is used to develop a composite weight tuning law for the action NN based on Lyapunov stability analysis.A recently developed robust feedback technique,robust integral of the sign of the error(RISE),is used in conjunction with the feedforward action neural network to yield a semiglobal asymptotic result.Experimental results are provided that illustrate the performance of the developed controller.