Using Lyapunov function to design optimal controller for AQM routers

It was shown that active queue management schemes implemented in the routers of communication networks sup-porting transmission control protocol (TCP) flows can be modelled as a feedback control system. In this paper based on Lyapunov function we developed an optimal controller to improve active queue management (AQM) router’s stability and response time, which are often in conflict with each other in system performance. Ns-2 simulations showed that optimal controller outperforms PI controller significantly.

SEIR Mathematical Model for Influenza-Corona Co-Infection with Treatment and Hospitalization Compartments and Optimal Control Strategies

The co-infection of corona and influenza viruses has emerged as a significant threat to global public health due to their shared modes of transmission and overlapping clinical symptoms.This article presents a novel mathematical model that addresses the dynamics of this co-infection by extending the SEIR(Susceptible-Exposed-Infectious-Recovered)framework to incorporate treatment and hospitalization compartments.The population is divided into eight compartments,with infectious individuals further categorized into influenza infectious,corona infectious,and co-infection cases.The proposed mathematical model is constrained to adhere to fundamental epidemiological properties,such as non-negativity and boundedness within a feasible region.Additionally,the model is demonstrated to be well-posed with a unique solution.Equilibrium points,including the disease-free and endemic equilibria,are identified,and various properties related to these equilibrium points,such as the basic reproduction number,are determined.Local and global sensitivity analyses are performed to identify the parameters that highly influence disease dynamics and the reproduction number.Knowing the most influential parameters is crucial for understanding their impact on the co-infection’s spread and severity.Furthermore,an optimal control problem is defined to minimize disease transmission and to control strategy costs.The purpose of our study is to identify the most effective(optimal)control strategies for mitigating the spread of the co-infection with minimum cost of the controls.The results illustrate the effectiveness of the implemented control strategies in managing the co-infection’s impact on the population’s health.This mathematical modeling and control strategy framework provides valuable tools for understanding and combating the dual threat of corona and influenza co-infection,helping public health authorities and policymakers make informed decisions in the face of these intertwined epidemics.

On the Optimal Controller for LTV Measurement Feedback Control Problem

In this paper,we consider the measurement feedback control problem for discrete linear time-varying systems within the framework of nest algebra consisting of causal and bounded linear operators.Based on the inner-outer factorization of operators,we reduce the control problem to a distance from a certain operator to a special subspace of a nest algebra and show the existence of the optimal LTV controller in two different ways：one via the characteristic of the subspace in question directly,the other via the duality theory.The latter also gives a new formula for computing the optimal cost.

Distributed Design of Approximately Optimal Controller for Identical Discrete-Time Multi-Agent Systems

This paper considers the distributed control of the LQR problem for discrete-time multiagent systems.Distributed controllers are designed based on the solutions of centralized optimal control and the topological structure of the systems.Under mild conditions,it is shown that the distributed controller can approximate to the centralized optimal controller.Then the states of the closed-loop systems of the distributed control exponentially converge to the states of the closed-loop systems of the centralized optimal control.Some examples are given to show effectiveness of the proposed results.

Optimal Tracking Controller Design for a Small Scale Helicopter

A model helicopter is more difficult to control than its full scale counterpart. This is due to its greater sensitivity to control inputs and disturbances as well as higher bandwidth of dynamics. This work is focused on designing practical tracking controller for a small scale helicopter following predefined trajectories. A tracking controller based on optimal control theory is synthesized as a part of the development of an autonomous helicopter. Some issues with regards to control constraints are addressed. The weighting between state tracking performance and control power expenditure is analyzed. Overall performance of the control design is evaluated based on its time domain histories of trajectories as well as control inputs.

Randomized Algorithms for Probabilistic Optimal Robust Performance Controller Design

Polynomial-time randomized algorithms were constructed to approximately solve optimal robust performance controller design problems in probabilistic sense and the rigorous mathematical justification of the approach was given. The randomized algorithms here were based on a property from statistical learning theory known as (uniform) convergence of empirical means (UCEM). It is argued that in order to assess the performance of a controller as the plant varies over a pre-specified family, it is better to use the average performance of the controller as the objective function to be optimized, rather than its worst-case performance. The approach is illustrated to be efficient through an example.

AN OPTIMAL CONTROL PROBLEM FOR A LOTKA-VOLTERRA COMPETITION MODEL WITH CHEMO-REPULSION

In this paper we study a bilinear optimal control problem for a diffusive Lotka-Volterra competition model with chemo-repulsion in a bounded domain of ℝ^(ℕ),N=2,3.This model describes the competition of two species in which one of them avoid encounters with rivals through a chemo-repulsion mechanism.We prove the existence and uniqueness of weak-strong solutions,and then we analyze the existence of a global optimal solution for a related bilinear optimal control problem,where the control is acting on the chemical signal.Posteriorly,we derive first-order optimality conditions for local optimal solutions using the Lagrange multipliers theory.Finally,we propose a discrete approximation scheme of the optimality system based on the gradient method,which is validated with some computational experiments.

Fuzzy controller based on chaos optimal design and its application

In order to overcome difficulty of tuning parameters of fuzzy controller, a chaos optimal design method based on annealing strategy is proposed. First, apply the chaotic variables to search for parameters of fuzzy contro-(ller,) and transform the optimal variables into chaotic variables by carrier-wave method. Making use of the intrinsic stochastic property and ergodicity of chaos movement to escape from the local minimum and direct optimization searching within global range, an approximate global optimal solution is obtained. Then, the chaos local searching and optimization based on annealing strategy are cited, the parameters are optimized again within the limits of the approximate global optimal solution, the optimization is realized by means of combination of global and partial chaos searching, which can converge quickly to global optimal value. Finally, the third order system and discrete nonlinear system are simulated and compared with traditional method of fuzzy control. The results show that the new chaos optimal design method is superior to fuzzy control method, and that the control results are of high precision, with no overshoot and fast response.

Linear quadratic optimal controller for cable-driven parallel robots

In recent years, various cable-driven parallel robots have been investigated for their advantages, such as low structural weight, high acceleration, and large work- space, over serial and conventional parallel systems. However, the use of cables lowers the stiffness of these robots, which in turn may decrease motion accuracy. A linear quadratic （LQ） optimal controller can provide all the states of a system for the feedback, such as position and velocity. Thus, the application of such an optimal controller in cable-driven parallel robots can result in more efficient and accurate motion compared to the performance of classical controllers such as the proportional-integral-derivative controller. This paper presents an approach to apply the LQ optimal controller on cabledriven parallel robots. To employ the optimal control theory, the static and dynamic modeling of a 3-DOF planar cable-driven parallel robot （Feriba-3） is developed. The synthesis of the LQ optimal control is described, and the significant experimental results are presented and discussed.

Optimal Control for an Uncertain Parameters, Second Order Plant with the Use of Discrete Controller

In the paper the proposition of a discrete, robust, minimal energetic P servo controller for second order plant is presented. The plant under consideration is described with the use of a state space equation and a transfer function with interval parameters. The considered model describes for example an oriented PV （photovoltaic） system. As a controller a P （proportional） controller was applied. It is very simple and their application in the situation we deal with assures the suitable control performance. The controller is going to be implemented at digital platform. To construct the control system a cost function proposed by the authors was applied. It describes both the energy consumption and the sample time of controller. The proposed cost function is a function of plant parameters, describing the dynamics of the plant and controller parameters： proportional gain and sample time. For the cost function a simple geometric interpretation can be given： for fixed plant parameters and varying controller parameters it is a surface in the Ra plane. This fact can be applied to assign of optimal controller. Theoretical results were depicted by a numerical example.

A BICUBIC B-SPLINE FINITE ELEMENT METHOD FOR FOURTH-ORDER SEMILINEAR PARABOLIC OPTIMAL CONTROL PROBLEMS

A bicubic B-spline finite element method is proposed to solve optimal control problems governed by fourth-order semilinear parabolic partial differential equations.Its key feature is the selection of bicubic B-splines as trial functions to approximate the state and costate variables in two space dimensions.A Crank-Nicolson difference scheme is constructed for time discretization.The resulting numerical solutions belong to C2in space,and the order of the coefficient matrix is low.Moreover,the Bogner-Fox-Schmit element is considered for comparison.Two numerical experiments demonstrate the feasibility and effectiveness of the proposed method.

Adaptive Optimal Output Regulation of Interconnected Singularly Perturbed Systems With Application to Power Systems

This article studies the adaptive optimal output regulation problem for a class of interconnected singularly perturbed systems(SPSs) with unknown dynamics based on reinforcement learning(RL).Taking into account the slow and fast characteristics among system states,the interconnected SPS is decomposed into the slow time-scale dynamics and the fast timescale dynamics through singular perturbation theory.For the fast time-scale dynamics with interconnections,we devise a decentralized optimal control strategy by selecting appropriate weight matrices in the cost function.For the slow time-scale dynamics with unknown system parameters,an off-policy RL algorithm with convergence guarantee is given to learn the optimal control strategy in terms of measurement data.By combining the slow and fast controllers,we establish the composite decentralized adaptive optimal output regulator,and rigorously analyze the stability and optimality of the closed-loop system.The proposed decomposition design not only bypasses the numerical stiffness but also alleviates the high-dimensionality.The efficacy of the proposed methodology is validated by a load-frequency control application of a two-area power system.

Dynamics modeling and optimal control for multi-information diffusion in Social Internet of Things

As an ingenious convergence between the Internet of Things and social networks,the Social Internet of Things(SIoT)can provide effective and intelligent information services and has become one of the main platforms for people to spread and share information.Nevertheless,SIoT is characterized by high openness and autonomy,multiple kinds of information can spread rapidly,freely and cooperatively in SIoT,which makes it challenging to accurately reveal the characteristics of the information diffusion process and effectively control its diffusion.To this end,with the aim of exploring multi-information cooperative diffusion processes in SIoT,we first develop a dynamics model for multi-information cooperative diffusion based on the system dynamics theory in this paper.Subsequently,the characteristics and laws of the dynamical evolution process of multi-information cooperative diffusion are theoretically investigated,and the diffusion trend is predicted.On this basis,to further control the multi-information cooperative diffusion process efficiently,we propose two control strategies for information diffusion with control objectives,develop an optimal control system for the multi-information cooperative diffusion process,and propose the corresponding optimal control method.The optimal solution distribution of the control strategy satisfying the control system constraints and the control budget constraints is solved using the optimal control theory.Finally,extensive simulation experiments based on real dataset from Twitter validate the correctness and effectiveness of the proposed model,strategy and method.

Optimal and robust control of population transfer in asymmetric quantum-dot molecules

We present an optimal and robust quantum control method for efficient population transfer in asymmetric double quantum-dot molecules.We derive a long-duration control scheme that allows for highly efficient population transfer by accurately controlling the amplitude of a narrow-bandwidth pulse.To overcome fluctuations in control field parameters,we employ a frequency-domain quantum optimal control theory method to optimize the spectral phase of a single pulse with broad bandwidth while preserving the spectral amplitude.It is shown that this spectral-phase-only optimization approach can successfully identify robust and optimal control fields,leading to efficient population transfer to the target state while concurrently suppressing population transfer to undesired states.The method demonstrates resilience to fluctuations in control field parameters,making it a promising approach for reliable and efficient population transfer in practical applications.

Lax-Oleinik-Type Formulas and Efficient Algorithms for Certain High-Dimensional Optimal Control Problems

Two of the main challenges in optimal control are solving problems with state-dependent running costs and developing efficient numerical solvers that are computationally tractable in high dimensions.In this paper,we provide analytical solutions to certain optimal control problems whose running cost depends on the state variable and with constraints on the control.We also provide Lax-Oleinik-type representation formulas for the corresponding Hamilton-Jacobi partial differential equations with state-dependent Hamiltonians.Additionally,we present an efficient,grid-free numerical solver based on our representation formulas,which is shown to scale linearly with the state dimension,and thus,to overcome the curse of dimensionality.Using existing optimization methods and the min-plus technique,we extend our numerical solvers to address more general classes of convex and nonconvex initial costs.We demonstrate the capabilities of our numerical solvers using implementations on a central processing unit(CPU)and a field-programmable gate array(FPGA).In several cases,our FPGA implementation obtains over a 10 times speedup compared to the CPU,which demonstrates the promising performance boosts FPGAs can achieve.Our numerical results show that our solvers have the potential to serve as a building block for solving broader classes of high-dimensional optimal control problems in real-time.

Sequential Inverse Optimal Control of Discrete-Time Systems

This paper presents a novel sequential inverse optimal control(SIOC)method for discrete-time systems,which calculates the unknown weight vectors of the cost function in real time using the input and output of an optimally controlled discrete-time system.The proposed method overcomes the limitations of previous approaches by eliminating the need for the invertible Jacobian assumption.It calculates the possible-solution spaces and their intersections sequentially until the dimension of the intersection space decreases to one.The remaining one-dimensional vector of the possible-solution space’s intersection represents the SIOC solution.The paper presents clear conditions for convergence and addresses the issue of noisy data by clarifying the conditions for the singular values of the matrices that relate to the possible-solution space.The effectiveness of the proposed method is demonstrated through simulation results.

Optimal Control for Age Distribution and Weighted Size Competitive Species in a Polluted Environment

In the paper,we study an optimal control for a system representing a competitive species model with fertility and mortality depending on a weighted size in a polluted environment.A fixed point theorem is applied to obtain the existence and uniqueness exhibited by a non-negative solution of above mentioned model.A maximum principle helps to carefully verify the existence of the optimal control policy,and tangent-normal cone techniques help to obtain the optimal condition specific to control issue.

Trigonometric Regularization and Continuation Method Based Time-Optimal Control of Hypersonic Vehicles

Aiming at the time-optimal control problem of hypersonic vehicles(HSV)in ascending stage,a trigonometric regularization method(TRM)is introduced based on the indirect method of optimal control.This method avoids analyzing the switching function and distinguishing between singular control and bang-bang control,where the singular control problem is more complicated.While in bang-bang control,the costate variables are unsmooth due to the control jumping,resulting in difficulty in solving the two-point boundary value problem(TPBVP)induced by the indirect method.Aiming at the easy divergence when solving the TPBVP,the continuation method is introduced.This method uses the solution of the simplified problem as the initial value of the iteration.Then through solving a series of TPBVP,it approximates to the solution of the original complex problem.The calculation results show that through the above two methods,the time-optimal control problem of HSV in ascending stage under the complex model can be solved conveniently.

Contract Mechanism of Water Environment Regulation for Small and Medium Sized Enterprises Based on Optimal Control Theory

The small and scattered enterprise pattern in the county economy has formed numerous sporadic pollution sources, hindering the centralized treatment of the water environment, increasing the cost and difficulty of treatment. How enterprises can make reasonable decisions on their water environment behavior based on the external environment and their own factors is of great significance for scientifically and effectively designing water environment regulation mechanisms. Based on optimal control theory, this study investigates the design of contractual mechanisms for water environmental regulation for small and medium-sized enterprises. The enterprise is regarded as an independent economic entity that can adopt optimal control strategies to maximize its own interests. Based on the participation of multiple subjects including the government, enterprises, and the public, an optimal control strategy model for enterprises under contractual water environmental regulation is constructed using optimal control theory, and a method for calculating the amount of unit pollutant penalties is derived. The water pollutant treatment cost data of a paper company is selected to conduct empirical numerical analysis on the model. The results show that the increase in the probability of government regulation and public participation, as well as the decrease in local government protection for enterprises, can achieve the same regulatory effect while reducing the number of administrative penalties per unit. Finally, the implementation process of contractual water environmental regulation for small and medium-sized enterprises is designed.

A new optimal adaptive backstepping control approach for nonlinear systems under deception attacks via reinforcement learning

In this paper,a new optimal adaptive backstepping control approach for nonlinear systems under deception attacks via reinforcement learning is presented in this paper.The existence of nonlinear terms in the studied system makes it very difficult to design the optimal controller using traditional methods.To achieve optimal control,RL algorithm based on critic–actor architecture is considered for the nonlinear system.Due to the significant security risks of network transmission,the system is vulnerable to deception attacks,which can make all the system state unavailable.By using the attacked states to design coordinate transformation,the harm brought by unknown deception attacks has been overcome.The presented control strategy can ensure that all signals in the closed-loop system are semi-globally ultimately bounded.Finally,the simulation experiment is shown to prove the effectiveness of the strategy.