Autonomous Vehicle Platoons In Urban Road Networks:A Joint Distributed Reinforcement Learning and Model Predictive Control Approach

In this paper, platoons of autonomous vehicles operating in urban road networks are considered. From a methodological point of view, the problem of interest consists of formally characterizing vehicle state trajectory tubes by means of routing decisions complying with traffic congestion criteria. To this end, a novel distributed control architecture is conceived by taking advantage of two methodologies: deep reinforcement learning and model predictive control. On one hand, the routing decisions are obtained by using a distributed reinforcement learning algorithm that exploits available traffic data at each road junction. On the other hand, a bank of model predictive controllers is in charge of computing the more adequate control action for each involved vehicle. Such tasks are here combined into a single framework:the deep reinforcement learning output(action) is translated into a set-point to be tracked by the model predictive controller;conversely, the current vehicle position, resulting from the application of the control move, is exploited by the deep reinforcement learning unit for improving its reliability. The main novelty of the proposed solution lies in its hybrid nature: on one hand it fully exploits deep reinforcement learning capabilities for decisionmaking purposes;on the other hand, time-varying hard constraints are always satisfied during the dynamical platoon evolution imposed by the computed routing decisions. To efficiently evaluate the performance of the proposed control architecture, a co-design procedure, involving the SUMO and MATLAB platforms, is implemented so that complex operating environments can be used, and the information coming from road maps(links,junctions, obstacles, semaphores, etc.) and vehicle state trajectories can be shared and exchanged. Finally by considering as operating scenario a real entire city block and a platoon of eleven vehicles described by double-integrator models, several simulations have been performed with the aim to put in light the main f eatures of the proposed approach. Moreover, it is important to underline that in different operating scenarios the proposed reinforcement learning scheme is capable of significantly reducing traffic congestion phenomena when compared with well-reputed competitors.

Robust Consensus Tracking Control of Uncertain Multi-Agent Systems With Local Disturbance Rejection

In this paper,a new distributed consensus tracking protocol incorporating local disturbance rejection is devised for a multi-agent system with heterogeneous dynamic uncertainties and disturbances over a directed graph.It is of two-degree-of-freedom nature.Specifically,a robust distributed controller is designed for consensus tracking,while a local disturbance estimator is designed for each agent without requiring the input channel information of disturbances.The condition for asymptotic disturbance rejection is derived.Moreover,even when the disturbance model is not exactly known,the developed method also provides good disturbance-rejection performance.Then,a robust stabilization condition with less conservativeness is derived for the whole multi-agent system.Further,a design algorithm is given.Finally,comparisons with the conventional one-degree-of-freedombased distributed disturbance-rejection method for mismatched disturbances and the distributed extended-state observer for matched disturbances validate the developed method.

Differential flatness-based distributed control of underactuated robot swarms

This paper proposes a distributed control method based on the differential flatness(DF) property of robot swarms. The swarm DF mapping is established for underactuated differentially flat dynamics, according to the control objective. The DF mapping refers to the fact that the system state and input of each robot can be derived algebraically from the flat outputs of the leaders and the cooperative errors and their finite order derivatives. Based on the proposed swarm DF mapping, a distributed controller is designed. The distributed implementation of swarm DF mapping is achieved through observer design. The effectiveness of the proposed method is validated through a numerical simulation of quadrotor swarm synchronization.

Distributed Model Predictive Load Frequency Control of Multi-area Power System with DFIGs

Reliable load frequency control(LFC) is crucial to the operation and design of modern electric power systems. Considering the LFC problem of a four-area interconnected power system with wind turbines, this paper presents a distributed model predictive control(DMPC) based on coordination scheme.The proposed algorithm solves a series of local optimization problems to minimize a performance objective for each control area. The generation rate constraints(GRCs), load disturbance changes, and the wind speed constraints are considered. Furthermore, the DMPC algorithm may reduce the impact of the randomness and intermittence of wind turbine effectively. A performance comparison between the proposed controller with and without the participation of the wind turbines is carried out. Analysis and simulation results show possible improvements on closed–loop performance, and computational burden with the physical constraints.

Resilience Against Replay Attacks:A Distributed Model Predictive Control Scheme for Networked Multi-Agent Systems

In this paper,a resilient distributed control scheme against replay attacks for multi-agent networked systems subject to input and state constraints is proposed.The methodological starting point relies on a smart use of predictive arguments with a twofold aim:1)Promptly detect malicious agent behaviors affecting normal system operations;2)Apply specific control actions,based on predictive ideas,for mitigating as much as possible undesirable domino effects resulting from adversary operations.Specifically,the multi-agent system is topologically described by a leader-follower digraph characterized by a unique leader and set-theoretic receding horizon control ideas are exploited to develop a distributed algorithm capable to instantaneously recognize the attacked agent.Finally,numerical simulations are carried out to show benefits and effectiveness of the proposed approach.

Chattering analysis for discrete sliding mode control ofdistributed control systems

The chattering characteristic of sliding mode control isanalyzed when it is applied in distributed control systems （DCSs）.For a DCS with random time delay and packet dropout, a discreteswitching system model with time varying sampling period isconstructed based on the time delay system method. The reachinglaw based sliding mode controller is applied in the proposedsystem. The exponential stability condition in the form of linearmatrix inequality is figured out based on the multi-Lyaponov functionmethod. Then, the chattering characteristic is analyzed for theswitching system, and a chattering region related with time varyingsampling period and external disturbance is proposed. Finally, numericalexamples are given to illustrate the validity of the analysisresult.

Distributed Fault-Tolerant Containment Control for Nonlinear Multi-Agent Systems Under Directed Network Topology via Hierarchical Approach

This paper investigates the distributed fault-tolerant containment control(FTCC)problem of nonlinear multi-agent systems(MASs)under a directed network topology.The proposed control framework which is independent on the global information about the communication topology consists of two layers.Different from most existing distributed fault-tolerant control(FTC)protocols where the fault in one agent may propagate over network,the developed control method can eliminate the phenomenon of fault propagation.Based on the hierarchical control strategy,the FTCC problem with a directed graph can be simplified to the distributed containment control of the upper layer and the fault-tolerant tracking control of the lower layer.Finally,simulation results are given to demonstrate the effectiveness of the proposed control protocol.

Distributed model predictive control for multiagent systems with improved consistency

This paper addresses an improved distributed model predictive control （DMPC） scheme for multiagent systems with an attempt to improving its consistency. The deviation between what an agent is actually doing and what its neighbors believe that agent is doing is penalized in the cost function of each agent. At each sampling instant the compatibility constraint of each agent is set tighter than the previous sampling instant. Like the traditional approach, the performance cost is utilized as the Lyapunov function to prove closed-looped stability. The closed-loop stability is guaranteed if the weight matrix for deviation in the cost function are sufficiently large. The proposed distributed control scheme is formulated as quadratic programming with quadratic constraints. A numerical example is given to illustrate the effectiveness of the proposed scheme.

Development of Distributed Control System for Neutral Beam Injector on EAST

A distributed control system of Neutral Beam Injector （NBI） on the Experimental Advanced Superconducting Tokamak （EAST-NBI） is briefly presented in this paper. The control system is developed in accordance with the experimental operational characteristics of the EAST- NBI. The NBI control system （NBICS）, which is based on the computer network technologies and classified according to the control levels, consists of three levels： a remote monitoring layer, a server control layer, and a field control layer. The 3-layer architecture is capable of extending the system functions and upgrading devices. The timing system provides the reference clock of the synchronization and interlock for the EAST-NBI system. An interlock system ensures the safety of the experiment operators and field devices. Both of the ion sources of the beamline are designed to operate independently. This lays an important foundation for developing a control system for the second beamline on EAST. Experimental results demonstrate that the NBICS meets functional requirements of the EAST-NBI control, and makes experimental operations visual and automatic.

DISOPE distributed model predictive control of cascade systems with network communication

A novel distributed model predictive control scheme based on dynamic integrated system optimization and parameter estimation （DISOPE） was proposed for nonlinear cascade systems under network environment. Under the distributed control structure, online optimization of the cascade system was composed of several cascaded agents that can cooperate and exchange information via network communication. By iterating on modified distributed linear optimal control problems on the basis of estimating parameters at every iteration the correct optimal control action of the nonlinear model predictive control problem of the cascade system could be obtained, assuming that the algorithm was convergent. This approach avoids solving the complex nonlinear optimization problem and significantly reduces the computational burden. The simulation results of the fossil fuel power unit are illustrated to verify the effectiveness and practicability of the proposed algorithm.

Aperiodic Sampled-Data Control of Distributed Networked Control Systems Under Stochastic Cyber-Attacks

This paper examines the stabilization problem of a distributed networked control system under the effect of cyberattacks by employing a hybrid aperiodic triggering mechanism.The cyber-attack considered in the paper is a stochastic deception attack at the sensor-controller end. The probability of the occurrence of attack on a subsystem is represented using a random variable. A decentralized hybrid sampled-data strategy is introduced to save energy consumption and reduce the transmission load of the network. In the proposed decentralized strategy, each subsystem can decide independently whether its state should be transmitted to the controller or not. The scheme of the hybrid triggering mechanism for each subsystem composed of two stages: In the first stage, the next sampling instant is computed using a self-triggering strategy. Subsequently, in the second stage, an event-triggering condition is checked at these sampling instants and the control signal is computed only if the event-triggering condition is violated. The self-triggering condition used in the first stage is dependent on the selection of eventtriggering condition of the second stage. Finally, a comparison of the proposed approach with other triggering mechanisms existing in the literature is presented in terms of the sampling instants,transmission frequency and performance measures through simulation examples.

Distributed Model Predictive Control with Actuator Saturation for Markovian Jump Linear System

This paper is concerned with the distributed model predictive control(MPC) problem for a class of discrete-time Markovian jump linear systems(MJLSs) subject to actuator saturation and polytopic uncertainty in system matrices. The global system is decomposed into several subsystems which coordinate with each other. A set of distributed controllers is designed by solving a min-max optimization problem in terms of the solutions of linear matrix inequalities(LMIs). An iterative algorithm is developed to achieve the online computation. Finally,a simulation example is employed to show the effectiveness of the proposed algorithm.

Optimal Cooperative Secondary Control for Islanded DC Microgrids via a Fully Actuated Approach

DC-DC converter-based multi-bus DC microgrids(MGs) in series have received much attention, where the conflict between voltage recovery and current balancing has been a hot topic. The lack of models that accurately portray the electrical characteristics of actual MGs while is controller design-friendly has kept the issue active. To this end, this paper establishes a large-signal model containing the comprehensive dynamical behavior of the DC MGs based on the theory of high-order fully actuated systems, and proposes distributed optimal control based on this. The proposed secondary control method can achieve the two goals of voltage recovery and current sharing for multi-bus DC MGs. Additionally, the simple structure of the proposed approach is similar to one based on droop control, which allows this control technique to be easily implemented in a variety of modern microgrids with different configurations. In contrast to existing studies, the process of controller design in this paper is closely tied to the actual dynamics of the MGs. It is a prominent feature that enables engineers to customize the performance metrics of the system. In addition, the analysis of the stability of the closed-loop DC microgrid system, as well as the optimality and consensus of current sharing are given. Finally, a scaled-down solar and battery-based microgrid prototype with maximum power point tracking controller is developed in the laboratory to experimentally test the efficacy of the proposed control method.

Distributed Economic MPC for Synergetic Regulation of the Voltage of an Island DC Micro-Grid

In this paper,distributed model predictive control(DMPC) for island DC micro-grids(MG) with wind/photovoltaic(PV)/battery power is proposed,which coordinates all distributed generations(DG) to stabilize the bus voltage together with the insurance of having computational efficiency under a real-time requirement.Based on the feedback of the bus voltage,the deviation of the current is dispatched to each DG according to cost over the prediction horizon.Moreover,to avoid the excessive fluctuation of the battery power,both the discharge-charge switching times and costs are considered in the model predictive control(MPC) optimization problems.A Lyapunov constraint with a time-varying steady-state is designed in each local MPC to guarantee the stabilization of the entire system.The voltage stabilization of the MG is achieved by this strategy with the cooperation of DGs.The numeric results of applying the proposed method to a MG of the Shanghai Power Supply Company shows the effectiveness of the distributed economic MPC.

THE STUDY ON A KIND OF CONTROL SYSTEM WITH NONLINEAR PARABOLIC DISTRIBUTED PARAMETERS

The modelling of one kind of nonlinear parabolic distributed parameter control system with moving boundary, which had extensive applications was presented, Two methods were used to investigate the basic characteristics of the system: I) transforming the system it? the variable domain into that in the fixed domain; 2) transforming the distributed parameter system into the lumped parameter system. It is found that there are two critical values for the control variable : the larger one determines whether or not the boundary would move, while the smaller one determines whether or not the boundary, would atop automatically. For one-dimensional system of planar, cylindrical and spherical cases the definite solution problem can be expressed as a unified form. By means of the computer simulation the open-loop control system and close-cycle feedback control system have been investigated. Numerical results agree well with theoretical results. The computer simulation shows that the system is well posed, stable, measurable and controllable.

Consensus of Multi-Agent Systems with Input Constraints Based on Distributed Predictive Control Scheme

Consensus control of multi-agent systems has attracted compelling attentions from various scientific communities for its promising applications.This paper presents a discrete-time consensus protocol for a class of multi-agent systems with switching topologies and input constraints based on distributed predictive control scheme.The consensus protocol is not only distributed but also depends on the errors of states between agent and its neighbors.We focus mainly on dealing with the input constraints and a distributed model predictive control scheme is developed to achieve stable consensus under the condition that both velocity and acceleration constraints are included simultaneously.The acceleration constraint is regarded as the changing rate of velocity based on some reasonable assumptions so as to simplify the analysis.Theoretical analysis shows that the constrained system steered by the proposed protocol achieves consensus asymptotically if the switching interaction graphs always have a spanning tree.Numerical examples are also provided to illustrate the validity of the algorithm.

Plasma spraying system with distributed controlling

A distributed control system is designed for plasma spraying equipment and the configurations of system software and hardware is discussed. Through founding an expert database, the spraying process parameters are worked out and the initialization and control of spraying process are realized. The plasma spraying system with this control configuration can simplify the spraying operation, improve automation level of spray process, and approach the experience criterion as soon as possible.

Cosimulation Platform for Distributed Control System via Heterogeneous Network

A cosimulation platform was established for distributed control systems via heterogeneous network,which integrated OPNET and Matlab/Simulink.The communication node in this cosimulation platform was built based on OSI model and UDP protocol,which was adopted as the transportation layer protocol.Data exchanged between the data source module and the specified node.It was fulfilled by revising the corresponding protocol modules based on the characteristics of UDP.The effectiveness of the constructed simulation platform was demonstrated by a numerical example.

Distributed Stretching Control of Web Production System

The stretching process,as a key phase of web production system,pursues the target velocities of rollers and the web tensions of spans between the successive rollers to guarantee proper stretching ratios. This requires the stable velocities and velocity ratios of large number rollers separated throughout the workshop. To this goal,a distributed cooperative controller is designed to coordinate the velocities of the rollers to the desired values as well as the target ratios between the upper and lower rollers. During the whole evolution,only the neighbor rollers can exchange the working information,and neither global information nor central controller is required. It is proven that all the rollers asymptotically achieve the desired velocity ratios via the proposed control law,which is also demonstrated by numerical simulation.

Metaheuristic Based Resource Scheduling Technique for Distributed Robotic Control Systems

The design of controllers for robots is a complex system that is to be dealt with several tasks in real time for enabling the robots to function independently.The distributed robotic control system can be used in real time for resolving various challenges such as localization,motion controlling,mapping,route planning,etc.The distributed robotic control system can manage different kinds of heterogenous devices.Designing a distributed robotic control system is a challenging process as it needs to operate effectually under different hardware configurations and varying computational requirements.For instance,scheduling of resources(such as communication channel,computation unit,robot chassis,or sensor input)to the various system components turns out to be an essential requirement for completing the tasks on time.Therefore,resource scheduling is necessary for ensuring effective execution.In this regard,this paper introduces a novel chaotic shell game optimization algorithm(CSGOA)for resource scheduling,known as the CSGOA-RS technique for the distributed robotic control system environment.The CSGOA technique is based on the integration of the chaotic maps concept to the SGO algorithm for enhancing the overall performance.The CSGOA-RS technique is designed for allocating the resources in such a way that the transfer time is minimized and the resource utilization is increased.The CSGOA-RS technique is applicable even for the unpredicted environment where the resources are to be allotted dynamically based on the early estimations.For validating the enhanced performance of the CSGOA-RS technique,a series of simulations have been carried out and the obtained results have been examined with respect to a selected set of measures.The resultant outcomes highlighted the promising performance of the CSGOA-RS technique over the other resource scheduling techniques.