Finite-time Prescribed Performance Time-Varying Formation Control for Second-Order Multi-Agent Systems With Non-Strict Feedback Based on a Neural Network Observer

This paper studies the problem of time-varying formation control with finite-time prescribed performance for nonstrict feedback second-order multi-agent systems with unmeasured states and unknown nonlinearities.To eliminate nonlinearities,neural networks are applied to approximate the inherent dynamics of the system.In addition,due to the limitations of the actual working conditions,each follower agent can only obtain the locally measurable partial state information of the leader agent.To address this problem,a neural network state observer based on the leader state information is designed.Then,a finite-time prescribed performance adaptive output feedback control strategy is proposed by restricting the sliding mode surface to a prescribed region,which ensures that the closed-loop system has practical finite-time stability and that formation errors of the multi-agent systems converge to the prescribed performance bound in finite time.Finally,a numerical simulation is provided to demonstrate the practicality and effectiveness of the developed algorithm.

Bounded consensus tracking of second-order multi-agent systems with sampling delay under directed networks

The bounded consensus tracking problems of second-order multi-agent systems under directed networks with sam- pling delay are addressed in this paper. When the sampling delay is more than a sampling period, new protocols based on sampled-data control are proposed so that each agent can track the time-varying reference state of the virtual leader. By using the delay decomposition approach, the augmented matrix method, and the frequency domain analysis, necessary and sufficient conditions are obtained, which guarantee that the bounded consensus tracking is realized. Furthermore, some numerical simulations are presented to demonstrate the effectiveness of the theoretical results.

Cluster consensus of second-order multi-agent systems via pinning control

This paper investigates the cluster consensus problem for second-order multi-agent systems by applying the pinning control method to a small collection of the agents. Consensus is attained independently for different agent clusters according to the community structure generated by the group partition of the underlying graph and sufficient conditions for both cluster and general consensus are obtained by using results from algebraic graph theory and the LaSalle Invariance Principle. Finally, some simple simulations are presented to illustrate the technique.

Consensus problem of second-order multi-agent systems with time-varying communication delay and switching topology

Leader-following stationary consensus problem is investigated for the second-order multi-agent systems with timevarying communication delay and switching topology. Based on Lyapunov-Krasovskii functional and Lyapunov-Razumikhin functions respectively, consensus criterions in the form of linear matrix inequality （LMI） are obtained for the system with time-varying communication delays under static interconnection topology con- verging to the leader＇s states. Moreover, the delay-dependent consensus criterion in the form of LMI is also obtained for the system with time-invariant communication delay and switching topologies by constructing Lyapunov-Krasovskii functional. Numerical simulations present the correctness of the results.

Second-order consensus in networks of dynamic agents with communication time-delays

This paper proposes second-order consensus protocols with time-delays and gives the measure of the robustness of the protocols to the time-delay existing in the network of agents with second-order dynamics. By employing a frequency domain method, it is proven that the information states and their time derivatives of all the agents in the network achieve consensus asymptotically, respectively, for appropriate communication timedelay if the topology of weighted network is connected. Particularly, a tight upper bound on the communication time-delay that can be tolerated in the dynamic network is found. The consensus protocols are distributed in the sense that each agent only needs information from its neighboring agents, which reduces the complexity of connections between neighboring agents significantly. Numerical simulation results are provided to demonstrate the effectiveness and the sharpness of the theoretical results for second-order consensus in networks in the presence of communication time-delays.

Distributed event-triggered consensus tracking of second-order multi-agent systems with a virtual leader

This paper investigates the consensus tracking problems of second-order multi-agent systems with a virtual leader via event-triggered control. A novel distributed event-triggered transmission scheme is proposed, which is intermittently examined at constant sampling instants. Only partial neighbor information and local measurements are required for event detection. Then the corresponding event-triggered consensus tracking protocol is presented to guarantee second-order multi-agent systems to achieve consensus tracking. Numerical simulations are given to illustrate the effectiveness of the proposed strategy.

CONSENSUS OF THE SECOND-ORDER MULTI-AGENT SYSTEMS WITH AN ACTIVE LEADER AND COUPLING TIME DELAY

This article investigates the consensus problem of the second-order multi-agent systems with an active leader and coupling time delay in direct graph. One decentralized state control rule is constructed for each agent to track the active leader and it is proved that the proposed control scheme enables the consensus to be obtained when the adjacency topology is fixed/switched. Simulation results show effectiveness of the proposed theoretical analysis.

Consensus of Second-order Multi-agent Systems with Nonsymmetric Interconnection and Heterogeneous Delays

In this paper, a consensus algorithm of multi-agent second-order dynamical systems with nonsymmetric interconnection and heterogeneous delays is studied. With the hypothesis of directed weighted topology graph with a globally reachable node, decentralized consensus condition is obtained by applying generalized Nyquist criterion. For the systems with both communication and input delays, it is shown that the consensus condition is dependent on input delays but independent of communication delays.

Distributed Time Synchronization in Wireless Sensor Networks via Second-Order Consensus Algorithms

This paper proposes a distributed second-order consensus time synchronization, which incorporates the second-order consensus algorithm into wireless sensor networks. Since local clocks may have different skews and offsets, the algorithm is designed to include offset compensation and skew compensation. The local clocks are not directly modified, thus the virtual clocks are built according to the local clocks via the compensation parameters. Each node achieves a virtual consensus clock by periodically updated compensation parameters. Finally, the effectiveness of the proposed algorithm is verified through a number of simulations in a mesh network. It is proved that the proposed algorithm has the advantage of being distributed, asymptotic convergence, and robust to new node joining.

Multi-agent reinforcement learning for edge information sharing in vehicular networks

To guarantee the heterogeneous delay requirements of the diverse vehicular services,it is necessary to design a full cooperative policy for both Vehicle to Infrastructure(V2I)and Vehicle to Vehicle(V2V)links.This paper investigates the reduction of the delay in edge information sharing for V2V links while satisfying the delay requirements of the V2I links.Specifically,a mean delay minimization problem and a maximum individual delay minimization problem are formulated to improve the global network performance and ensure the fairness of a single user,respectively.A multi-agent reinforcement learning framework is designed to solve these two problems,where a new reward function is proposed to evaluate the utilities of the two optimization objectives in a unified framework.Thereafter,a proximal policy optimization approach is proposed to enable each V2V user to learn its policy using the shared global network reward.The effectiveness of the proposed approach is finally validated by comparing the obtained results with those of the other baseline approaches through extensive simulation experiments.

Target Tracking and Obstacle Avoidance for Multi-agent Networks with Input Constraints

In this paper, the problems of target tracking and obstacle avoidance for multi-agent networks with input constraints are investigated. When there is a moving obstacle, the control objectives are to make the agents track a moving target and to avoid collisions among agents. First, without considering the input constraints, a novel distributed controller can be obtained based on the potential function. Second, at each sampling time, the control algorithm is optimized. Furthermore, to solve the problem that agents cannot effectively avoid the obstacles in dynamic environment where the obstacles are moving, a new velocity repulsive potential is designed. One advantage of the designed control algorithm is that each agent only requires local knowledge of its neighboring agents. Finally, simulation results are provided to verify the effectiveness of the proposed approach.

Reference model based consensus control of second-order multi-agent systems

This paper deals with the consensus problem of multi-agent systems with second-order dynamics. The objective is to design algorithms such that all agents will have same positions and velocities. First, a reference model based consensus algorithm is proposed. It is proved that the consensus can be achieved if the communication graph has a spanning tree. Different from most of the consensus algorithms proposed in the literature, the parameters of the control laws are different among agents. Therefore, each agent can design its control law independently. Secondly, it gives a consensus algorithm for the case that the velocities of the agents are not available. Thirdly, the effectiveness of the input delay and the communication delay is considered. It shows that consensus can be achieved if the input delay of every agent is smaller than a bound related to parameters in its control law. Finally, some numerical examples are given to illustrate the proposed results.

H_∞ consensus control of a class of second-order multi-agent systems without relative velocity measurement

This paper studies consensus control problems for a class of second-order multi-agent systems without relative velocity measurement. Some dynamic neighbour-based rules are adopted for the agents in the presence of external disturbances. A sufficient condition is derived to make all agents achieve consensus while satisfying desired H∞ performance. Finally, numerical simulations are provided to show the effectiveness of our theoretical results.

Multi-agent consensus algorithm for second-order systems with a time-varying reference state

Two second-order consensus algorithms with a time-vary reference state without relative velocity measurements are proposed in a directed topology. Necessary and sufficient conditions are presented to ensure second-order consensus. It is shown that all the coupling strengths and the ei- genvalues of the Laplacian matrix play important roles in reaching consensus. Specially when all non- zero eigenvalues of the Laplacian matrix are real, consensus can be achieved if and only if the cou- pling strengths are positive and the directed topology has a spanning tree for the first algorithm, and for the second one, consensus can be achieved if and only if the coupling strengths are positive. Fi- nally, simulation examples are presented to verify the theoretical analysis.

Improving consensual performance of multi-agent systems in weighted scale-free networks

This paper studies consensus problems in weighted scale-free networks of asymmetrically coupled dynamical units, where the asymmetry in a given link is deter：mined by the relative degree of the involved nodes. It shows that the asymmetry of interactions has a great effect on the consensus. Especially, when the interactions are dominant from higher- to lower-degree nodes, both the convergence speed and the robustness to communication delay are enhanced.

MULTI-AGENT SYSTEM FOR WORM DETECTION AND CONTAINMENT IN METROPOLITAN AREA NETWORKS

Active worms can cause widespread damages at so high a speed that effectively precludes human-directed reaction, and patches for the worms are always available after the damages have been caused, which has elevated them self to a first-class security threat to Metropolitan Area Networks (MAN). Multi-agent system for Worm Detection and Containment in MAN (MWDCM) is presented to provide a first-class automatic reaction mechanism that automatically applies containment strategies to block the propagation of the worms and to protect MAN against worm scan that wastes a lot of network bandwidth and crashes the routers. Its user agent is used to detect the known worms. Worm detection agent and worm detection correlation agent use two-stage based decision method to detect unknown worms. They adaptively study the accessing in the whole network and dynamically change the working parameters to detect the unknown worms. MWDCM confines worm infection within a macro-cell or a micro-cell of the metropolitan area networks, the rest of the accesses and hosts continue functioning without disruption. MWDCM integrates Worm Detection System (WDS) and network management system. Reaction measures can be taken by using Simple Network Management Protocol (SNMP) interface to control broadband access server as soon as the WDS detect the active worm. MWDCM is very effective in blocking random scanning worms. Simulation results indicate that high worm infection rate of epidemics can be avoided to a degree by MWDCM blocking the propagation of the worms.

A Multi-Agent School Simulation Based on Hierarchical Social Networks

The quality of K-12 education has been a very big concern for years. Previous methods studied only one or two factors, such as school choice, or teacher quality, on school performance. Therefore the results they provide can be limited. We propose a multi-agent approach to integrate multiple actors in a school system. These actors include teachers, students, supporting staffs and administrators. The interactions among these actors compose a hierarchical school social network. We first detect the hierarchical community structure in this school network by using an agglomerative hierarchical algorithm. Existing agglomerative hierarchical algorithms usually calculate similarity or dissimilarity between two clusters by using some measure of distance between pairs of observations. We, however, develop a method that calculates similarity based on social interactions between interactions is essential in multi-agent systems. Our algorithm is applied to 15 school districts in Bexar County, Texas, and it provides satisfying results on generating the hierarchical structure of all school districts. We then use the detected structure of the social network to evaluate the school system’s organization performance. We design and implement a funding evaluation model to decompose the funding policy task into subtasks and then evaluate these subtasks by using funding distribution policies from past years and looking for possible relationships between student performances and funding policies. Experiments in the 15 school districts in Bexar County show no significant correlation between student performance and the amount of the funding a school district received.

Distributed Containment Control of Networked Nonlinear Second-order Systems With Unknown Parameters

In this paper, we study the containment control problem for nonlinear second-order systems with unknown parameters and multiple stationary/dynamic leaders. The topologies that characterize the interaction among the leaders and the followers are directed graphs. Necessary and sufficient criteria which guarantee the control objectives are established for both stationary leaders(regulation case) and dynamic leaders(dynamic tracking case) based protocols. The final states of all the followers are exclusively determined by the initial values of the leaders and the topology structures. In the regulation case, all the followers converge into the convex hull spanned by the leaders,while in the dynamic tracking case, not only the positions of the followers converge into the convex hull but also the velocities of the followers converge into the velocity convex hull of the leaders.Finally, all the theoretical results are illustrated by numerical simulations.

Multi-agent system application in accordance with game theory in bi-directional coordination network model

The multi-agent system is the optimal solution to complex intelligent problems. In accordance with the game theory, the concept of loyalty is introduced to analyze the relationship between agents' individual income and global benefits and build the logical architecture of the multi-agent system. Besides, to verify the feasibility of the method, the cyclic neural network is optimized, the bi-directional coordination network is built as the training network for deep learning, and specific training scenes are simulated as the training background. After a certain number of training iterations, the model can learn simple strategies autonomously. Also,as the training time increases, the complexity of learning strategies rises gradually. Strategies such as obstacle avoidance, firepower distribution and collaborative cover are adopted to demonstrate the achievability of the model. The model is verified to be realizable by the examples of obstacle avoidance, fire distribution and cooperative cover. Under the same resource background, the model exhibits better convergence than other deep learning training networks, and it is not easy to fall into the local endless loop.Furthermore, the ability of the learning strategy is stronger than that of the training model based on rules, which is of great practical values.

Resilience Against Replay Attacks:A Distributed Model Predictive Control Scheme for Networked Multi-Agent Systems

In this paper,a resilient distributed control scheme against replay attacks for multi-agent networked systems subject to input and state constraints is proposed.The methodological starting point relies on a smart use of predictive arguments with a twofold aim:1)Promptly detect malicious agent behaviors affecting normal system operations;2)Apply specific control actions,based on predictive ideas,for mitigating as much as possible undesirable domino effects resulting from adversary operations.Specifically,the multi-agent system is topologically described by a leader-follower digraph characterized by a unique leader and set-theoretic receding horizon control ideas are exploited to develop a distributed algorithm capable to instantaneously recognize the attacked agent.Finally,numerical simulations are carried out to show benefits and effectiveness of the proposed approach.