Radio resource management in energy harvesting cooperative cognitive UAV assisted IoT networks:A multi-objective approach

Cooperative communication through energy harvested relays in Cognitive Internet of Things(CIoT)has been envisioned as a promising solution to support massive connectivity of Cognitive Radio(CR)based IoT devices and to achieve maximal energy and spectral efficiency in upcoming wireless systems.In this work,a cooperative CIoT system is contemplated,in which a source acts as a satellite,communicating with multiple CIoT devices over numerous relays.Unmanned Aerial Vehicles(UAVs)are used as relays,which are equipped with onboard Energy Harvesting(EH)facility.We adopted a Power Splitting(PS)method for EH at relays,which are harvested from the Radio frequency(RF)signals.In conjunction with this,the Decode and Forward(DF)relaying strategy is used at UAV relays to transmit the messages from the satellite source to the CIoT devices.We developed a Multi-Objective Optimization(MOO)framework for joint optimization of source power allocation,CIoT device selection,UAV relay assignment,and PS ratio determination.We formulated three objectives:maximizing the sum rate and the number of admitted CIoT in the network and minimizing the carbon dioxide emission.The MOO formulation is a Mixed-Integer Non-Linear Programming(MINLP)problem,which is challenging to solve.To address the joint optimization problem for an epsilon optimal solution,an Outer Approximation Algorithm(OAA)is proposed with reduced complexity.The simulation results show that the proposed OAA is superior in terms of CIoT device selection and network utility maximization when compared to those obtained using the Nonlinear Optimization with Mesh Adaptive Direct-search(NOMAD)algorithm.

Regional Multi-Agent Cooperative Reinforcement Learning for City-Level Traffic Grid Signal Control

This article studies the effective traffic signal control problem of multiple intersections in a city-level traffic system.A novel regional multi-agent cooperative reinforcement learning algorithm called RegionSTLight is proposed to improve the traffic efficiency.Firstly a regional multi-agent Q-learning framework is proposed,which can equivalently decompose the global Q value of the traffic system into the local values of several regions Based on the framework and the idea of human-machine cooperation,a dynamic zoning method is designed to divide the traffic network into several strong-coupled regions according to realtime traffic flow densities.In order to achieve better cooperation inside each region,a lightweight spatio-temporal fusion feature extraction network is designed.The experiments in synthetic real-world and city-level scenarios show that the proposed RegionS TLight converges more quickly,is more stable,and obtains better asymptotic performance compared to state-of-theart models.

Stochastic sampled-data multi-objective control of active suspension systems for in-wheel motor driven electric vehicles

This paper addresses the sampled-data multi-objective active suspension control problem for an in-wheel motor driven electric vehicle subject to stochastic sampling periods and asynchronous premise variables.The focus is placed on the scenario that the dynamical state of the half-vehicle active suspension system is transmitted over an in-vehicle controller area network that only permits the transmission of sampled data packets.For this purpose,a stochastic sampling mechanism is developed such that the sampling periods can randomly switch among different values with certain mathematical probabilities.Then,an asynchronous fuzzy sampled-data controller,featuring distinct premise variables from the active suspension system,is constructed to eliminate the stringent requirement that the sampled-data controller has to share the same grades of membership.Furthermore,novel criteria for both stability analysis and controller design are derived in order to guarantee that the resultant closed-loop active suspension system is stochastically stable with simultaneous𝐻2 and𝐻∞performance requirements.Finally,the effectiveness of the proposed stochastic sampled-data multi-objective control method is verified via several numerical cases studies in both time domain and frequency domain under various road disturbance profiles.

Neural Dynamics for Cooperative Motion Control of Omnidirectional Mobile Manipulators in the Presence of Noises: A Distributed Approach

This paper presents a distributed scheme with limited communications, aiming to achieve cooperative motion control for multiple omnidirectional mobile manipulators(MOMMs).The proposed scheme extends the existing single-agent motion control to cater to scenarios involving the cooperative operation of MOMMs. Specifically, squeeze-free cooperative load transportation is achieved for the end-effectors of MOMMs by incorporating cooperative repetitive motion planning(CRMP), while guiding each individual to desired poses. Then, the distributed scheme is formulated as a time-varying quadratic programming(QP) and solved online utilizing a noise-tolerant zeroing neural network(NTZNN). Theoretical analysis shows that the NTZNN model converges globally to the optimal solution of QP in the presence of noise. Finally, the effectiveness of the control design is demonstrated by numerical simulations and physical platform experiments.

Cooperative task allocation for heterogeneous multi-UAV using multi-objective optimization algorithm

The application of multiple UAVs in complicated tasks has been widely explored in recent years.Due to the advantages of flexibility,cheapness and consistence,the performance of heterogeneous multi-UAVs with proper cooperative task allocation is superior to over the single UAV.Accordingly,several constraints should be satisfied to realize the efficient cooperation,such as special time-window,variant equipment,specified execution sequence.Hence,a proper task allocation in UAVs is the crucial point for the final success.The task allocation problem of the heterogeneous UAVs can be formulated as a multi-objective optimization problem coupled with the UAV dynamics.To this end,a multi-layer encoding strategy and a constraint scheduling method are designed to handle the critical logical and physical constraints.In addition,four optimization objectives:completion time,target reward,UAV damage,and total range,are introduced to evaluate various allocation plans.Subsequently,to efficiently solve the multi-objective optimization problem,an improved multi-objective quantum-behaved particle swarm optimization(IMOQPSO)algorithm is proposed.During this algorithm,a modified solution evaluation method is designed to guide algorithmic evolution;both the convergence and distribution of particles are considered comprehensively;and boundary solutions which may produce some special allocation plans are preserved.Moreover,adaptive parameter control and mixed update mechanism are also introduced in this algorithm.Finally,both the proposed model and algorithm are verified by simulation experiments.

A Lane Change Model Considering the Stability of Cooperative Adaptive Cruise Control Platoon Fleet

In this article,lane change models for mixed traffic flow under cooperative adaptive cruise control(CACC)platoon formation are established.The analysis begins by examining the impact of lane changes on traffic flow stability.The influences of various factors such as lane change locations,timing,and the current traffic state on stability are discussed.In this analysis,it is assumed that the lane change location and the entry position in the adjacent lane have already been selected,without considering the specific intention behind the lane change.The speeds of the involved vehicles are adjusted based on an existing lane change model,and various conditions are analyzed for traffic flow disturbances,including duration,shock amplitude,and driving delays.Numerical calculations are provided to illustrate these effects.Additionally,traffic flow stability is factored into the lane change decision-making process.By incorporating disturbances to the fleet into the lane change income model,both a lane change intention model and a lane change execution model are constructed.These models are then compared with a model that does not account for stability,leading to the corresponding conclusions.

Cooperative Adaptive Cruise Control Platoon Fleet Formation Model Considering Efficiency and Stability

In the existing formation model,vehicles in the same lane or adjacent lane are regarded as the structure,and the driving behavior of vehicles is studied from the perspectives of safety,speed consistency,and stability,and the speed control model is proposed from the perspective of vehicles themselves,to obtain a stable fleet with the same distance and speed.However,in this process,the initial condition of the vehicle,the traffic flow environment,and the efficiency of the fleet formation are less considered.Therefore,based on summarizing the existing fleet building model,this paper puts forward the rapid construction model and algorithm of a cooperative adaptive cruise control platoon fleet.One of the important goals of forming a team is to enter the team with the smoothest trajectory in the shortest time.Therefore,this chapter studies the trajectory optimization of the vehicle formation process from the perspective of vehicle dynamics.

The Coalition Cooperative Game Method and Its Application in Multi-objective Optimization Design

This paper proposes a multi-objective optimization design method based on the coalition cooperative game theory where the three design goals have been seen as three game players. By calculating the affecting factors and fuzzy clustering, the design variables are divided into different strategic spaces which belong to each player, then it constructs a payoff function based on the coalition mechanism. Each game player takes its own revenue function as a target and obtains the best strategy versus other players. The best strategies of all players consist of the strategy permutation of a round game and it obtains the final game solutions through multi-round games according to the convergence criterion. A multi-objective optimization example of the luff mechanism of compensative sheave block shows the effectiveness of the coalition cooperative game method.

STABILITY ANALYSIS AND COOPERATIVE CONTROL OF DISTRIBUTED MULTI-AGENT SYSTEM WITH SAMPLED COMMUNICATION

The cooperative control and stability analysis problems for the multi-agent system with sampled com- munication are investigated. Distributed state feedback controllers are adopted for the cooperation of networked agents. A theorem in the form of linear matrix inequalities（LMI） is derived to analyze the system stability. An- other theorem in the form of optimization problem subject to LMI constraints is proposed to design the controller, and then the algorithm is presented. The simulation results verify the validity and the effectiveness of the pro- posed approach.

Multi-objective Stability Control Algorithm of Heavy Tractor Semi-trailer Based on Differential Braking

Rollover and jack-knifing of tractor semi-trailer are serious threats for vehicle safety, and accordingly active safety technologies have been widely used to reduce or prevent the occurrence of such accidents. However, currently tractor semi-trailer stability control is generally only a single hazardous condition (rollover or jack-knifing) control, it is difficult to ensure the vehicle comprehensive stability of various dangerous conditions. The main objective of this study is to introduce a multi-objective stability control algorithm which can improve the vehicle stability of a tractor semi-trailer by using differential braking. A vehicle controller is designed to minimize the likelihood of rollover and jack-knifing. First a linear vehicle model of tractor semi-trailer is constructed. Then an optimal yaw control for tractor using differential braking is applied to minimize the yaw rate and lateral acceleration deviation of tractor, as well as the hitch articulation angle of tractor semi-trailer, so as to improve the vehicle stability. Second a braking scheme and variable structure control with sliding mode control are introduced in order to achieve the best braking effect. Last Fishhook maneuver is introduced to the active safety simulation and the active control system effect verification. The simulation results show that multi-objective stability control algorithm of semi-trailer could improve the vehicle stability significantly during the transient maneuvers. The proposed multi-objective stability control algorithm is effective to prevent the vehicle rollover and jackknifing.

Connect & Drive:design and evaluation of cooperative adaptive cruise control for congestion reduction

Road throughput can be increased by driving at small inter-vehicle time gaps. The amplification of velocity disturbances in upstream direction, however, poses limitations to the minimum feasible time gap. This effect is covered by the notion of string stability. String-stable behavior is thus considered an essential requirement for the design of automatic distance control systems, which are needed to allow for safe driving at time gaps well below 1 s. Using wireless inter-vehicle communications to provide real-time information of the preceding vehicle, in addition to the information obtained by common Adaptive Cruise Control （ACC） sensors, appears to significantly decrease the feasible time gap, which is shown by practical experiments with a test fleet consisting of six passenger vehicles. The large-scale deployment of this system, known as Cooperative ACC （CACC）, however, poses challenges with respect to the reliability of the wireless communication system. A solution for this scalability problem can be found in decreasing the transmission power and/or beaconing rate, or adapting the communications protocol. Although the main CACC objective is to increase road throughput, the first commercial application of CACC is foreseen to be in truck platooning, since short distance following is expected to yield significant fuel savings in this case.

Distributed cooperative control of autonomous multi-agent UAV systems using smooth control

This paper addresses the cooperative control problem of multiple unmanned aerial vehicles(multi-UAV)systems.First,a new distributed consensus algorithm for second-order nonlinear multi-agent systems(MAS)is formulated under the leader-following approach.The algorithm provides smooth input signals to the agents’control channels,which avoids the chattering effect generated by the conventional sliding mode-based control protocols.Second,a new formation control scheme is developed by integrating smooth distributed consensus control protocols into the geometric pattern model to achieve three-dimensional formation tracking.The Lyapunov theory is used to prove the stability and convergence of both distributed consensus and formation controllers.The effectiveness of the proposed algorithms is demonstrated through simulation results.

Cooperative adaptive bidirectional control of a train platoon for efficient utility and string stability

This paper proposes cooperative adaptive control schemes for a train platoon to improve efficient utility and guarantee string stability. The control schemes are developed based on a bidirectional strategy, i.e., the information of proximal（preceding and following） trains is used in the controller design. Based on available proximal information（prox-info） of location, speed, and acceleration, a direct adaptive control is designed to maintain the tracking interval at the minimum safe distance. Based on available prox-info of location, an observer-based adaptive control is designed to achieve the same target, which alleviates the requirements of equipped sensors to measure prox-info of speed and acceleration. The developed schemes are capable of on-line estimating of the unknown system parameters and stabilizing the closed-loop system, the string stability of train platoon is guaranteed on the basis of Lyapunov stability theorem. Numerical simulation results are presented to verify the effectiveness of the proposed control laws.

Distributed Cooperative Control Algorithm for Multi-UAV Mission Rendezvous

Multiple unmanned aerial vehicles(UAVs)cooperative operation is the main form for UAVs fighting in battlefield,and multi-UAV mission rendezvous is the premise of cooperative reconnaissance and attack missions.We propose a rendezvous control strategy,which divides the rendezvous process into two parts:The loose formation rendezvous and the close formation rendezvous.In the first stage,UAVs are supposed to reach the specific target locations simultaneously and form a loose formation.A distributed control strategy based on first-order consensus algorithm is presented to achieve this goal.Then the second stage is designed based on the second-order consensus algorithm to complete the transition from the loose formation to the close formation.This process needs the speeds and heading angles of UAVs to reach an agreement.Besides,control algorithms with a virtual leader are proposed,by which the formation states can reach a specific value.Finally,simulation results show that the control algorithms are capable of realizing the mission rendezvous of multi-UAV and the consistence of UAVs′final states,which verify the effectiveness and feasibility of the designed control strategy.

Design and implementation of a leader-follower cooperative control system for unmanned helicopters

In this paper, we present a full scheme for the cooperative control of multiple unmanned aerial vehicle （UAV） helicopters. We adopt the leader-follower pattern to maintain a fixed geometrical formation while navigating the UAVs following certain trajectories. More specifically, the leader is commanded to fly on some predefined trajectories, and each follower is controlled to maintain its position in formation using the measurement of its inertial position and the information of the leader position and velocity, obtained through a wireless modem. More specifications are made for multiple UAV formation flight. In order to avoid possible collisions of UAV helicopters in the actual formation flight test, a collision avoidance scheme based on some predefined alert zones and protected zones is employed. Simulations and experimental results are presented to verify our design.

Distributed Cooperative Control of Battery Energy Storage Systems in DC Microgrids

The control of battery energy storage systems(BESSs)plays an important role in the management of microgrids.In this paper,the problem of balancing the state-ofcharge(SoC)of the networked battery units in a BESS while meeting the total charging/discharging power requirement is formulated and solved as a distributed control problem.Conditions on the communication topology among the battery units are established under which a control law is designed for each battery unit to solve the control problem based on distributed average reference power estimators and distributed average unit state estimators.Two types of estimators are proposed.One achieves asymptotic estimation and the other achieves finite time estimation.We show that,under the proposed control laws,SoC balancing of all battery units is achieved and the total charging/discharging power of the BESS tracks the desired power.A simulation example is shown to verify the theoretical results.

An Improved Cooperative Adaptive Cruise Control(CACC) Algorithm Considering Invalid Communication

For the Cooperative Adaptive Cruise Control （CACC） Algorithm, existing research studies mainly focus on how inter-vehicle communication can be used to develop CACC controller, the influence of the communication delays and lags of the actuators to the string stability. However, whether the string stability can be guaranteed when inter-vehicle communication is invalid partially has hardly been considered. This paper presents an improved CACC algorithm based on the sliding mode control theory and analyses the range of CACC controller parameters to maintain string stability. A dynamic model of vehicle spacing deviation in a platoon is then established, and the string stability conditions under improved CACC are analyzed. Unlike the traditional CACC algorithms, the proposed algorithm can ensure the functionality of the CACC system even if inter-vehicle communication is partially invalid. Finally, this paper establishes a platoon of five vehicles to simulate the improved CACC algorithm in MATLAB/Simulink, and the simulation results demonstrate that the improved CACC algorithm can maintain the string stability of a CACC platoon through adjusting the controller parameters and enlarging the spacing to prevent accidents. With guaranteed string stability, the proposed CACC algorithm can prevent oscillation of vehicle spacing and reduce chain collision accidents under real-world circumstances. This research proposes an improved CACC algorithm, which can guarantee the string stability when inter-vehicle communication is invalid.

Aircraft Landing Gear Control with Multi-Objective Optimization Using Generalized Cell Mapping

This paper presents a numerical algorithm tuning aircraft landing gear control system with three objectives,including reducing relative vibration, reducing hydraulic strut force and controlling energy consumption. Sliding mode control is applied to the vibration control of a simplified landing gear model with uncertainty. A two-stage generalized cell mapping algorithm is applied to search the Pareto set with gradient-free scheme. Drop test simulations over uneven runway show that the vibration and force interaction can be considerably reduced, and the Pareto optimum form a tight range in time domain.

Multi-UAV cooperative maneuver decision-making for pursuitevasion using improved MADRL

Aiming at the problem of multi-UAV pursuit-evasion confrontation, a UAV cooperative maneuver method based on an improved multi-agent deep reinforcement learning(MADRL) is proposed. In this method, an improved Comm Net network based on a communication mechanism is introduced into a deep reinforcement learning algorithm to solve the multi-agent problem. A layer of gated recurrent unit(GRU) is added to the actor-network structure to remember historical environmental states. Subsequently,another GRU is designed as a communication channel in the Comm Net core network layer to refine communication information between UAVs. Finally, the simulation results of the algorithm in two sets of scenarios are given, and the results show that the method has good effectiveness and applicability.

A cooperative control strategy of resistance spot welding process by combining the constant current control with the DRC method

The modeling control method based on the dynamic resistance characteristics of good nuggets, that is the DRC method, is an improvement on the dynamic resistance threshold method for the quality control of resistance spot welding. But there is still a control blind area in the initial four cycles. For this reason, the quality of every weld nugget could not be fully ensured. Thus a new fuzzy cooperative control method is put forward. It uses a multi-information time-control mechanism by combining the constant current control technology with the DRC method in a relay way. This whole-process control strategy has led to a good control effect and produced the dual-identical results in the weld nugget quality and the welding time.