Resilience-driven cooperative reconfiguration strategy for unmanned weapon system-of-systems

As the unmanned weap system-of systems(UWSoS)becomes complex,the inevitable uncertain interference gradu-ally increases,which leads to a strong emphasis on the resilience of UWSoS.Hence,this paper presents a resilience-driven cooperative reconfiguration strategy to enhance the resilience of UWSoS.First,a unified resilience-driven coopera-tive reconfiguration strategy framework is designed to guide the UWSoS resilience enhancement.Subsequently,a cooperative reconfiguration strategy algorithm is proposed to identify the optimal cooperative reconfiguration sequence,combining the cooperative pair resilience contribution index(CPRCI)and coop-erative pair importance index(CPII).At last,the effectiveness and superiority of the proposed algorithm are demonstrated through various attack scenario simulations that include differ-ent attack modes and intensities.The analysis results can pro-vide a reference for decision-makers to manage UWSoS.

Design and implementation of a leader-follower cooperative control system for unmanned helicopters

In this paper, we present a full scheme for the cooperative control of multiple unmanned aerial vehicle （UAV） helicopters. We adopt the leader-follower pattern to maintain a fixed geometrical formation while navigating the UAVs following certain trajectories. More specifically, the leader is commanded to fly on some predefined trajectories, and each follower is controlled to maintain its position in formation using the measurement of its inertial position and the information of the leader position and velocity, obtained through a wireless modem. More specifications are made for multiple UAV formation flight. In order to avoid possible collisions of UAV helicopters in the actual formation flight test, a collision avoidance scheme based on some predefined alert zones and protected zones is employed. Simulations and experimental results are presented to verify our design.

Formation and adjustment of manned/unmanned combat aerial vehicle cooperative engagement system

Manned combat aerial vehicles （MCAVs）, and un-manned combat aerial vehicles （UCAVs） together form a cooper-ative engagement system to carry out operational mission, whichwill be a new air engagement style in the near future. On the basisof analyzing the structure of the MCAV/UCAV cooperative engage-ment system, this paper divides the unique system into three hi-erarchical levels, respectively, i.e., mission level, task-cluster leveland task level. To solve the formation and adjustment problem ofthe latter two levels, three corresponding mathematical modelsare established. To solve these models, three algorithms calledquantum artificial bee colony （QABC） algorithm, greedy strategy（GS） and two-stage greedy strategy （TSGS） are proposed. Finally,a series of simulation experiments are designed to verify the effec-tiveness and superiority of the proposed algorithms.

Cooperative multi-target hunting by unmanned surface vehicles based on multi-agent reinforcement learning

To solve the problem of multi-target hunting by an unmanned surface vehicle(USV)fleet,a hunting algorithm based on multi-agent reinforcement learning is proposed.Firstly,the hunting environment and kinematic model without boundary constraints are built,and the criteria for successful target capture are given.Then,the cooperative hunting problem of a USV fleet is modeled as a decentralized partially observable Markov decision process(Dec-POMDP),and a distributed partially observable multitarget hunting Proximal Policy Optimization(DPOMH-PPO)algorithm applicable to USVs is proposed.In addition,an observation model,a reward function and the action space applicable to multi-target hunting tasks are designed.To deal with the dynamic change of observational feature dimension input by partially observable systems,a feature embedding block is proposed.By combining the two feature compression methods of column-wise max pooling(CMP)and column-wise average-pooling(CAP),observational feature encoding is established.Finally,the centralized training and decentralized execution framework is adopted to complete the training of hunting strategy.Each USV in the fleet shares the same policy and perform actions independently.Simulation experiments have verified the effectiveness of the DPOMH-PPO algorithm in the test scenarios with different numbers of USVs.Moreover,the advantages of the proposed model are comprehensively analyzed from the aspects of algorithm performance,migration effect in task scenarios and self-organization capability after being damaged,the potential deployment and application of DPOMH-PPO in the real environment is verified.

Assessment of Meteorological Threats to the Coordinated Search and Rescue of Unmanned/Manned Aircraft

The architecture and working principle of coordinated search and rescue system of unmanned/manned aircraft,which is composed of manned/unmanned aircraft and manned aircraft,were first introduced,and they can cooperate with each other to complete a search and rescue task.Secondly,a threat assessment method based on meteorological data was proposed,and potential meteorological threats,such as storms and rainfall,can be predicted by collecting and analyzing meteorological data.Finally,an experiment was carried out to evaluate the performance of the proposed method in different scenarios.The experimental results show that the coordinated search and rescue system of unmanned/manned aircraft can be used to effectively assess meteorological threats and provide accurate search and rescue guidance.

Joint waveform selection and power allocation algorithm in manned/unmanned aerial vehicle hybrid swarm based on chance-constraint programming

In this paper, we propose a joint waveform selection and power allocation(JWSPA) strategy based on chance-constraint programming(CCP) for manned/unmanned aerial vehicle hybrid swarm(M/UAVHS) tracking a single target. Accordingly,the low probability of intercept(LPI) performance of system can be improved by collaboratively optimizing transmit power and waveform. For target radar cross section(RCS) prediction, we design a random RCS prediction model based on electromagnetic simulation(ES) of target. For waveform selection, we build a waveform library to adaptively manage the frequency modulation slope and pulse width of radar waveform. For power allocation,the CCP is employed to balance tracking accuracy and power resource. The Bayesian Cramér-Rao lower bound(BCRLB) is adopted as a criterion to measure target tracking accuracy. The hybrid intelli gent algorithms, in which the stochastic simulation is integrated into the genetic algorithm(GA), are used to solve the stochastic optimization problem. Simulation results demonstrate that the proposed JWSPA strategy can save more transmit power than the traditional fixed waveform scheme under the same target tracking accuracy.

Cooperative UAV search strategy based on DMPC-AACO algorithm in restricted communication scenarios

Improvement of integrated battlefield situational awareness in complex environments involving dynamic factors such as restricted communications and electromagnetic interference(EMI)has become a contentious research problem.In certain mission environments,due to the impact of many interference sources on real-time communication or mission requirements such as the need to implement communication regulations,the mission stages are represented as a dynamic combination of several communication-available and communication-unavailable stages.Furthermore,the data interaction between unmanned aerial vehicles(UAVs)can only be performed in specific communication-available stages.Traditional cooperative search algorithms cannot handle such situations well.To solve this problem,this study constructed a distributed model predictive control(DMPC)architecture for a collaborative control of UAVs and used the Voronoi diagram generation method to re-plan the search areas of all UAVs in real time to avoid repetition of search areas and UAV collisions while improving the search efficiency and safety factor.An attention mechanism ant-colony optimization(AACO)algorithm is proposed for UAV search-control decision planning.The search strategy is adaptively updated by introducing an attention mechanism for regular instruction information,a priori information,and emergent information of the mission to satisfy different search expectations to the maximum extent.Simulation results show that the proposed algorithm achieves better search performance than traditional algorithms in restricted communication constraint scenarios.

Cooperative Anti-Jamming and Interference Mitigation for UAV Networks: A Local Altruistic Game Approach

To improve the anti-jamming and interference mitigation ability of the UAV-aided communication systems, this paper investigates the channel selection optimization problem in face of both internal mutual interference and external malicious jamming. A cooperative anti-jamming and interference mitigation method based on local altruistic is proposed to optimize UAVs’ channel selection. Specifically, a Stackelberg game is modeled to formulate the confrontation relationship between UAVs and the jammer. A local altruistic game is modeled with each UAV considering the utilities of both itself and other UAVs. A distributed cooperative anti-jamming and interference mitigation algorithm is proposed to obtain the Stackelberg equilibrium. Finally, the convergence of the proposed algorithm and the impact of the transmission power on the system loss value are analyzed, and the anti-jamming performance of the proposed algorithm can be improved by around 64% compared with the existing algorithms.

Intervention decision-making in MAV/UAV cooperative engagement based on human factors engineering

Aiming at the intervention decision-making problem in manned/unmanned aerial vehicle（MAV/UAV） cooperative engagement, this paper carries out a research on allocation strategy of emergency discretion based on human factors engineering（HFE）.Firstly, based on the brief review of research status of HFE, it gives structural description to emergency in the process of cooperative engagement and analyzes intervention of commanders. After that,constraint conditions of intervention decision-making of commanders based on HFE（IDMCBHFE） are given, and the mathematical model, which takes the overall efficiency value of handling emergencies as the objective function, is established. Then, through combining K-best and variable neighborhood search（VNS） algorithm, a K-best optimization variable neighborhood search mixed algorithm（KBOVNSMA） is designed to solve the model. Finally,through three groups of simulation experiments, effectiveness and superiority of the proposed algorithm are verified.

Unmanned air/ground vehicles heterogeneous cooperative techniques:Current status and prospects

Multiple unmanned air/ground vehicles heterogeneous cooperation is a novel and challenging filed.Heterogeneous cooperative techniques can widen the application fields of unmanned air or ground vehicles,and enhance the effectiveness of implementing detection,search and rescue tasks.This paper mainly focused on the key issues in multiple unmanned air/ground vehicles heterogeneous cooperation,including heterogeneous flocking,formation control,formation stability,network control,and actual applications.The main problems and future directions in this field were also analyzed in detail.These innovative technologies can significantly enhance the effectiveness of implementing complicated tasks,which definitely provide a series of novel breakthroughs for the intelligence,integration and advancement of future robot systems.

Cooperative task assignment of multiple heterogeneous unmanned aerial vehicles using a modifed genetic algorithm with multi-type genes

The task assignment problem of multiple heterogeneous unmanned aerial vehicles （UAVs）, concerned with cooperative decision making and control, is studied in this paper. The heterogeneous vehicles have different operational capabilities and kinematic constraints, and carry limited resources （e.g., weapons） onboard. They are designated to perform multiple consecutive tasks cooperatively on multiple ground targets. The problem becomes much more complicated because of these terms of heterogeneity. In order to tackle the challenge, we modify the former genetic algorithm with multi-type genes to stochastically search a best solution. Genes of chromo- somes are different, and they are assorted into several types according to the tasks that must be performed on targets. Different types of genes are processed specifically in the improved genetic operators including initialization, crossover, and mutation. We also present a mirror representation of vehicles to deal with the limited resource constraint. Feasible chromosomes that vehicles could perform tasks using their limited resources under the assignment are created and evolved by genetic operators. The effect of the proposed algorithm is demonstrated in numerical simulations. The results show that it effectively provides good feasible solutions and finds an optimal one.

Cooperative task allocation for heterogeneous multi-UAV using multi-objective optimization algorithm

The application of multiple UAVs in complicated tasks has been widely explored in recent years.Due to the advantages of flexibility,cheapness and consistence,the performance of heterogeneous multi-UAVs with proper cooperative task allocation is superior to over the single UAV.Accordingly,several constraints should be satisfied to realize the efficient cooperation,such as special time-window,variant equipment,specified execution sequence.Hence,a proper task allocation in UAVs is the crucial point for the final success.The task allocation problem of the heterogeneous UAVs can be formulated as a multi-objective optimization problem coupled with the UAV dynamics.To this end,a multi-layer encoding strategy and a constraint scheduling method are designed to handle the critical logical and physical constraints.In addition,four optimization objectives:completion time,target reward,UAV damage,and total range,are introduced to evaluate various allocation plans.Subsequently,to efficiently solve the multi-objective optimization problem,an improved multi-objective quantum-behaved particle swarm optimization(IMOQPSO)algorithm is proposed.During this algorithm,a modified solution evaluation method is designed to guide algorithmic evolution;both the convergence and distribution of particles are considered comprehensively;and boundary solutions which may produce some special allocation plans are preserved.Moreover,adaptive parameter control and mixed update mechanism are also introduced in this algorithm.Finally,both the proposed model and algorithm are verified by simulation experiments.

Distributed Cooperative Control Algorithm for Multi-UAV Mission Rendezvous

Multiple unmanned aerial vehicles(UAVs)cooperative operation is the main form for UAVs fighting in battlefield,and multi-UAV mission rendezvous is the premise of cooperative reconnaissance and attack missions.We propose a rendezvous control strategy,which divides the rendezvous process into two parts:The loose formation rendezvous and the close formation rendezvous.In the first stage,UAVs are supposed to reach the specific target locations simultaneously and form a loose formation.A distributed control strategy based on first-order consensus algorithm is presented to achieve this goal.Then the second stage is designed based on the second-order consensus algorithm to complete the transition from the loose formation to the close formation.This process needs the speeds and heading angles of UAVs to reach an agreement.Besides,control algorithms with a virtual leader are proposed,by which the formation states can reach a specific value.Finally,simulation results show that the control algorithms are capable of realizing the mission rendezvous of multi-UAV and the consistence of UAVs′final states,which verify the effectiveness and feasibility of the designed control strategy.

Cooperative localization against GPS signal loss in multiple UAVs flight

Based on multiple unmanned aerial vehicles（UAVs） flight at a constant altitude,a fault-tolerant cooperative localization algorithm against global positioning system（GPS） signal loss due to GPS receiver malfunction is proposed.Contrast to the traditional means with single UAV,the proposed method is based on the use of inter-UAV relative range measurements against GPS signal loss and more suitable for the small-size and low-cost UAV applications.Firstly,for re-localizing an UAV with a malfunction in its GPS receiver,an algorithm which makes use of any other three healthy UAVs in the cooperative flight as the reference points for re-localization is proposed.Secondly,by using the relative ranges from the faulty UAV to the other three UAVs,its horizontal location can be determined after the GPS signal is lost.In order to improve an accuracy of the localization,a Kalman filter is further exploited to provide the estimated location of the UAV with the GPS signal loss.The Kalman filter calculates the variance of observations in terms of horizontal dilution of positioning（HDOP） automatically.Then,during each discrete computing time step,the best reference points are selected adaptively by minimizing the HDOP.Finally,two simulation examples in Matlab/Simulink environment with five UAVs in cooperative flight are shown to evaluate the effectiveness of the proposed method.

A review of cooperative path planning of an unmanned aerial vehicle group

As a cutting-edge branch of unmanned aerial vehicle(UAV)technology,the cooperation of a group of UAVs has attracted increasing attention from both civil and military sectors,due to its remarkable merits in functionality and flexibility for accomplishing complex extensive tasks,e.g.,search and rescue,fire-fighting,reconnaissance,and surveillance.Cooperative path planning(CPP)is a key problem for a UAV group in executing tasks collectively.In this paper,an attempt is made to perform a comprehensive review of the research on CPP for UAV groups.First,a generalized optimization framework of CPP problems is proposed from the viewpoint of three key elements,i.e.,task,UAV group,and environment,as a basis for a comprehensive classification of different types of CPP problems.By following the proposed framework,a taxonomy for the classification of existing CPP problems is proposed to describe different kinds of CPPs in a unified way.Then,a review and a statistical analysis are presented based on the taxonomy,emphasizing the coordinative elements in the existing CPP research.In addition,a collection of challenging CPP problems are provided to highlight future research directions.

A review on fault-tolerant cooperative control of multiple unmanned aerial vehicles

This paper presents the recent developments in Fault-Tolerant Cooperative Control(FTCC)of multiple unmanned aerial vehicles(multi-UAVs).To facilitate the analyses of FTCC methods for multi-UAVs.the formation control strategies under fault-free flight conditions of multi-UAVs are first summarized and analyzed,including the leader-following,behavior-based,virtual structure,collision avoidance,algebraic graph-based,and close formation control methods,which are viewed as the cooperative control methods for multi-UAVs at the pre-fault stage.Then,by considering the various faults encountered by the multi-UAVs,the state-of-the-art developments on individual,leader-following,and distributed FTCC schemes for multi-UAVs are reviewed in detail.Finally,conclusions and challenging issues towards future developments are presented.

Cooperative Search of UAV Swarm Based on Ant Colony Optimization with Artificial Potential Field

An ant colony optimization with artificial potential field(ACOAPF)algorithm is proposed to solve the cooperative search mission planning problem of unmanned aerial vehicle(UAV)swarm.This algorithm adopts a distributed architecture where each UAV is considered as an ant and makes decision autonomously.At each decision step,the ants choose the next gird according to the state transition rule and update its own artificial potential field and pheromone map based on the current search results.Through iterations of this process,the cooperative search of UAV swarm for mission area is realized.The state transition rule is divided into two types.If the artificial potential force is larger than a threshold,the deterministic transition rule is adopted,otherwise a heuristic transition rule is used.The deterministic transition rule can ensure UAVs to avoid the threat or approach the target quickly.And the heuristics transition rule considering the pheromone and heuristic information ensures the continuous search of area with the goal of covering more unknown area and finding more targets.Finally,simulations are carried out to verify the effectiveness of the proposed ACOAPF algorithm for cooperative search mission of UAV swarm.

Markov decision evolutionary game theoretic learning for cooperative sensing of unmanned aerial vehicles

As one of the major contributions of biology to competitive decision making, evolutionary game theory provides a useful tool for studying the evolution of cooperation. To achieve the optimal solution for unmanned aerial vehicles （UAVs） that are car- rying out a sensing task, this paper presents a Markov decision evolutionary game （MDEG） based learning algorithm. Each in- dividual in the algorithm follows a Markov decision strategy to maximize its payoff against the well known Tit-for-Tat strate- gy. Simulation results demonstrate that the MDEG theory based approach effectively improves the collective payoff of the roam. The proposed algorithm can not only obtain the best action sequence but also a sub-optimal Markov policy that is inde- pendent of the game duration. Furthermore, the paper also studies the emergence of cooperation in the evolution of self-regarded UAVs. The results show that it is the adaptive ability of the MDEG based approach as well as the perfect balance between revenge and forgiveness of the Tit-for-Tat strategy that the emergence of cooperation should be attributed to.

A Multi-UCAV cooperative occupation method based on weapon engagement zones for beyond-visual-range air combat

Recent advances in on-board radar and missile capabilities,combined with individual payload limitations,have led to increased interest in the use of unmanned combat aerial vehicles(UCAVs)for cooperative occupation during beyond-visual-range(BVR)air combat.However,prior research on occupational decision-making in BVR air combat has mostly been limited to one-on-one scenarios.As such,this study presents a practical cooperative occupation decision-making methodology for use with multiple UCAVs.The weapon engagement zone(WEZ)and combat geometry were first used to develop an advantage function for situational assessment of one-on-one engagement.An encircling advantage function was then designed to represent the cooperation of UCAVs,thereby establishing a cooperative occupation model.The corresponding objective function was derived from the one-on-one engagement advantage function and the encircling advantage function.The resulting model exhibited similarities to a mixed-integer nonlinear programming(MINLP)problem.As such,an improved discrete particle swarm optimization(DPSO)algorithm was used to identify a solution.The occupation process was then converted into a formation switching task as part of the cooperative occupation model.A series of simulations were conducted to verify occupational solutions in varying situations,including two-on-two engagement.Simulated results showed these solutions varied with initial conditions and weighting coefficients.This occupation process,based on formation switching,effectively demonstrates the viability of the proposed technique.These cooperative occupation results could provide a theoretical framework for subsequent research in cooperative BVR air combat.

Adaptive cooperative secure control of networked multiple unmanned systems under FDI attacks

With the expanding applications of multiple unmanned systems in various fields,more and more research attention has been paid to their security.The aim is to enhance the anti-interference ability,ensure their reliability and stability,and better serve human society.This article conducts adaptive cooperative secure tracking consensus of networked multiple unmanned systems subjected to false data injection attacks.From a practical perspective,each unmanned system is modeled using high-order unknown nonlinear discrete-time systems.To reduce the communication bandwidth between agents,a quantizer-based codec mechanism is constructed.This quantizer uses a uniform logarithmic quantizer,combining the advantages of both quantizers.Because the transmission information attached to the false data can affect the accuracy of the decoder,a new adaptive law is added to the decoder to overcome this difficulty.A distributed controller is devised in the backstepping framework.Rigorous mathematical analysis shows that our proposed control algorithms ensure that all signals of the resultant systems remain bounded.Finally,simulation examples reveal the practical utility of the theoretical analysis.