Bidirectional parallel multi-branch convolution feature pyramid network for target detection in aerial images of swarm UAVs

In this paper,based on a bidirectional parallel multi-branch feature pyramid network(BPMFPN),a novel one-stage object detector called BPMFPN Det is proposed for real-time detection of ground multi-scale targets by swarm unmanned aerial vehicles(UAVs).First,the bidirectional parallel multi-branch convolution modules are used to construct the feature pyramid to enhance the feature expression abilities of different scale feature layers.Next,the feature pyramid is integrated into the single-stage object detection framework to ensure real-time performance.In order to validate the effectiveness of the proposed algorithm,experiments are conducted on four datasets.For the PASCAL VOC dataset,the proposed algorithm achieves the mean average precision(mAP)of 85.4 on the VOC 2007 test set.With regard to the detection in optical remote sensing(DIOR)dataset,the proposed algorithm achieves 73.9 mAP.For vehicle detection in aerial imagery(VEDAI)dataset,the detection accuracy of small land vehicle(slv)targets reaches 97.4 mAP.For unmanned aerial vehicle detection and tracking(UAVDT)dataset,the proposed BPMFPN Det achieves the mAP of 48.75.Compared with the previous state-of-the-art methods,the results obtained by the proposed algorithm are more competitive.The experimental results demonstrate that the proposed algorithm can effectively solve the problem of real-time detection of ground multi-scale targets in aerial images of swarm UAVs.

A Planning Method for Operational Test of UAV Swarm Based on Mission Reliability

The unmanned aerial vehicle(UAV)swarm plays an increasingly important role in the modern battlefield,and the UAV swarm operational test is a vital means to validate the combat effectiveness of the UAV swarm.Due to the high cost and long duration of operational tests,it is essential to plan the test in advance.To solve the problem of planning UAV swarm operational test,this study considers the multi-stage feature of a UAV swarm mission,composed of launch,flight and combat stages,and proposes a method to find test plans that can maximize mission reliability.Therefore,a multi-stage mission reliability model for a UAV swarm is proposed to ensure successful implementation of the mission.A multi-objective integer optimization method that considers both mission reliability and cost is then formulated to obtain the optimal test plans.This study first constructs a mission reliability model for the UAV swarm in the combat stage.Then,the launch stage and flight stage are integrated to develop a complete PMS(Phased Mission Systems)reliability model.Finally,the Binary Decision Diagrams(BDD)and Multi Objective Quantum Particle Swarm Optimization(MOQPSO)methods are proposed to solve the model.The optimal plans considering both reliability and cost are obtained.The proposed model supports the planning of UAV swarm operational tests and represents a meaningful exploration of UAV swarm test planning.

通信约束下UAV集群协同拦截任务分配算法

针对多无人机协同拦截多机动目标的任务分配问题,同时考虑到真实战场环境中存在的通信约束以及探测范围约束条件,本文提出了分步一致性拍卖算法(SCBAA)。首先,对真实战场环境中存在的通信约束以及探测范围约束等问题进行了描述分析,构建了多无人机协同拦截任务分配模型,设计了综合效能函数以及相应约束条件。其次,为解决多无人机协同打击单一目标的不平衡任务分配以及冲突消解问题,将原任务分配过程分为主要任务分配以及次要任务分配两部分,通过多次拍卖以及冲突消解实现多无人机对单一目标的任务分配。仿真结果表明,该算法可有效解决通信约束条件下的分布式多无人机协同拦截问题,并适应动态环境中任务分配对实时性的要求。

Optimal deployment of swarm positions in cooperative interception of multiple UAV swarms

In order to prevent the attacker from breaking through the blockade of the interception,deploying multiple Unmanned Aerial Vehicle(UAV)swarms on the interception line is a new combat style.To solve the optimal deployment of swarm positions in the cooperative interception,an optimal deployment optimization model is presented by minimizing the penetration zones'area and the analytical expression of the optimal deployment positions is deduced.Firstly,from the view of the attackers breaking through the interception line,the situations of vertical penetration and oblique penetration are analyzed respectively,and the mathematical models of penetration zones are obtained under the condition of a single UAV swarm and multiple UAV swarms.Secondly,based on the optimization goal of minimizing the penetration area,the optimal deployment optimization model for swarm positions is proposed,and the analytical solution of the optimal deployment is solved by using the convex programming theory.Finally,the proposed optimal deployment is compared with the uniform deployment and random deployment to verify the validity of the theoretical analysis.

Two-layer formation-containment fault-tolerant control of fixed-wing UAV swarm for dynamic target tracking

This paper tackles the formation-containment control problem of fixed-wing unmanned aerial vehicle(UAV)swarm with model uncertainties for dynamic target tracking in three-dimensional space in the faulty case of UAVs’actuator and sensor.The fixed-wing UAV swarm under consideration is organized as a“multi-leader-multi-follower”structure,in which only several leaders can obtain the dynamic target information while others only receive the neighbors’information through the communication network.To simultaneously realize the formation,containment,and dynamic target tracking,a two-layer control framework is adopted to decouple the problem into two subproblems:reference trajectory generation and trajectory tracking.In the upper layer,a distributed finite-time estimator(DFTE)is proposed to generate each UAV’s reference trajectory in accordance with the control objective.Subsequently,a distributed composite robust fault-tolerant trajectory tracking controller is developed in the lower layer,where a novel adaptive extended super-twisting(AESTW)algorithm with a finite-time extended state observer(FTESO)is involved in solving the robust trajectory tracking control problem under model uncertainties,actuator,and sensor faults.The proposed controller simultaneously guarantees rapidness and enhances the system’s robustness with fewer chattering effects.Finally,corresponding simulations are carried out to demonstrate the effectiveness and competitiveness of the proposed two-layer fault-tolerant cooperative control scheme.

DQN-based decentralized multi-agent JSAP resource allocation for UAV swarm communication

It is essential to maximize capacity while satisfying the transmission time delay of unmanned aerial vehicle(UAV)swarm communication system.In order to address this challenge,a dynamic decentralized optimization mechanism is presented for the realization of joint spectrum and power(JSAP)resource allocation based on deep Q-learning networks(DQNs).Each UAV to UAV(U2U)link is regarded as an agent that is capable of identifying the optimal spectrum and power to communicate with one another.The convolutional neural network,target network,and experience replay are adopted while training.The findings of the simulation indicate that the proposed method has the potential to improve both communication capacity and probability of successful data transmission when compared with random centralized assignment and multichannel access methods.

A cooperative detection game:UAV swarm vs.one fast intruder

This paper studies a special defense game using unmanned aerial vehicle(UAV)swarm against a fast intruder.The fast intruder applies an offensive strategy based on the artificial potential field method and Apollonius circle to scout a certain destination.As defenders,the UAVs are arranged into three layers:the forward layer,the midfield layer and the back layer.The co-defense mechanism,including the role derivation method of UAV swarm and a guidance law based on the co-defense front point,is introduced for UAV swarm to co-detect the intruder.Besides,five formations are designed for comparative analysis when ten UAVs are applied.Through Monte Carlo experiments and ablation experiment,the effectiveness of the proposed co-defense method has been verified.

Hybrid TDOA/FDOA and track optimization of UAV swarm based on A-optimality

The source location based on the hybrid time difference of arrival(TDOA)/frequency difference of arrival(FDOA) is a basic problem in wireless sensor networks, and the layout of sensors in the hybrid TDOA/FDOA positioning will greatly affect the accuracy of positioning. Using unmanned aerial vehicle(UAV) as base stations, by optimizing the trajectory of the UAV swarm, an optimal positioning configuration is formed to improve the accuracy of the target position and velocity estimation. In this paper, a hybrid TDOA/FDOA positioning model is first established, and the positioning accuracy of the hybrid TDOA/FDOA under different positioning configurations and different measurement errors is simulated by the geometric dilution of precision(GDOP) factor. Second, the Cramer-Rao lower bound(CRLB) matrix of hybrid TDOA/FDOA location under different moving states of the target is derived theoretically, the objective function of the track optimization is obtained, and the track of the UAV swarm is optimized in real time. The simulation results show that the track optimization effectively improves the accuracy of the target position and velocity estimation.

Deep reinforcement learning for UAV swarm rendezvous behavior

The unmanned aerial vehicle(UAV)swarm technology is one of the research hotspots in recent years.With the continuous improvement of autonomous intelligence of UAV,the swarm technology of UAV will become one of the main trends of UAV development in the future.This paper studies the behavior decision-making process of UAV swarm rendezvous task based on the double deep Q network(DDQN)algorithm.We design a guided reward function to effectively solve the problem of algorithm convergence caused by the sparse return problem in deep reinforcement learning(DRL)for the long period task.We also propose the concept of temporary storage area,optimizing the memory playback unit of the traditional DDQN algorithm,improving the convergence speed of the algorithm,and speeding up the training process of the algorithm.Different from traditional task environment,this paper establishes a continuous state-space task environment model to improve the authentication process of UAV task environment.Based on the DDQN algorithm,the collaborative tasks of UAV swarm in different task scenarios are trained.The experimental results validate that the DDQN algorithm is efficient in terms of training UAV swarm to complete the given collaborative tasks while meeting the requirements of UAV swarm for centralization and autonomy,and improving the intelligence of UAV swarm collaborative task execution.The simulation results show that after training,the proposed UAV swarm can carry out the rendezvous task well,and the success rate of the mission reaches 90%.

A Dual-Cluster-Head Based Medium Access Control for Large-Scale UAV Ad-Hoc Networks

Unmanned Aerial Vehicle(UAV)ad hoc network has achieved significant growth for its flexibility,extensibility,and high deployability in recent years.The application of clustering scheme for UAV ad hoc network is imperative to enhance the performance of throughput and energy efficiency.In conventional clustering scheme,a single cluster head(CH)is always assigned in each cluster.However,this method has some weaknesses such as overload and premature death of CH when the number of UAVs increased.In order to solve this problem,we propose a dual-cluster-head based medium access control(DCHMAC)scheme for large-scale UAV networks.In DCHMAC,two CHs are elected to manage resource allocation and data forwarding cooperatively.Specifically,two CHs work on different channels.One of CH is used for intra-cluster communication and the other one is for inter-cluster communication.A Markov chain model is developed to analyse the throughput of the network.Simulation result shows that compared with FM-MAC(flying ad hoc networks multi-channel MAC,FM-MAC),DCHMAC improves the throughput by approximately 20%~50%and prolongs the network lifetime by approximately 40%.

Security Enhancement of UAV Swarm Enabled Relaying Systems with Joint Beamforming and Resource Allocation

The high mobility of unmanned aerial vehicles(UAVs)could bring abundant degrees of freedom for the design of wireless communication systems,which results in that UAVs,especially UAV swarm,have attracted considerable attention.This paper considers a UAV Swarm enabled relaying communication system,where multiple UAV relays are organized via coordinated multiple points(CoMP)as a UAV swarm to enhance physical layer security of the system in the presence of an eavesdropper.In order to maximize achievable secrecy rate of downlink,we jointly optimize the beamforming vector of the virtual array shaped by the UAV swarm and bandwidth allocation on it for receiving and forwarding,and both amplify-and-forward(AF)and decode-andforward(DF)protocols are considered on the UAV swarm.Due to the non-convexity of the joint optimization problem,we propose an alternating optimization(AO)algorithm to decompose it into two subproblems utilizing block coordinate descent technique,then each subproblem is solved by successive convex optimization method.Simulation results demonstrate that DF has competitive performance advantage compared with AF and the superiority of the proposed secure transmission strategy with optimal beamforming and bandwidth allocation compared with benchmark strategies.

Cooperative Search of UAV Swarm Based on Ant Colony Optimization with Artificial Potential Field

An ant colony optimization with artificial potential field(ACOAPF)algorithm is proposed to solve the cooperative search mission planning problem of unmanned aerial vehicle(UAV)swarm.This algorithm adopts a distributed architecture where each UAV is considered as an ant and makes decision autonomously.At each decision step,the ants choose the next gird according to the state transition rule and update its own artificial potential field and pheromone map based on the current search results.Through iterations of this process,the cooperative search of UAV swarm for mission area is realized.The state transition rule is divided into two types.If the artificial potential force is larger than a threshold,the deterministic transition rule is adopted,otherwise a heuristic transition rule is used.The deterministic transition rule can ensure UAVs to avoid the threat or approach the target quickly.And the heuristics transition rule considering the pheromone and heuristic information ensures the continuous search of area with the goal of covering more unknown area and finding more targets.Finally,simulations are carried out to verify the effectiveness of the proposed ACOAPF algorithm for cooperative search mission of UAV swarm.

Self-organized search-attack mission planning for UAV swarm based on wolf pack hunting behavior

Cooperative search-attack is an important application of unmanned aerial vehicle(UAV)swarm in military field.The coupling between path planning and task allocation,the heterogeneity of UAVs,and the dynamic nature of task environment greatly increase the complexity and difficulty of the UAV swarm cooperative search-attack mission planning problem.Inspired by the collaborative hunting behavior of wolf pack,a distributed selforganizing method for UAV swarm search-attack mission planning is proposed.First,to solve the multi-target search problem in unknown environments,a wolf scouting behavior-inspired cooperative search algorithm for UAV swarm is designed.Second,a distributed self-organizing task allocation algorithm for UAV swarm cooperative attacking of targets is proposed by analyzing the flexible labor division behavior of wolves.By abstracting the UAV as a simple artificial wolf agent,the flexible motion planning and group task coordinating for UAV swarm can be realized by self-organizing.The effectiveness of the proposed method is verified by a set of simulation experiments,the stability and scalability are evaluated,and the integrated solution for the coupled path planning and task allocation problems for the UAV swarm cooperative search-attack task can be well performed.

TDOA and track optimization of UAV swarm based on D-optimality

To solve the problem of time difference of arrival(TDOA)positioning and tracking of targets by the unmanned aerial vehicles(UAV)swarm in future air combat,this paper adopts the TDOA positioning method and uses time difference sensors of the UAV swarm to locate target radiation sources.Firstly,a TDOA model for the target is set up for the UAV swarm under the condition that the error variance varies with the received signal-to-noise ratio.The accuracy of the positioning error is analyzed by geometric dilution of precision(GDOP).The D-optimality criterion of the positioning model is theoretically derived.The target is positioned and settled,and the maximum value of the Fisher information matrix determinant is used as the optimization objective function to optimize the track of the UAV in real time.Simulation results show that the track optimization improves the positioning accuracy and stability of the UAV swarm to the target.

Bibliometric analysis of UAV swarms

Projects on unmanned aerial vehicle(UAV) swarms have been initiated in a big way in the last few years, especially from 2015 to 2016. As a result, the number of related works on UAV swarms has been on the rise, with the rate of growth dramatically accelerating since 2017. This research conducts a bibliometric analysis of robotics swarms and UAV swarms to answer the following questions:(i) Disciplines mentioned in the UAV swarms research.(ii) The future development trends and hotspots in the UAV swarms research.(iii) Tracking related outcomes in the UAV swarms research.

基于改进球面向量粒子群优化的UAV航迹规划

针对无人机在复杂环境下受到多种威胁时的航迹规划问题,提出一种改进的基于球面向量的粒子群优化算法(ISPSO)。利用融合压缩因子和异步变化学习因子的ISPSO算法,通过粒子位置和速度同无人机转角和爬升角的对应关系,高效地搜索无人机的构形空间,找到成本函数最小的最优路径。为了评估ISPSO的性能,从真实的数字高程模型地图中生成2个基准场景,仿真结果表明,该算法优于基于球面向量的粒子群算法。

面向林业资源防护的CGPSO算法UAV航迹优化应用研究

针对传统PSO无人机航迹规划算法在林业资源防护任务中存在收敛速度慢、易陷入局部最优的问题,提出了一种基于CGPSO的无人机航迹优化算法(cauchy gauss particle swarm optimization, CGPSO)。借助雷达传感器对林间环境进行预检,构建了无人机飞行任务环境模型;引入了自适应惯性权重和融合柯西-高斯变异算子调整粒子群算法,平衡全局-局部收敛速度,优化局部极值问题;综合分析了无人机航迹长度代价、障碍物碰撞代价和高程范围代价,建立了航迹规划适应度函数。仿真结果显示,所规划算法适应度标准差达到了0.148 6,用时54.34 s,相比PSO算法,收敛代价值减少了42%,用时提升了25%,与所有算法相比,整体航迹具有较强的鲁棒性,对环境的适应性更优。因此,采用新规划航迹算法在林区进行林业资源防护工作是可行的。

A UAV collaborative defense scheme driven by DDPG algorithm

The deep deterministic policy gradient(DDPG)algo-rithm is an off-policy method that combines two mainstream reinforcement learning methods based on value iteration and policy iteration.Using the DDPG algorithm,agents can explore and summarize the environment to achieve autonomous deci-sions in the continuous state space and action space.In this paper,a cooperative defense with DDPG via swarms of unmanned aerial vehicle(UAV)is developed and validated,which has shown promising practical value in the effect of defending.We solve the sparse rewards problem of reinforcement learning pair in a long-term task by building the reward function of UAV swarms and optimizing the learning process of artificial neural network based on the DDPG algorithm to reduce the vibration in the learning process.The experimental results show that the DDPG algorithm can guide the UAVs swarm to perform the defense task efficiently,meeting the requirements of a UAV swarm for non-centralization,autonomy,and promoting the intelligent development of UAVs swarm as well as the decision-making process.

改进粒子群算法的UAV突防路径规划

面对复杂地形条件下的无人机突防任务,粒子群算法(PSO)在寻找最优路径的过程中易陷入局部最优、搜索时间过长等困境。针对上述问题,在PSO中引入球坐标系,将所得的路径看作向量。通过向量的距离、仰角和方位角与无人机的速度、俯仰角和转向角的相互关系来实现粒子的迭代更新。最后,引入随机自适应惯性权重,弥补粒子前期局部搜索能力与后期全局搜索能力的不足。仿真结果表明,改进算法能够有效规避威胁区域,收敛速度更快,收敛精度更高,且不易陷入局部最优。

改进粒子群算法的城市环境下UAV航迹规划

良好的航迹规划可以极大提升无人机的工作效率。针对城市复杂的低空环境对无人机航迹规划的限制,提出了一种改进粒子群算法的三维航迹规划方法。首先利用栅格法进行城市环境建模,将无人机航迹规划问题转化至易于处理的抽象空间;其次,根据粒子群算法的特点,对粒子群的初始化引入自适应机制;采用自适应惯性权重与自适应指数学习因子;为粒子群的更新引入牵引加速度;然后以无人机运行效率和运行风险为目标,结合无人机运行约束构建目标航迹规划模型;与传统遗传算法和传统粒子群算法进行对比仿真,验证了改进后算法所求解的质量更好。