基于深度强化学习的无人机自组网路由算法

Reinforcement learning based routing algorithm for UAV ad-hoc networks

针对无人机自组网节点密度大、拓扑变换频繁,导致移动自组网复杂的问题,提出了一种基于深度强化学习(deep-reinforcement learning,DRL)的分布式无人机自组网路由算法。利用DRL感知学习无人机特征,使节点不断与环境交互、探索学习最优行动(路由)策略;通过存储经验知识,维护端到端路由,赋予无人机网络智能化重构和快速修复的能力,从而提高路径的稳定性,降低路由建立和维护开销,增强网络的鲁棒性能。仿真结果表明,提出的算法具有较好的收敛性能;在路由修复时间、端到端时延,以及网络适应性、扩展性方面都优于传统的路由算法。

Aiming at the problem that the density of nodes in UAV ad hoc network is large and the topology transformation is frequent,which leads to the complexity of mobile ad hoc network,a distributed UAV ad hoc network routing algorithm based on deep reinforcement learning(DRL)is proposed.Using DRL perception to learn the characteristics of UAV,the node can continuously interact with the environment and explore and learn the optimal action(routing)strategy.By storing experience knowledge and maintaining end-to-end routes,the UAV network is endowed with the ability of intelligent reconfiguration and rapid repair,thus improving the stability of the path,reducing the cost of route establishment and maintenance,and enhancing the robustness of the network.Simulation results show that the proposed algorithm has good convergence performance.It is superior to traditional routing algorithms in routing repair time,end-to-end delay,network adaptability and scalability.