基于函数逼近的强化学习FANET路由优化算法

Optimized FANET Routing Algorithm with Reinforcement Learning Based on Function Approximation

针对高速移动状态下的飞行自组网路由协议链路维护困难问题,提出一种基于强化学习的自适应链路状态路由优化算法QLA-OLSR。借鉴强化学习中的Q学习算法,通过感知动态环境下节点邻居数量变化和业务负载程度,构建价值函数求解最优HELLO时隙,提高节点链路发现与维护能力。利用优化Kanerva编码算法的状态相似度机制,降低QLA-OLSR算法复杂度并增强稳定性。仿真结果表明,QLA-OLSR算法能有效提升网络吞吐量,减少路由维护开销,且具有自学习特性,适用于高动态环境下的飞行自组网。

The high-speed movement of nodes in Flying Ad-Hoc Network(FANET)has caused difficulties in maintaining the links of the FANET routing protocol.To address the problem,an algorithm named QLA-OLSR is proposed based on Reinforcement Learning(RL)for adaptive optimization of link state routing.By sensing the changing number of the node neighbors and the service loads in the dynamic environment,the Q-learning algorithm in RL is used to construct a value function.On this basis,the optimal HELLO time slot is solved to improve the performance of the node in link detection and maintenance.Then the State Similarity Mechanism(SSM)of the improved Kanerva coding algorithm is used to reduce the complexity of the algorithm while increasing its stability.Simulation results show that the QLA-OLSR algorithm can significantly improve the network throughput,reduce the overhead of routine maintenance,and is capable of self-learning.It is suitable for FANET in a highly dynamic environment.