基于双层强化学习的干扰策略与干扰波形优化设计

Optimization Design of Interference Strategy and Interference Waveform Based on Two-layer Reinforcement Learning

针对干扰策略与干扰波形联合优化设计问题,提出了一种基于双层强化学习的干扰策略与间歇采样转发干扰波形人工智能优化设计方法。该方法通过建立基于双层强化学习的干扰决策模型,外层利用Q学习(Q-learning)算法,基于雷达工作模式识别对干扰策略进行人工智能优化,内层利用深度Q学习网络(deep Q-leaning network,DQN)对非均匀间歇采样转发干扰波形进行人工智能优化,从而将一个干扰策略与相干干扰波形优化的二维决策问题转换为两个一维决策问题。仿真实验表明:该模型对于未知且复杂的电磁环境具有良好的自适应能力,为多层强化学习网络应用于复杂干扰决策场景提供了一种可行的解决方案。

Aiming at the problem of joint optimization design of interference strategy and interference waveform,an artificial intelligence optimization design method of interference strategy and intermittent sampling and forwarding interference waveform based on two-layer reinforcement learning was proposed.In this method,an interference decision-making model based on two-layer reinforcement learning was established,the outer layer employed the Qlearning algorithm,conducting artificial intelligence optimization on the basis of radar working mode recognition for interference strategies,meanwhile,the inner layer utilized a deep Q-learning network(DQN)for artificial intelligence optimization of non-uniform intermittent sampling and forwarding interference waveforms.Therefore,a two-dimensional decision problem of interference strategy and coherent interference waveform optimization design was transformed into two one-dimensional decision problems.Simulation experiments show that the model has good adaptive ability for unknown and complex electromagnetic environments,which provides a feasible solution for multi-layer reinforcement learning network to be applied to complex interference decision-making scenarios.