基于多智能体深度强化学习的空战博弈对抗策略训练模型

Game Confrontation Strategy Training Model for Air Combat Based onMulti⁃agent Deep Reinforcement Learning

鉴于多智能体深度强化学习在解决蜂群系统、能源分配和大型团队策略游戏等高维复杂动作空间以及多智能体决策问题中的良好表现,提出了一种基于多智能体深度强化学习的空战博弈对抗策略训练模型。在对多智能体深度强化学习基本概念和对空战策略生成的可行性分析的基础上,建立了基于多智能体马尔可夫决策过程空战配合策略的框架,从而生成最优对抗策略。实践表明,该模型可生成多种双机联合对抗策略,具有较高的研究价值和实际意义。

In view of the good performance of multi-agent deep reinforcement learning in solving the high-dimensional complex action space and multi-agent decision problems,such as the swarm systems,the energy distribution and the large team strategy games,a game confrontation strategy training model for air combat based on multi-agent deep reinforcement learning is proposed.Based on the analysis of the basic concept of multi-agent deep reinforcement learning and the feasibility of air combat strategy generation,the air combat coordination strategy framework of multi-agent Markov decision process is established to generate the optimal confrontation strategy.The practice shows that the model can generate a variety of dual-fighters joint confrontation strategies,thus has high research value and practical significance.