基于深度强化学习的有源中点钳位逆变器效率优化设计

Efficiency Optimized Design of Active Neutral Point Clamped Inverter Based on Deep Reinforcement Learning

传统电力电子变换器设计多采用顺序设计法,依赖人工经验。近年来,电力电子自动化设计可通过计算机快速优化设计电力电子系统而备受关注。该文以有源中点钳位(ANPC)逆变器的效率优化设计为例,提出一种基于深度强化学习(DRL)的电力电子自动化设计方法,可实现在变换器设计需求变化时,根据设计目标快速得到最优的设计参数。首先介绍了基于DRL的逆变器效率优化整体框架;然后建立了逆变器的效率模型;接着通过深度确定性策略梯度(DDPG)算法的自学习不断训练智能体,获得了最小化功率损耗的优化策略,该策略能够快速响应设计规格变化提供最大化效率的设计变量;最后,搭建了140 kW的实验样机,实验结果验证了所提方法的有效性,相比于遗传算法和强化学习(RL),实测效率分别提高了0.025%和0.025%。

The traditional power electronic converter design adopts mostly the sequential design method,which relies on manual experience.In recent years,power electronics automation design has attracted much attention by optimizing rapidly the design of power electronic systems with computers.Taking the efficiency optimized design of Active Neutral Point Clamped(ANPC)inverter as an example,a power electronics automation design method based on Deep Reinforcement Learning(DRL)is proposed,which can realize quickly to obtain the optimal design parameters according to the design objectives when the design requirements of converter change.Firstly,the overall framework of inverter efficiency optimization based on DRL is introduced;Then the efficiency model of the inverter is established;After that the agent is continuously trained through the self-learning of the Deep Deterministic Policy Gradient(DDPG)algorithm,and an optimization strategy that minimizes power loss is obtained;The strategy can quickly respond to design specification changes and provide design variables that maximize efficiency;Finally,a 140 kW experimental prototype is built,and the effectiveness of the proposed method is verified by the experimental results,which demonstrates efficiency improvements of 0.025%and 0.025%respectively compared to genetic algorithm and Reinforcement Learning(RL).