基于多主体博弈与强化学习的并网型综合能源微网协调调度

Coordinated Scheduling of Grid-connected Integrated Energy Microgrid Based on Multi-agent Game and Reinforcement Learning

针对传统集中式优化调度方法难以全面反映综合能源微网内不同智能体的利益诉求,以及人工智能技术在综合能源调度方面的应用亟待进一步挖掘等问题,提出了基于多主体博弈与强化学习的并网型综合能源微网协调调度模型和方法。首先,针对并网型综合能源微网中横向电气热冷各子系统及纵向源网荷储等各环节的不同投资与运营主体,开展了多智能体划分;其次,针对可再生能源服务商、微网系统能源服务商、电动汽车用户等智能体,分别构建了各自的决策模型,并建立了以多智能体间利益均衡为目标的联合博弈决策模型;再次,针对多主体博弈这一高维决策难题,引入人工智能求解方法,提出了基于Nash博弈和强化学习算法的综合能源微网协调调度方法;最后,通过实例验证了所提模型和方法的有效性与实用性。

Considering that the traditional centralized optimized scheduling methods cannot comprehensively reflect the interests of different agents in the integrated energy microgrid and the application of artificial intelligence techniques in integrated energy scheduling is deepened,the coordinated scheduling model and method for grid-connected integrated energy microgrid based on multi-agent game and reinforcement learning are proposed in this paper.Firstly,the multiple investment and operation agents are divided from the perspectives of electrical/heating/cooling subsystems and source/grid/load/storage links,respectively.Secondly,the decision-making models for renewable energy provider,microgrid energy provider and electric vehicle owner are constructed,and the joint game based decision-making model is established with the objective of balancing the multi-agent interests.Thirdly,the artificial intelligence techniques are introduced to solve the highly-dimensional multi-agent game decision-making problem,and the coordinated scheduling method for integrated energy microgrid based on Nash game and Q learning algorithm is proposed.Finally,the effectiveness and applicability of the model and method proposed are verified by case study.