大用户直购中基于Q学习算法的多代理两阶段谈判策略

A Two-stage Negotiation Strategy Based on Multi-agent Using Q-learning in Direct Power Purchase with Large Consumers

利用多代理对大用户直购电中不同类型交易者的谈判行为进行了模拟,采取基于历史报价数据的Q学习算法增加了代理的自主学习能力,使代理能根据对手动作及时调整己方报价。此外,为保证市场竞争的公平性,提出了基于"谈判+拍卖"的两阶段谈判机制,给予因对谈判形势估计不足致使谈判破裂但又拥有成本优势的发电商再一次出价的机会,使得合同电价反映出不同发电成本间的真实差异,以此激励发电商以降低成本的方式来换取谈判中的主动权。

The negotiation actions of different traders in the negotiation process of direct power purchase with large consumers are simulated using the multi-agent technology. With the Q-learning algorithm based on historical data, an agent can strengthen its own learning capacity and timely adjust its bid price against its opponent＇ s action. Meanwhile, in order to ensure the fairness of market competition, a two-stage negotiation mechanism of ＇negotiations＋auction＇ is proposed. It gives one more opportunity to the generator agent who has a lower reserve price but fails to achieve an agreement, due to underestimation of the situation in the negotiations. It also makes the real diversity of different generating costs reflected by contract power price, and can inspire the generators to get the negotiating initiative by lowering their costs.