This paper proposes a robust and computationally efficient control method for damping ultra-low frequency oscillations(ULFOs) in hydropower-dominated systems. Unlike the existing robust optimization based control form...This paper proposes a robust and computationally efficient control method for damping ultra-low frequency oscillations(ULFOs) in hydropower-dominated systems. Unlike the existing robust optimization based control formulation that can only deal with a limited number of operating conditions, the proposed method reformulates the control problem into a bi-level robust parameter optimization model. This allows us to consider a wide range of system operating conditions. To speed up the bi-level optimization process, the deep deterministic policy gradient(DDPG) based deep reinforcement learning algorithm is developed to train an intelligent agent. This agent can provide very fast lower-level decision variables for the upper-level model, significantly enhancing its computational efficiency. Simulation results demonstrate that the proposed method can achieve much better damping control performance than other alternatives with slightly degraded dynamic response performance of the governor under various types of operating conditions.展开更多
With the growing integration of distributed energy resources(DERs),flexible loads,and other emerging technologies,there are increasing complexities and uncertainties for modern power and energy systems.This brings gre...With the growing integration of distributed energy resources(DERs),flexible loads,and other emerging technologies,there are increasing complexities and uncertainties for modern power and energy systems.This brings great challenges to the operation and control.Besides,with the deployment of advanced sensor and smart meters,a large number of data are generated,which brings opportunities for novel data-driven methods to deal with complicated operation and control issues.Among them,reinforcement learning(RL)is one of the most widely promoted methods for control and optimization problems.This paper provides a comprehensive literature review of RL in terms of basic ideas,various types of algorithms,and their applications in power and energy systems.The challenges and further works are also discussed.展开更多
基金supported by the National Natural Science Foundation of China (No.52277083)。
文摘This paper proposes a robust and computationally efficient control method for damping ultra-low frequency oscillations(ULFOs) in hydropower-dominated systems. Unlike the existing robust optimization based control formulation that can only deal with a limited number of operating conditions, the proposed method reformulates the control problem into a bi-level robust parameter optimization model. This allows us to consider a wide range of system operating conditions. To speed up the bi-level optimization process, the deep deterministic policy gradient(DDPG) based deep reinforcement learning algorithm is developed to train an intelligent agent. This agent can provide very fast lower-level decision variables for the upper-level model, significantly enhancing its computational efficiency. Simulation results demonstrate that the proposed method can achieve much better damping control performance than other alternatives with slightly degraded dynamic response performance of the governor under various types of operating conditions.
基金supported by the Sichuan Science and Technology Program(Sichuan Distinguished Young Scholars)(No.2020JDJQ0037).
文摘With the growing integration of distributed energy resources(DERs),flexible loads,and other emerging technologies,there are increasing complexities and uncertainties for modern power and energy systems.This brings great challenges to the operation and control.Besides,with the deployment of advanced sensor and smart meters,a large number of data are generated,which brings opportunities for novel data-driven methods to deal with complicated operation and control issues.Among them,reinforcement learning(RL)is one of the most widely promoted methods for control and optimization problems.This paper provides a comprehensive literature review of RL in terms of basic ideas,various types of algorithms,and their applications in power and energy systems.The challenges and further works are also discussed.
