Probabilistic Assessment of Impact of Flexible Loads Under Network Tariffs in Low-voltage Distribution Networks

Given the historically static nature of low-voltage networks, distribution network companies do not possess the tools for dealing with an increasingly variable demand due to the high penetration of distributed energy resources (DERs). Within this context, this paper proposes a probabilistic framework for tariff design that minimises the impact of DER on network performance, stabilises the revenue of network company, and improves the equity of network cost allocation. To deal with the lack of customers’ response, we also show how DER-specific tariffs can be complemented with an automated home energy management system (HEMS) that reduces peak demand while retaining the desired comfort level. The proposed framework comprises a nonparametric Bayesian model which statistically generates synthetic load and PV traces, a hot-water-use statistical model, a novel HEMS to schedule customers’ controllable devices, and a probabilistic power flow model. Test cases using both energy- and demand-based network tariffs show that flat tariffs with a peak demand component reduce the customers’ cost, and alleviate network constraints. This demonstrates, firstly, the efficacy of the proposed tool for the development of tariffs that are beneficial for the networks with a high penetration of DERs, and secondly, how customers’ HEM systems can be part of the solution.

Reinforcement learning for whole-building HVAC control and demand response

This paper proposes a novel reinforcement learning(RL)architecture for the efficient scheduling and control of the heating,ventilation and air conditioning(HVAC)system in a commercial building while harnessing its de-mand response(DR)potentials.With advances in automated building management systems,this can be achieved seamlessly by a smart autonomous RL agent which takes the best action,for example,a change in HVAC temper-ature set point,necessary to change the electricity usage pattern of a building in response to demand response signals,and with minimal thermal comfort impact to customers.Previous research in this area has tackled only individual aspects of the problem using RL.Specifically,due to the challenges in implementing demand response with whole-building models,simpler analytical models which poorly capture reality have been used instead.And where whole-building models are applied,RL is used for HVAC control mainly to achieve energy efficiency goals while demand response is neglected.Thus,in this research,we implement a holistic framework by designing an efficient RL controller for a whole-building model which learns to optimise and control the HVAC system for improved energy efficiency and thermal comfort levels in addition to achieving demand response goals.Our simulation results show that by applying reinforcement learning for normal HVAC operation,a maximum weekly energy reduction of up to 22%can be achieved compared to a handcrafted baseline controller.Furthermore,by employing a DR-aware RL controller during demand response periods,average power reductions or increases of up to 50%can be achieved on a weekly basis compared to the default RL controller,while keeping occupant thermal comfort levels within acceptable bounds.