Privacy Preserving Demand Side Management Method via Multi-Agent Reinforcement Learning

The smart grid utilizes the demand side management technology to motivate energy users towards cutting demand during peak power consumption periods, which greatly improves the operation efficiency of the power grid. However, as the number of energy users participating in the smart grid continues to increase, the demand side management strategy of individual agent is greatly affected by the dynamic strategies of other agents. In addition, the existing demand side management methods, which need to obtain users’ power consumption information,seriously threaten the users’ privacy. To address the dynamic issue in the multi-microgrid demand side management model, a novel multi-agent reinforcement learning method based on centralized training and decentralized execution paradigm is presented to mitigate the damage of training performance caused by the instability of training experience. In order to protect users’ privacy, we design a neural network with fixed parameters as the encryptor to transform the users’ energy consumption information from low-dimensional to high-dimensional and theoretically prove that the proposed encryptor-based privacy preserving method will not affect the convergence property of the reinforcement learning algorithm. We verify the effectiveness of the proposed demand side management scheme with the real-world energy consumption data of Xi’an, Shaanxi, China. Simulation results show that the proposed method can effectively improve users’ satisfaction while reducing the bill payment compared with traditional reinforcement learning(RL) methods(i.e., deep Q learning(DQN), deep deterministic policy gradient(DDPG),QMIX and multi-agent deep deterministic policy gradient(MADDPG)). The results also demonstrate that the proposed privacy protection scheme can effectively protect users’ privacy while ensuring the performance of the algorithm.

Optimal Scheme with Load Forecasting for Demand Side Management (DSM) in Residential Areas

Utilities around the world have been considering Demand Side Management (DSM) in their strategic planning. The costs of constructing and operating a new capacity generation unit are increasing everyday as well as Transmission and distribution and land issues for new generation plants, which force the utilities to search for another alternatives without any additional constraints on customers comfort level or quality of delivered product. De can be defined as the selection, planning, and implementation of measures intended to have an influence on the demand or customer-side of the electric meter, either caused directly or stimulated indirectly by the utility. DSM programs are peak clipping, Valley filling, Load shifting, Load building, energy conservation and flexible load shape. The main Target of this paper is to show the relation between DSM and Load Forecasting. Moreover, it highlights on the effect of applying DSM on Forecasted demands and how this affects the planning strategies for utility companies. This target will be clearly illustrated through applying the developed algorithm in this paper on an existing residential compound in Cairo-Egypt.

Price-Based Residential Demand Response Management in Smart Grids:A Reinforcement Learning-Based Approach

This paper studies price-based residential demand response management(PB-RDRM)in smart grids,in which non-dispatchable and dispatchable loads(including general loads and plug-in electric vehicles(PEVs))are both involved.The PB-RDRM is composed of a bi-level optimization problem,in which the upper-level dynamic retail pricing problem aims to maximize the profit of a utility company(UC)by selecting optimal retail prices(RPs),while the lower-level demand response(DR)problem expects to minimize the comprehensive cost of loads by coordinating their energy consumption behavior.The challenges here are mainly two-fold:1)the uncertainty of energy consumption and RPs;2)the flexible PEVs’temporally coupled constraints,which make it impossible to directly develop a model-based optimization algorithm to solve the PB-RDRM.To address these challenges,we first model the dynamic retail pricing problem as a Markovian decision process(MDP),and then employ a model-free reinforcement learning(RL)algorithm to learn the optimal dynamic RPs of UC according to the loads’responses.Our proposed RL-based DR algorithm is benchmarked against two model-based optimization approaches(i.e.,distributed dual decomposition-based(DDB)method and distributed primal-dual interior(PDI)-based method),which require exact load and electricity price models.The comparison results show that,compared with the benchmark solutions,our proposed algorithm can not only adaptively decide the RPs through on-line learning processes,but also achieve larger social welfare within an unknown electricity market environment.

Demand Side Management for Thermally Activated Building Systems Based on Multiple Linear Regression

The building sector and its heating and cooling represents one of the major consumer of energy worldwide. Simultaneously, the share of fluctuating generation of renewable energies in the energy mix increases. Therefore storage and demand side management technologies are required. The new adaptive and predictive control algorithm for thermally activated building systems （TABS） based on multiple linear regression （AMLR） presented in this paper enables the application of demand side management （DSM） strategies. Based on simulations, different strategies have been compared with each other. By applying the AMLR algorithm, electricity energy cost savings of 38% could be achieved compared to the conventional control strategy for TABS, while increasing the thermal comfort. At the same time, thermal energy demand can be reduced in the range between 4% to 8%, and pump operation time from 86% to 89%.

Demand side management for solving environment constrained economic dispatch of a microgrid system using hybrid MGWOSCACSA algorithm

Microgrids are a type of restricted power distribution systems in which electricity is generated,transmitted,and distributed within a small geographic region.They are used to ensure that renewable energy sources are used to their full potential.Microgrids provide further benefits,such as lowering transmission losses and the expenses associated with them.This research compares and contrasts the aims of economic dispatch,emission dispatch,fractional programing based combined economic emission dispatch,and environmental restricted economic dispatch(ECED).A low-voltage microgrid system is investigated for three different scenarios.As a study optimization tool,an innovative,resilient,and strong hybrid swarm-intelligence optimization algorithm is utilised,which is based on combining the properties of the traditional grey-wolf optimiser,sine-cosine algorithm,and crow search algorithm.The employment of a time-of-use energy mar-ket pricing approach instead of a fixed pricing plan resulted in a 15%decrease in gen-eration costs throughout the course of the research.When ECED was assessed with a 15%-20%demand side management based restructured load demand model for the microgrid system,the generation costs were reduced even further.

Intelligent Load Management Scheme for a Residential Community in Smart Grids Network Using Fair Emergency Demand Response Programs

In the framework of liberalized deregulated electricity market, dynamic competitive environment exists between wholesale and retail dealers for energy supplying and management. Smart Grids topology in form of energy management has forced power supplying agencies to become globally competitive. Demand Response (DR) Programs in context with smart energy network have influenced prosumers and consumers towards it. In this paper Fair Emergency Demand Response Program (FEDRP) is integrated for managing the loads intelligently by using the platform of Smart Grids for Residential Setup. The paper also provides detailed modelling and analysis of respective demands of residential consumers in relation with economic load model for FEDRP. Due to increased customer’s partaking in this program the load on the utility is reduced and managed intelligently during emergency hours by providing fair and attractive incentives to residential clients, thus shifting peak load to off peak hours. The numerical and graphical results are matched for intelligent load management scenario.

Optimal Demand-Side Management for Smart Micro Grid with Storage

In this paper, an autonomous and distributive demand-side management based on Bayesian game theory is developed and applied among users in a grid connected micro-grid with storage. To derive that strategy, an energy consumption of shiftable loads belonging to a given user is modelled as a noncooperative three-player game of incomplete information, in which each user plays against the storage unit and an opponent gathering all the other users in the micro-grid. Each player is assumed to be endowed with statistical information about its behavior and that of its opponents so that he can take actions maximizing his expected utility. Results of the proposed strategy evaluated by simulating, under MATLAB environment, a connected micro-grid with storage device evidence its efficacy when employed to manage the charging of electric vehicles.

Prediction-based Manufacturing Center Self-adaptive Demand Side Energy Optimization in Cyber Physical Systems

Cyber physical systems（CPS） recently emerge as a new technology which can provide promising approaches to demand side management（DSM）, an important capability in industrial power systems. Meanwhile, the manufacturing center is a typical industrial power subsystem with dozens of high energy consumption devices which have complex physical dynamics. DSM, integrated with CPS, is an effective methodology for solving energy optimization problems in manufacturing center. This paper presents a prediction-based manufacturing center self-adaptive energy optimization method for demand side management in cyber physical systems. To gain prior knowledge of DSM operating results, a sparse Bayesian learning based componential forecasting method is introduced to predict 24-hour electric load levels for specific industrial areas in China. From this data, a pricing strategy is designed based on short-term load forecasting results. To minimize total energy costs while guaranteeing manufacturing center service quality, an adaptive demand side energy optimization algorithm is presented. The proposed scheme is tested in a machining center energy optimization experiment. An AMI sensing system is then used to measure the demand side energy consumption of the manufacturing center. Based on the data collected from the sensing system, the load prediction-based energy optimization scheme is implemented. By employing both the PSO and the CPSO method, the problem of DSM in the manufac^ring center is solved. The results of the experiment show the self-adaptive CPSO energy optimization method enhances optimization by 5% compared with the traditional PSO optimization method.

Water Demand Management in Jordan

Jordan is located in the Middle East in the eastern Mediterranean. It has a surface area of approximately 90,000 km2 and its population reaches 6.3 million. Jordan is the fourth driest countries in the World and water demand exceeds Jordan’s available water resources. Annual per capita water availability has declined from 3600 m3/year in 1946 to 145 m3/year today. It is estimated that the population will continue to grow from about 5.87 million in 2008 to over 7.80 million by 2022. Total projected water demand will be 1673 million cubic meters by 2022. Fifteen-year complete records for water consumption were studied to see the supply and demand variation with time. It had been noticed that water demand management will address the actual needs for water. This management program will ensure further reduction in water use, reduce water loses through the distribution supply net, prevent pollution. In addition, it will help minimize water disposal in nature, make efficient use of available water resources, plan for future new water resources prudently and finally impose a real cost for water supply that would be acceptable. In addition to the above, public awareness program is to be put in action. Such a program should be used in schools as well as the media. The public is to be aware of the problem and how they can assist with overcoming the water shortage crisis.

Employing Water Demand Management Option for the Improvement of Water Supply and Sanitation in Nigeria

The aim of this paper is to assess the importance of Water Demand Management (WDM) strategy to the improvement of water supply and sanitation in Nigeria. Persistent water supply shortages and poor sanitation have since remained important features of the Nigerian urban and rural communities. Most often governmental solution to these problems has been to develop and exploit the available water resources and the level of sanitation for the people. This predominant approach which is also known as augmentation method is supply driven with the primary purpose being how best to meet the perceived water and sanitation demand. One of the major disadvantages of this approach is the huge financial involvement associated with it. Conversely, quite recently water resource managers have begun to direct attention on how consumers can be motivated to regulate the amount and manner in which they use and dispose water to alleviate pressure on freshwater supplies. This new approach is known as water demand management. It is demand driven in that consumers determine their own water need. Employment of WDM by consumers especially in water scarce areas as was discussed in the paper will decrease the amount of water use, thereby limiting unnecessary financial expenditure in exploiting new sources to meet the ever increasing demand.

The 3D simulation and optimized management model of groundwater systems based on eco-environmental water demand

Through the study of mutual process between groundwater systems and eco-environmental water demand, the eco-environmental water demand is brought into groundwater systems model as the important water consumption item and unification of groundwater抯 economic, environmental and ecological functions were taken into account. Based on eco-environmental water demand at Da抋n in Jilin province, a three-dimensional simulation and optimized management model of groundwater systems was established. All water balance components of groundwater systems in 1998 and 1999 were simulated with this model and the best optimal exploitation scheme of groundwater systems in 2000 was determined, so that groundwater resource was efficiently utilized and good economic, ecologic and social benefits were obtained.

Water Demand Management Is a Must in MENA Countries…But Is It Enough?

The majority of Middle East and North Africa(MENA)countries suffer from chronic imbalance between available water supply and rising water demand.This imbalance is expected to worsen even further in the future as a result of sharp population growth,rapid economic development and climate change,unless major positive measures are implemented to augment water supply and manage water demand.The supply management approach,on its own,practiced by many countries in the region for so many years has so far demonstrated its inability to bridge the“water gap”between available water resources and rising water demand,as most traditional water resourced in almost all MENA countries have been exploited(or over exploited),and the cost of non-traditional water resources has become increasingly prohibitively high,apart from its environmental impact.Demand management is regarded by many water experts in the region as the answer or“panacea”for the water imbalance problem.But,is demand management approach alone able to solve the problem of water scarcity in the MENA region?In other words,if all demand management measures have been fully implemented,would there still be gaps between supply and demand that need to be filled with supply augmentation,andwill supply management options still need to be part of the solution?This paper tries to answer this question by reviewing several works in this domain,particularly,recent studies by the World Bank[9-11].It was concluded that,although water demand management measures should be given the first priority,especially,in the agricultural sector where it has the maximum impact,demand management on its own will not be able to bridge the“water gap”,and supply management options,such as sea water desalination and the re-use of treated wastewater,will be part of the solution.

Optimal Energy Consumption Optimization in a Smart House by Considering Electric Vehicles and Demand Response via a Hybrid Gravitational Search and Particle Swarm Optimization Algorithm

Buildings are the main energy consumers across the world,especially in urban communities.Building smartization,or the smartification of housing,therefore,is a major step towards energy grid smartization too.By controlling the energy consumption of lighting,heating,and cooling systems,energy consumption can be optimized.All or some part of the energy consumed in future smart buildings must be supplied by renewable energy sources(RES),which mitigates environmental impacts and reduces peak demand for electrical energy.In this paper,a new optimization algorithm is applied to solve the optimal energy consumption problem by considering the electric vehicles and demand response in smart homes.In this way,large power stations that work with fossil fuels will no longer be developed.The current study modeled and evaluated the performance of a smart house in the presence of electric vehicles(EVs)with bidirectional power exchangeability with the power grid,an energy storage system(ESS),and solar panels.Additionally,the solar RES and ESS for predicting solar-generated power prediction uncertainty have been considered in this work.Different case studies,including the sales of electrical energy resulting from PV panels’generated power to the power grid,time-variable loads such as washing machines,and different demand response(DR)strategies based on energy price variations were taken into account to assess the economic and technical effects of EVs,BESS,and solar panels.The proposed model was simulated in MATLAB.A hybrid particle swarm optimization(PSO)and gravitational search(GS)algorithm were utilized for optimization.Scenario generation and reduction were performed via LHS and backward methods,respectively.Obtained results demonstrate that the proposed model minimizes the energy supply cost by considering the stochastic time of use(STOU)loads,EV,ESS,and PV system.Based on the results,the proposed model markedly reduced the electricity costs of the smart house.

FEDRP Based Model Implementation of Intelligent Energy Management Scheme for a Residential Community in Smart Grids Network

In the framework of liberalized deregulated electricity market, dynamic competitive environment exists between wholesale and retail dealers for energy supplying and management. Smart Grids topology in form of energy management has forced power supplying agencies to become globally competitive. Demand Response (DR) Programs in context with smart energy network have influenced prosumers and consumers towards it. In this paper Fair Emergency Demand Response Program (FEDRP) is integrated for managing the loads intelligently by using the platform of Smart Grids for Residential Setup. The paper also provides detailed modeling and analysis of respective demands of residential consumers in relation with economic load model for FEDRP. Due to increased customer’s partaking in this program the load on the utility is reduced and managed intelligently during emergency hours by providing fair and attractive incentives to residential clients, thus shifting peak load to off peak hours. The numerical and graphical results are matched for intelligent energy management scenario.

Supply-side Reform and Management Accounting Innovation

Essentially, the supply-side reform will also play a very important role in China's future economic development. The supply-side reform can adjust the industrial structures to solve a series of problems in China's economy, such as the process mismatch. If we actively use the advantages of the supply-side reform in the management accounting, then enterprises can further optimize and improve the management accounting system and the related information systems on the basis of improving the value increment of enterprises.

Urban Growth Management through Travel Demand Modeling in Washington and Oregon

Among the fast growing states in the USA,the States of Washington and Oregon have enacted legislative land use and transportation concurrency/balancing planning policies for orderly urban growth management since 1990 and 1991,respectively.Regional or urban travel demand forecasting models play an instrumental role in implementing the Washington GMA(Growth Management Act)and the Oregon TPR(Transportation Planning Rule).Both program-and project-level modeling approaches to urban land use/transportation system management are evaluated through the selected cities in Washington and Oregon.

Inventory Management and Demand Forecasting Improvement of a Forecasting Model Based on Artificial Neural Networks

Forecasting is predicting or estimating a future event or trend.Supply chains have been constantly growing in most countries ever since the industrial revolution of the 18th century.As the competitiveness between supply chains intensifies day by day,companies are shifting their focus to predictive analytics techniques to minimize costs and boost productivity and profits.Excessive inventory(overstock)and stock outs are very significant issues for suppliers.Excessive inventory levels can lead to loss of revenue because the company's capital is tied up in excess inventory.Excess inventory can also lead to increased storage,insurance costs and labor as well as lower and degraded quality based on the nature of the product.Shortages or out of stock can lead to lost sales and a decline in customer contentment and loyalty to the store.If clients are unable to find the right products on the shelves,they may switch to another vendor or purchase alternative items.Demand forecasting is valuable for planning,scheduling and improving the coordination of all supply chain activities.This paper discusses the use of neural networks for seasonal time series forecasting.Our objective is to evaluate the contribution of the correct choice of the transfer function by proposing a new form of the transfer function to improve the quality of the forecast.

Delivery Service Management System Using Google Maps for SMEs in Emerging Countries

This paper proposes a Delivery Service Management(DSM)system for Small and Medium Enterprises(SMEs)that own a delivery fleet of pickup trucks to manage Business-to-Business(B2B)delivery services.The proposed DSM system integrates four systems:Delivery Location Positioning(DLP),Delivery Route Planning(DRP),Arrival Time Prediction(ATP),and Communication and Data Sharing(CDS)systems.These systems are used to pinpoint the delivery locations of customers,plan the delivery route of each truck,predict arrival time(with an interval)at each delivery location,and communicate and share information among stakeholders,respectively.The DSM system deploys Google applications,a GPS tracking system,Google Map APIs,ATP algorithms(embedded in Excel Macros),Line,and Telegram as supporting tools.To improve the accuracy of the ATP system,three tech-niques are applied considering driver behaviors.The proposed DSM system has been implemented in a Thai SME.From the process perspective,the DSM system is a systematic procedure for end-to-end delivery services.It allows the interactions between planner-driver decisions and supporting tools.The supporting tools are simple,can be easily used with little training,and require low capital expenditure.The statistical analysis shows that the ATP algorithm with the three techniques provides high accuracy.Thus,the proposed DSM system is beneficial for practitioners to manage delivery services,especially for SMEs in emerging countries.