Reinforcement Learning-Based Energy Management for Hybrid Power Systems:State-of-the-Art Survey,Review,and Perspectives

The new energy vehicle plays a crucial role in green transportation,and the energy management strategy of hybrid power systems is essential for ensuring energy-efficient driving.This paper presents a state-of-the-art survey and review of reinforcement learning-based energy management strategies for hybrid power systems.Additionally,it envisions the outlook for autonomous intelligent hybrid electric vehicles,with reinforcement learning as the foundational technology.First of all,to provide a macro view of historical development,the brief history of deep learning,reinforcement learning,and deep reinforcement learning is presented in the form of a timeline.Then,the comprehensive survey and review are conducted by collecting papers from mainstream academic databases.Enumerating most of the contributions based on three main directions—algorithm innovation,powertrain innovation,and environment innovation—provides an objective review of the research status.Finally,to advance the application of reinforcement learning in autonomous intelligent hybrid electric vehicles,future research plans positioned as“Alpha HEV”are envisioned,integrating Autopilot and energy-saving control.

Regenerative Braking Energy Recovery System of Metro Train Based on Dual-Mode Power Management

In order to fully utilize the regenerative braking energy of metro trains and stabilize the metro DC traction busbar voltage,a hybrid regenerative braking energy recovery system with a dual-mode power management strategy is proposed.Firstly,the construction of the hybrid regenerative braking energy recovery system is explained.Then,based on the power demand of low-voltage load in metro stations,a dual-mode power management strategy is proposed to allocate the reference power of each system according to the different working conditions,and the control methods of each system are set.Finally,the correctness and effectiveness of the dual-mode strategy are verified through simulation,and the proposed braking energy utilization scheme is compared with other singleform utilization schemes.The results illustrate that the hybrid system with the dual-mode strategy can effectively recycle the regenerative braking energy of metro train and inhibit the busbar voltage fluctuation;the proposed braking energy utilization scheme has certain advantages on energy recovery and DC bus voltage stabilization compared with other single-form schemes;the proposed power management strategy can correctly allocate the reference power of each system with a lower construction cost.

Topological Structure-Modulated Collagen Carbon as Two-in-One Energy Storage Configuration toward Ultrahigh Power and Energy Density

Efficient energy storage devices with suitable electrode materials,that integrate high power and high energy,are the crucial requisites of the renewable power source,which have unwrapped new possibilities in the sustainable development of energy and the environment.Herein,a facile collagen microstructure modulation strategy is proposed to construct a nitrogen/oxygen dual-doped hierarchically porous carbon fiber with ultrahigh specific surface area(2788 m^(2)g^(-1))and large pore volume(4.56 cm^(3)g^(-1))via local microfibrous breakage/disassembly of natural structured proteins.Combining operando spectroscopy and density functional theory unveil that the dual-heteroatom doping could effectively regulate the electronic structure of carbon atom framework with enhanced electric conductivity and electronegativity as well as decreased diffusion resistance in favor of rapid pseudocapacitive-dominated Li^(+)-storage(353 mAh g^(-1)at 10 A g^(-1)).Theoretical calculations reveal that the tailored micro-/mesoporous structures favor the rapid charge transfer and ion storage,synergistically realizing high capacity and superior rate performance for NPCF-H cathode(75.0 mAh g^(-1)at 30 A g^(-1)).The assembled device with NPCF-H as both anode and cathode achieves extremely high energy density(200 Wh kg^(-1))with maximum power density(42600 W kg^(-1))and ultralong lifespan(80%capacity retention over 10000 cycles).

Source-Load Coordinated Optimal Scheduling Considering the High Energy Load of Electrofused Magnesium and Wind Power Uncertainty

In fossil energy pollution is serious and the“double carbon”goal is being promoted,as a symbol of fresh energy in the electrical system,solar and wind power have an increasing installed capacity,only conventional units obviously can not solve the new energy as the main body of the scheduling problem.To enhance the systemscheduling ability,based on the participation of thermal power units,incorporate the high energy-carrying load of electro-melting magnesiuminto the regulation object,and consider the effects on the wind unpredictability of the power.Firstly,the operating characteristics of high energy load and wind power are analyzed,and the principle of the participation of electrofusedmagnesiumhigh energy-carrying loads in the elimination of obstructedwind power is studied.Second,a two-layer optimization model is suggested,with the objective function being the largest amount of wind power consumed and the lowest possible cost of system operation.In the upper model,the high energy-carrying load regulates the blocked wind power,and in the lower model,the second-order cone approximation algorithm is used to solve the optimizationmodelwithwind power uncertainty,so that a two-layer optimizationmodel that takes into account the regulation of the high energy-carrying load of the electrofused magnesium and the uncertainty of the wind power is established.Finally,the model is solved using Gurobi,and the results of the simulation demonstrate that the suggested model may successfully lower wind abandonment,lower system operation costs,increase the accuracy of day-ahead scheduling,and lower the final product error of the thermal electricity unit.

The Correlation between the Power Quality Indicators and Entropy Production Characteristics of Wind Power+Energy Storage Systems

Power quality improvements help guide and solve the problems of inefficient energy production and unstable power output in wind power systems.The purpose of this paper is mainly to explore the influence of different energy storage batteries on various power quality indicators by adding different energy storage devices to the simulated wind power system,and to explore the correlation between systementropy generation and various indicators,so as to provide a theoretical basis for directly improving power quality by reducing loss.A steady-state experiment was performed by replacing the wind wheel with an electric motor,and the output power qualities of the wind power systemwith andwithout energy storagewere compared and analyzed.Moreover,the improvement effect of different energy storage devices on various indicatorswas obtained.Then,based on the entropy theory,the loss of the internal components of the wind power system generator is simulated and explored by Ansys software.Through the analysis of power quality evaluation indicators,such as current harmonic distortion rate,frequency deviation rate,and voltage fluctuation,the correlation between entropy production and each evaluation indicator was explored to investigate effective methods to improve power quality by reducing entropy production.The results showed that the current harmonic distortion rate,voltage fluctuation,voltage deviation,and system entropy production are positively correlated in the tests and that the power factor is negatively correlated with system entropy production.In the frequency range,the frequency deviationwas not significantly correlated with the systementropy production.

Enhancing Renewable Energy Integration:A Gaussian-Bare-Bones Levy Cheetah Optimization Approach to Optimal Power Flow in Electrical Networks

In the contemporary era,the global expansion of electrical grids is propelled by various renewable energy sources(RESs).Efficient integration of stochastic RESs and optimal power flow(OPF)management are critical for network optimization.This study introduces an innovative solution,the Gaussian Bare-Bones Levy Cheetah Optimizer(GBBLCO),addressing OPF challenges in power generation systems with stochastic RESs.The primary objective is to minimize the total operating costs of RESs,considering four functions:overall operating costs,voltage deviation management,emissions reduction,voltage stability index(VSI)and power loss mitigation.Additionally,a carbon tax is included in the objective function to reduce carbon emissions.Thorough scrutiny,using modified IEEE 30-bus and IEEE 118-bus systems,validates GBBLCO’s superior performance in achieving optimal solutions.Simulation results demonstrate GBBLCO’s efficacy in six optimization scenarios:total cost with valve point effects,total cost with emission and carbon tax,total cost with prohibited operating zones,active power loss optimization,voltage deviation optimization and enhancing voltage stability index(VSI).GBBLCO outperforms conventional techniques in each scenario,showcasing rapid convergence and superior solution quality.Notably,GBBLCO navigates complexities introduced by valve point effects,adapts to environmental constraints,optimizes costs while considering prohibited operating zones,minimizes active power losses,and optimizes voltage deviation by enhancing the voltage stability index(VSI)effectively.This research significantly contributes to advancing OPF,emphasizing GBBLCO’s improved global search capabilities and ability to address challenges related to local minima.GBBLCO emerges as a versatile and robust optimization tool for diverse challenges in power systems,offering a promising solution for the evolving needs of renewable energy-integrated power grids.

Intelligent UAV Based Energy Supply for 6G Wireless Powered IoT Networks

In this paper,we develop a 6G wireless powered Internet of Things(IoT)system assisted by unmanned aerial vehicles(UAVs)to intelligently supply energy and collect data at the same time.In our dual-UAV scheme,UAV-E,with a constant power supply,transmits energy to charge the IoT devices on the ground,whereas UAV-B serves the IoT devices by data collection as a base station.In this framework,the system's energy efficiency is maximized,which we define as a ratio of the sum rate of IoT devices to the energy consumption of two UAVs during a fixed working duration.With the constraints of duration,transmit power,energy,and mobility,a difficult non-convex issue is presented by optimizing the trajectory,time duration allocation,and uplink transmit power of concurrently.To tackle the non-convex fractional optimization issue,we deconstruct it into three subproblems and we solve each of them iteratively using the descent method in conjunction with sequential convex approximation(SCA)approaches and the Dinkelbach algorithm.The simulation findings indicate that the suggested cooperative design has the potential to greatly increase the energy efficiency of the 6G intelligent UAV-assisted wireless powered IoT system when compared to previous benchmark systems.

A Two-Layer Active Power Optimization and Coordinated Control for Regional Power Grid Partitioning to Promote Distributed Renewable Energy Consumption

With the large-scale development and utilization of renewable energy,industrial flexible loads,as a kind of loadside resource with strong regulation ability,provide new opportunities for the research on renewable energy consumption problem in power systems.This paper proposes a two-layer active power optimization model based on industrial flexible loads for power grid partitioning,aiming at improving the line over-limit problem caused by renewable energy consumption in power grids with high proportion of renewable energy,and achieving the safe,stable and economical operation of power grids.Firstly,according to the evaluation index of renewable energy consumption characteristics of line active power,the power grid is divided into several partitions,and the interzone tie lines are taken as the optimization objects.Then,on the basis of partitioning,a two-layer active power optimization model considering the power constraints of industrial flexible loads is established.The upper-layer model optimizes the planned power of the inter-zone tie lines under the constraint of the minimum peak-valley difference within a day;the lower-layer model optimizes the regional source-load dispatching plan of each resource in each partition under the constraint of theminimumoperation cost of the partition,so as to reduce the line overlimit phenomenon caused by renewable energy consumption and save the electricity cost of industrial flexible loads.Finally,through simulation experiments,it is verified that the proposed model can effectively mobilize industrial flexible loads to participate in power grid operation and improve the economic stability of power grid.

Energy efficiency aware dynamic rate and power adaptation in carrier sensing based WLANs under Rayleigh fading and shadowing

We consider the problem of energy efficiency aware dynamic adaptation of data transmission rate and transmission power of the users in carrier sensing based Wireless Local Area Networks(WLANs)in the presence of path loss,Rayleigh fading and log-normal shadowing.For a data packet transmission,we formulate an optimization problem,solve the problem,and propose a rate and transmission power adaptation scheme with a restriction methodology of data packet transmission for achieving the optimal energy efficiency.In the restriction methodology of data packet transmission,a user does not transmit a data packet if the instantaneous channel gain of the user is lower than a threshold.To evaluate the performance of the proposed scheme,we develop analytical models for computing the throughput and energy efficiency of WLANs under the proposed scheme considering a saturation traffic condition.We then validate the analytical models via simulation.We find that the proposed scheme provides better throughput and energy efficiency with acceptable throughput fairness if the restriction methodology of data packet transmission is included.By means of the analytical models and simulations,we demonstrate that the proposed scheme provides significantly higher throughput,energy efficiency and fairness index than a traditional non-adaptive scheme and an existing most relevant adaptive scheme.Throughput and energy efficiency gains obtained by the proposed scheme with respect to the existing adapting scheme are about 75%and 103%,respectively,for a fairness index of 0.8.We also study the effect of various system parameters on throughput and energy efficiency and provide various engineering insights.

Application of Power Electronics Converters in Renewable Energy

Against the backdrop of global energy shortages and increasingly severe environmental pollution,renewable energy is gradually becoming a significant direction for future energy development.Power electronics converters,as the core technology for energy conversion and control,play a crucial role in enhancing the efficiency and stability of renewable energy systems.This paper explores the basic principles and functions of power electronics converters and their specific applications in photovoltaic power generation,wind power generation,and energy storage systems.Additionally,it analyzes the current innovations in high-efficiency energy conversion,multilevel conversion technology,and the application of new materials and devices.By studying these technologies,the aim is to promote the widespread application of power electronics converters in renewable energy systems and provide theoretical and technical support for achieving sustainable energy development.

Research on the Application of New Energy Photovoltaic Power Generation Technology

With the rapid development of technology and economy,the demand for energy in society is increasing.People are gradually realizing that fossil energy is limited,and the development of new energy may also face situations where it cannot meet social needs.The problem of resource shortage is gradually exposed to people.Therefore,the development of usable new energy has become an urgent problem for society to solve.At present,electricity is the most widely used energy source worldwide and photovoltaic power generation technology is gradually becoming well-known.As an emerging industry,the development of photovoltaic power generation still requires continuous promotion by national and social policies to be extended to various industries and ensure the stability of its energy supply.This article mainly outlines the principles,characteristics,and advantages of photovoltaic power generation,and briefly explains the current technology types and application aspects of photovoltaic power generation to contribute to its promotion and better serve all aspects of social life with new energy.

Energy Conservation and Emissions Reduction: Experiences from Three Provincial Power Companies and One Regional Power Grid Company

Power industry is one of the key fields for energy conservation and emissions reduction (ECER) in China. In order to achieve the nation's overall energy consumption target and pollutant emission target set by the 11th Five-Year Plan, to build the resource-conservation and environment-friendly society during the 11th Five-Year Plan period (2006-2010), it is crucial to implement the policy of "Large (units) In and Small (units) Out (LISO)" (i.e., replacing small units with large ones) and accelerate the retirement of small thermal units. According to the statistics, the power industry has made a significant progress in SO2 emission reduction during the first half of 2007. Specifically, with 18.3% growth in power generation, the SO2 emission was reduced by 5.2% compared with the same period in 2006. By the end of July 2007, the retired small units have totaled 6950 MW, 85% of which belongs to the five major power generation groups such as Guodian and Huadian. In this article, the achievements and remaining issues in Henan, Jiangsu, Sichuan Power Companies and East China Grid Company were presented and discussed thoroughly.

Dynamic and Power Generation Features of A Wind-Wave Hybrid System Consisting of A Spar-Type Wind Turbine and An Annular Wave Energy Converter in Irregular Waves

Combining wave energy converters(WECs)with floating offshore wind turbines proves a potential strategy to achieve better use of marine renewable energy.The full coupling investigation on the dynamic and power generation features of the hybrid systems under operational sea states is necessary but limited by numerical simulation tools.Here an aero-hydro-servo-elastic coupling numerical tool is developed and applied to investigate the motion,mooring tension,and energy conversion performance of a hybrid system consisting of a spar-type floating wind turbine and an annular wave energy converter.Results show that the addition of the WEC has no significant negative effect on the dynamic performance of the platform and even enhances the rotational stability of the platform.For surge and pitch motion,the peak of the spectra is originated from the dominating wave component,whereas for the heave motion,the peak of the spectrum is the superposed effect of the dominating wave component and the resonance of the system.The addition of the annular WEC can slightly improve the wind power by making the rotor to be in a better position to face the incoming wind and provide considerable wave energy production,which can compensate for the downtime of the offshore wind.

Research on Coordinated Development and Optimization of Distribution Networks at All Levels in Distributed Power Energy Engineering

The uncertainty of distributed generation energy has dramatically challenged the coordinated development of distribution networks at all levels.This paper focuses on the multi-time-scale regulation model of distributed generation energy under normal conditions.The simulation results of the example verify the self-optimization characteristics and the effectiveness of real-time dispatching of the distribution network control technology at all levels under multiple time scales.

Traction power systems for electrified railways:evolution,state of the art,and future trends

Traction power systems(TPSs)play a vital role in the operation of electrified railways.The transformation of conventional railway TPSs to novel structures is not only a trend to promote the development of electrified railways toward high-efficiency and resilience but also an inevitable requirement to achieve carbon neutrality target.On the basis of sorting out the power supply structures of conventional AC and DC modes,this paper first reviews the characteristics of the existing TPSs,such as weak power supply flexibility and low-energy efficiency.Furthermore,the power supply structures of various TPSs for future electrified railways are described in detail,which satisfy longer distance,low-carbon,high-efficiency,high-reliability and high-quality power supply requirements.Meanwhile,the application prospects of different traction modes are discussed from both technical and economic aspects.Eventually,this paper introduces the research progress of mixed-system electrified railways and traction power supply technologies without catenary system,speculates on the future development trends and challenges of TPSs and predicts that TPSs will be based on the continuous power supply mode,employing power electronic equipment and intelligent information technology to construct a railway comprehensive energy system with renewable energy.

Energy Management System with Power Offering Strategy for a Microgrid Integrated VPP

In the context of both the Virtual Power Plant (VPP) and microgrid(MG), the Energy Management System (EMS) is a key decision-maker forintegrating Distributed renewable Energy Resources (DERs) efficiently. TheEMS is regarded as a strong enabler of providing the optimized schedulingcontrol in operation and management of usage of disperse DERs and RenewableEnergy reSources (RES) such as a small-size wind-turbine (WT) andphotovoltaic (PV) energies. The main objective to be pursued by the EMSis the minimization of the overall operating cost of the MG integrated VPPnetwork. However, the minimization of the power peaks is a new objective andopen issue to a well-functional EMS, along with the maximization of profitin the energy market. Thus, both objectives have to be taken into accountat the same time. Thus, this paper proposes the EMS application incorporatingpower offering strategy applying a nature-inspired algorithm such asParticle Swarm Optimization (PSO) algorithm, in order to find the optimalsolution of the objective function in the context of the overall operating cost,the coordination of DERs, and the energy losses in a MG integrated VPPnetwork. For a fair DERs coordination with minimized power fluctuationsin the power flow, the power offering strategies with an active power controland re-distribution are proposed. Simulation results show that the proposedMG integrated VPP model with PSO-based EMS employing EgalitarianreDistribution (ED) power offering strategy is most feasible option for theoverall operating cost of VPP revenue. The total operating cost of the proposedEMS with ED strategy is 40.98$ compared to 432.8$ of MGs only withoutEMS. It is concluded that each MGs in the proposed VPP model intelligentlyparticipates in energy trading market compliant with the objective function,to minimize the overall cost and the power fluctuation.

Peer-to-Peer Energy Trading Method of Multi-Virtual Power Plants Based on Non-Cooperative Game

The current electricity market fails to consider the energy consumption characteristics of transaction subjects such as virtual power plants.Besides,the game relationship between transaction subjects needs to be further explored.This paper proposes a Peer-to-Peer energy trading method for multi-virtual power plants based on a non-cooperative game.Firstly,a coordinated control model of public buildings is incorporated into the scheduling framework of the virtual power plant,considering the energy consumption characteristics of users.Secondly,the utility functions of multiple virtual power plants are analyzed,and a non-cooperative game model is established to explore the game relationship between electricity sellers in the Peer-to-Peer transaction process.Finally,the influence of user energy consumption characteristics on the virtual power plant operation and the Peer-to-Peer transaction process is analyzed by case studies.Furthermore,the effect of different parameters on the Nash equilibrium point is explored,and the influence factors of Peer-to-Peer transactions between virtual power plants are summarized.According to the obtained results,compared with the central air conditioning set as constant temperature control strategy,the flexible control strategy proposed in this paper improves the market power of each VPP and the overall revenue of the VPPs.In addition,the upper limit of the service quotation of the market operator have a great impact on the transaction mode of VPPs.When the service quotation decreases gradually,the P2P transaction between VPPs is more likely to occur.

Identification of High-Risk Scenarios for Cascading Failures in New Energy Power Grids Based on Deep Embedding Clustering Algorithms

At present,the proportion of new energy in the power grid is increasing,and the random fluctuations in power output increase the risk of cascading failures in the power grid.In this paper,we propose a method for identifying high-risk scenarios of interlocking faults in new energy power grids based on a deep embedding clustering(DEC)algorithm and apply it in a risk assessment of cascading failures in different operating scenarios for new energy power grids.First,considering the real-time operation status and system structure of new energy power grids,the scenario cascading failure risk indicator is established.Based on this indicator,the risk of cascading failure is calculated for the scenario set,the scenarios are clustered based on the DEC algorithm,and the scenarios with the highest indicators are selected as the significant risk scenario set.The results of simulations with an example power grid show that our method can effectively identify scenarios with a high risk of cascading failures from a large number of scenarios.

Impact of interconnections and renewable energy integration on the Philippine-Sabah Power Grid systems

This study presents a comprehensive impact analysis of the rotor angle stability of a proposed international connection between the Philippines and Sabah,Malaysia,as part of the Association of Southeast Asian Nations(ASEAN)Power Grid.This study focuses on modeling and evaluating the dynamic performance of the interconnected system,considering the high penetration of renewable sources.Power flow,small signal stability,and transient stability analyses were conducted to assess the ability of the proposed linked power system models to withstand small and large disturbances,utilizing the Power Systems Analysis Toolbox(PSAT)software in MATLAB.All components used in the model are documented in the PSAT library.Currently,there is a lack of publicly available studies regarding the implementation of this specific system.Additionally,the study investigates the behavior of a system with a high penetration of renewable energy sources.Based on the findings,this study concludes that a system is generally stable when interconnection is realized,given its appropriate location and dynamic component parameters.Furthermore,the critical eigenvalues of the system also exhibited improvement as the renewable energy sources were augmented.

Research progress on protective coatings against molten nitrate salts for thermal energy storage in concentrating solar power plants

Concentrating solar power(CSP) has garnered considerable global attention as a reliable means of generating bulk electricity, effectively addressing the intermittent nature of solar resources.The integration of molten salt technology for thermal energy storage(TES) has further contributed to the growth of CSP plants;however, the corrosive nature of molten salts poses challenges to the durability of container materials, necessitating innovative corrosion mitigation strategies.This review summarizes scientific advancements in high-temperature anticorrosion coatings for molten nitrate salts, highlighting the key challenges and future trends.It also explores various coating types, including metallic, ceramic, and carbon-based coatings, and compares different coating deposition methods.This review emphasizes the need for durable coatings that meet long-term performance requirements and regulatory limitations, with an emphasis on carbon-based coatings and emerging nanomaterials.A combination of multiple coatings is required to achieve desirable anticorrosion properties while addressing material compatibility and cost considerations.The overall goal is to advance the manufacturing, assembly, and performance of CSP systems for increased efficiency, reliability, and durability in various applications.