Reinforcement Learning-Based Energy Management for Hybrid Power Systems:State-of-the-Art Survey,Review,and Perspectives

The new energy vehicle plays a crucial role in green transportation,and the energy management strategy of hybrid power systems is essential for ensuring energy-efficient driving.This paper presents a state-of-the-art survey and review of reinforcement learning-based energy management strategies for hybrid power systems.Additionally,it envisions the outlook for autonomous intelligent hybrid electric vehicles,with reinforcement learning as the foundational technology.First of all,to provide a macro view of historical development,the brief history of deep learning,reinforcement learning,and deep reinforcement learning is presented in the form of a timeline.Then,the comprehensive survey and review are conducted by collecting papers from mainstream academic databases.Enumerating most of the contributions based on three main directions—algorithm innovation,powertrain innovation,and environment innovation—provides an objective review of the research status.Finally,to advance the application of reinforcement learning in autonomous intelligent hybrid electric vehicles,future research plans positioned as“Alpha HEV”are envisioned,integrating Autopilot and energy-saving control.

Regenerative Braking Energy Recovery System of Metro Train Based on Dual-Mode Power Management

In order to fully utilize the regenerative braking energy of metro trains and stabilize the metro DC traction busbar voltage,a hybrid regenerative braking energy recovery system with a dual-mode power management strategy is proposed.Firstly,the construction of the hybrid regenerative braking energy recovery system is explained.Then,based on the power demand of low-voltage load in metro stations,a dual-mode power management strategy is proposed to allocate the reference power of each system according to the different working conditions,and the control methods of each system are set.Finally,the correctness and effectiveness of the dual-mode strategy are verified through simulation,and the proposed braking energy utilization scheme is compared with other singleform utilization schemes.The results illustrate that the hybrid system with the dual-mode strategy can effectively recycle the regenerative braking energy of metro train and inhibit the busbar voltage fluctuation;the proposed braking energy utilization scheme has certain advantages on energy recovery and DC bus voltage stabilization compared with other single-form schemes;the proposed power management strategy can correctly allocate the reference power of each system with a lower construction cost.

Optimal Power Management for Antagonizing Between Radar and Jamming Based on Continuous Game Theory

To solve the problem of dynamic power resource allocation for cooperative penetration combat,the continuous game theory is introduced and a two-person general-sum continuous-game-based model is put forward with a common payoff function named collaborative detection probability of netted radar countermeasures.Comparing with traditional optimization methods,an obvious advantage of game-based model is an adequate consideration of the opposite potential strategy.This model guarantees a more effective allocation of the both sides′power resource and a higher combat efficiency during a combat.Furthermore,an analysis of the complexity of the proposed model is given and a hierarchical processing method is presented to simplify the calculating process.Simulation results show the validity of the proposed scheme.

Analysis and management strategies for the low voltage problems of rural power grid based on the distribution network flow calculation method

For a long time, because of the lack of investment capital and enough attentions, the overall constructions of rural power grid were far behind than the urban power grid in Chongqing Jiangbei Power Company. The low voltage problems were highlighted in the rural power grid due to the characteristics of rural power grid. Using the distribution network flow calculation method, we evaluated the low voltage problems of the rural power grid which belongs to Chongqing Jiangbei Power Company. In addition, we collected the data of distribution transformers in electricity consumption peak period. Some practical management strategies were proposed by the analysis and evaluation of potential and appeared low voltage problems.

Power management unit chip design for automobile active-matrix organic light-emitting diode display module

A power management unit （PMU） chip supplying dual panel supply voltage, which has a low electro-magnetic interference （EMI） characteristic and is favorable for miniaturization, is designed. A two-phase charge pump circuit using external pumping capacitor increases its pumping current and works out the charge-loss problem by using bulk-potential biasing circuit. A low-power start-up circuit is also proposed to reduce the power consumption of the band-gap reference voltage generator. And the ring oscillator used in the ELVSS power circuit is designed with logic devices by supplying the logic power supply to reduce the layout area. The PMU chip is designed with MagnaChip＇s 0.25 μ high-voltage process. The driving currents of ELVDD and ELVSS are more than 50 mA when a SPICE simulation is done.

Optimal Energy Management for Virtual Power Plant with Renewable Generation

The nature of variable and uncertainty from renewable energy sources (RESs) makes them challenging to be integrated into the main grid separately. A Virtual Power Plant (VPP) is proposed to aggregate the capacities of RESs and facilitate the integration and management in a decentralized manner. In this paper, a novel framework for optimal energy management of VPP considering key features such as handling uncertainties with RESs, reducing operating costs and regulating system voltage levels is proposed, and a two-stage stochastic simulation is formulated to address the uncertainties of RESs generation and electricity prices. Simulation result show that the framework can benefit from ensuring the energy balance and system security, as well as reducing the operation costs.

Improving SINR via Joint Beam and Power Management for GEO and LEO Spectrum-Sharing Satellite Communication Systems

In this paper,we investigate a geosynchronous earth orbit(GEO)and low earth orbit(LEO)coexisting satellite communication system.To decrease the interference imposed on the GEO user caused by LEO satellites,we propose a joint beammanagement and power-allocation(JBMPA)scheme to maximize signal-to-interference plus noise ratio(SINR)at the GEO user,whilst maintaining the ongoing wireless links spanning from LEO satellites to their corresponding users.Specifically,we first analyze the overlapping coverage among GEO and LEO satellites,to obtain the LEO-satellite set in which their beams impose interference on the GEO user.Then,considering the traffic of LEO satellites in the obtained set,we design a beam-management method to turn off and switch interference beams of LEO satellites.Finally,we further propose a deep Q-network(DQN)aided power allocation algorithm to allocate the transmit power for the ongoing LEO satellites in the obtained set,whose beams are unable to be managed.Numerical results show that comparing with the traditional fixed beam with power allocation(FBPA)scheme,the proposed JBMPA can achieve a higher SINR and a lower outage probability,whilst guaranteeing the ongoing wireless transmissions of LEO satellites.

Research on Performance Optimization of Liquid Cooling and Composite Phase Change Material Coupling Cooling Thermal Management System for Vehicle Power Battery

The serpentine tube liquid cooling and composite PCM coupled cooling thermal management system is designed for 18650 cylindrical power batteries,with the maximum temperature and temperature difference of the power pack within the optimal temperature operating range as the target.The initial analysis of the battery pack at a 5C discharge rate,the influence of the single cell to cooling tube distance,the number of cooling tubes,inlet coolant temperature,the coolant flow rate,and other factors on the heat dissipation performance of the battery pack,initially determined a reasonable value for each design parameter.A control strategy is used to regulate the inlet flow rate and coolant temperature of the liquid cooling system in order to make full use of the latent heat of the composite PCM and reduce the pump’s energy consumption.The simulation results show that the maximum battery pack temperature of 309.8 K and the temperature difference of 4.6 K between individual cells with the control strategy are in the optimal temperature operating range of the power battery,and the utilization rate of the composite PCM is up to 90%.

Power Management Integrated Circuit with 90Plus Efficiency Used in AC/DC Converter

Recently, resonant AC/DC converter has been accepted by the industry. However, the efficiency will be decreased at light load. So, a novel topology with critical controlling mode combined with resonant ones is proposed in this paper. The new topology can correspond to a 90 plus percent of power converting. So,a novel topology of an state of-art integrated circuit, which can be used as power management circuit, has been designed based on the above new topology. A simulator which is specific suitable for the power controller has been founded in this work and it has been used for the simulation of the novel architecture and the proposed integrated circuit.

Pricing Power of Agricultural Products under the Background of Small Peasant Management and Information Asymmetry

From the background of small peasant management and information asymmetry,this paper introduced the middle profit sharing model and discussed influence factors and ownership of pricing power of agricultural products. It obtained following results:( i) the transaction scale has positive effect on farmer's pricing power of agricultural products,while the competitor's transaction scale has negative effect on it,so does the cost for information search;( ii) under the condition of small peasant management system,farmer is in a relatively weak position in the distribution of pricing power of agricultural products,due to factors such as small transaction scale,information asymmetry and farmer's weak negotiation ability;( iii) through cooperative game,farmer and buyers can share cooperative surplus at the agreed ratio;( iv) the introduction of self-organizing specialized farmers cooperatives is favorable for solving the problem of pricing power of agricultural products,and possible problems,such as " collective action dilemma" and " fake cooperatives" in the cooperative development process can be solved by internal and external division of labor and specialization of cooperatives.

Design of Multi-User Electric Power Management Device

The current consumption method of Electric Power Industry is “electricity consumption first, paying for it later”. The trend of consumption method is Pre-order Electricity. If we adopt the Pre-order Electricity System, we need to replace Traditional Energy Meter with Prepayment Energy Meter. But this alteration is costly. And the alarm action of Prepayment Energy Meter are bells and alarm lamp, users can not receive alarm information timely. In this paper, we present the design of Multi-user Electric Power Management Device. The device uses TMS320F2812 as CPU, with peripheral devices such as mobile phone communication module MC55, so the device supports remote operation and sends alarm information via SMS, it also can communicate with the master station by GPRS. The device can be seamlessly integrated into the existing power system in order to read meter, achieve billing and Pre-order Electricity functions. In addition, the device has the Harmonic Measurement function, so it is a high cost-effective application.

Design of Power Communication Data Network Management System and Implementation of Data Acquisition Module

The power communication network is a separate network from the power grid whose primary purpose is to ensure the power grid's safe operation.This paper expounds the composition of the comprehensive network management architecture of the power communication data network and the implementation of the data acquisition module in the network management system through theoretical analysis,for the reference of relevant personnel,in order to better promote the collection of power grid communication network data.

Energy Management System with Power Offering Strategy for a Microgrid Integrated VPP

In the context of both the Virtual Power Plant (VPP) and microgrid(MG), the Energy Management System (EMS) is a key decision-maker forintegrating Distributed renewable Energy Resources (DERs) efficiently. TheEMS is regarded as a strong enabler of providing the optimized schedulingcontrol in operation and management of usage of disperse DERs and RenewableEnergy reSources (RES) such as a small-size wind-turbine (WT) andphotovoltaic (PV) energies. The main objective to be pursued by the EMSis the minimization of the overall operating cost of the MG integrated VPPnetwork. However, the minimization of the power peaks is a new objective andopen issue to a well-functional EMS, along with the maximization of profitin the energy market. Thus, both objectives have to be taken into accountat the same time. Thus, this paper proposes the EMS application incorporatingpower offering strategy applying a nature-inspired algorithm such asParticle Swarm Optimization (PSO) algorithm, in order to find the optimalsolution of the objective function in the context of the overall operating cost,the coordination of DERs, and the energy losses in a MG integrated VPPnetwork. For a fair DERs coordination with minimized power fluctuationsin the power flow, the power offering strategies with an active power controland re-distribution are proposed. Simulation results show that the proposedMG integrated VPP model with PSO-based EMS employing EgalitarianreDistribution (ED) power offering strategy is most feasible option for theoverall operating cost of VPP revenue. The total operating cost of the proposedEMS with ED strategy is 40.98$ compared to 432.8$ of MGs only withoutEMS. It is concluded that each MGs in the proposed VPP model intelligentlyparticipates in energy trading market compliant with the objective function,to minimize the overall cost and the power fluctuation.

A novel design of power management integrated circuit with 90 plus efficiency used in AC/DC converter

Recently, resonant AC/DC converter has been accepted by the industry. However, the efficiency will be decreased at light load. So, a novel topology with critical controlling mode combined with resonant ones is proposed in this paper. The new topology can correspond to a 90 plus percent of power converting. So,a novel topology of an state of art integrated circuit, which can be used as power management circuit, has been designed based on the above new topology. A simulator which is specifically suitable for the power controller has been founded in this work and it has been used for the simulation of the novel architecture and the proposed integrated circuit.

Discussion on Project Management Mode and Power Engineering Management

In view of the current development of power engineering management,traditional management methods can no longer be applied to the management of current power engineering work.Therefore,it is necessary to innovate and optimize existing project management modes,transform traditional management concepts and models,focus on addressing the problems in project management and improve management.This paper mainly analyzes the project management mode and power engineering management.

Perception and Uses of Stakeholders＇ Power on Health and Safety Risk Management in Construction Projects in Tanzania

Key project stakeholders such as clients, consultant teams, contractors and workers have different sources of power to implement projects. How these powers influence health and safety risk management is not well documented. This article therefore assesses the perception and uses of stakeholders＇ power on health and safety in risk management in construction projects in Tanzania, specifically focuses on sources and types of power, how stakeholders perceive their power, how they use power on health and safety risk management, and what factors hinders their use of power. A case study strategy was adopted and four large on-going construction projects in Dar es Salaam Tanzania were involved. Data was collected through in-depth interviews with clients, consultants, contractors and construction workers. Findings indicate that stakeholders have different sources of power such as technical expertise, legitimate, political position, resources information to influence health and safety risk management. Nonetheless, the use of these powers was generally limited due to low level of knowledge on health and safety risk management among stakeholders, wrong perception on their roles, insufficient health and safety regulations and weak procurement system. The research recommends that, in order to realize health and safety performance through using stakeholder＇s power, there is a need of clear definition of stakeholders＇ role and responsibilities on health and safety, wide knowledge and experiences on health and safety risk management, strong regulatory system and procurement system.

"Emperor's Power Far Away from the Countryside"and"Town in Charge of Village Affairs":The Extreme Grass-roots Management System is Not Conducive to the Healthy Development of the Countryside

This paper compares the two different rural management methods of"emperor’s power far away from the countryside"and"town in charge of village affairs",which shows that the extreme grass-roots management system is not conducive to rural development.This paper also points out that rural development needs to find a road of sustainable development in line with its own characteristics,which is the fundamental shortcut to change poverty and become rich for a long time.

Initiative Optimization Operation Strategy and Multi-objective Energy Management Method for Combined Cooling Heating and Power

This paper proposed an initiative optimization operation strategy and multi-objective energy management method for combined cooling heating and power U+0028 CCHP U+0029 with storage systems. Initially, the initiative optimization operation strategy of CCHP system in the cooling season, the heating season and the transition season was formulated. The energy management of CCHP system was optimized by the multi-objective optimization model with maximum daily energy efficiency, minimum daily carbon emissions and minimum daily operation cost based on the proposed initiative optimization operation strategy. Furthermore, the pareto optimal solution set was solved by using the niche particle swarm multi-objective optimization algorithm. Ultimately, the most satisfactory energy management scheme was obtained by using the technique for order preference by similarity to ideal solution U+0028 TOPSIS U+0029 method. A case study of CCHP system used in a hospital in the north of China validated the effectiveness of this method. The results showed that the satisfactory energy management scheme of CCHP system was obtained based on this initiative optimization operation strategy and multi-objective energy management method. The CCHP system has achieved better energy efficiency, environmental protection and economic benefits. © 2014 Chinese Association of Automation.

The Application of Principle of Automatic Control in the site Management of Electric Power Construction Enterprise

It is need to establish site project department during the construction of electric power project.The head office should design and build the main structure,continually improve structure of project department,meantime,positively apply principle of automatic control to improve the site management of electric power construction.In this article,the application strategy of principle of automatic control is analyzed focusing on the site work of electric power construction.