Reinforcement Learning-Based Energy Management for Hybrid Power Systems:State-of-the-Art Survey,Review,and Perspectives

The new energy vehicle plays a crucial role in green transportation,and the energy management strategy of hybrid power systems is essential for ensuring energy-efficient driving.This paper presents a state-of-the-art survey and review of reinforcement learning-based energy management strategies for hybrid power systems.Additionally,it envisions the outlook for autonomous intelligent hybrid electric vehicles,with reinforcement learning as the foundational technology.First of all,to provide a macro view of historical development,the brief history of deep learning,reinforcement learning,and deep reinforcement learning is presented in the form of a timeline.Then,the comprehensive survey and review are conducted by collecting papers from mainstream academic databases.Enumerating most of the contributions based on three main directions—algorithm innovation,powertrain innovation,and environment innovation—provides an objective review of the research status.Finally,to advance the application of reinforcement learning in autonomous intelligent hybrid electric vehicles,future research plans positioned as“Alpha HEV”are envisioned,integrating Autopilot and energy-saving control.

Regenerative Braking Energy Recovery System of Metro Train Based on Dual-Mode Power Management

In order to fully utilize the regenerative braking energy of metro trains and stabilize the metro DC traction busbar voltage,a hybrid regenerative braking energy recovery system with a dual-mode power management strategy is proposed.Firstly,the construction of the hybrid regenerative braking energy recovery system is explained.Then,based on the power demand of low-voltage load in metro stations,a dual-mode power management strategy is proposed to allocate the reference power of each system according to the different working conditions,and the control methods of each system are set.Finally,the correctness and effectiveness of the dual-mode strategy are verified through simulation,and the proposed braking energy utilization scheme is compared with other singleform utilization schemes.The results illustrate that the hybrid system with the dual-mode strategy can effectively recycle the regenerative braking energy of metro train and inhibit the busbar voltage fluctuation;the proposed braking energy utilization scheme has certain advantages on energy recovery and DC bus voltage stabilization compared with other single-form schemes;the proposed power management strategy can correctly allocate the reference power of each system with a lower construction cost.

Research on Performance Optimization of Liquid Cooling and Composite Phase Change Material Coupling Cooling Thermal Management System for Vehicle Power Battery

The serpentine tube liquid cooling and composite PCM coupled cooling thermal management system is designed for 18650 cylindrical power batteries,with the maximum temperature and temperature difference of the power pack within the optimal temperature operating range as the target.The initial analysis of the battery pack at a 5C discharge rate,the influence of the single cell to cooling tube distance,the number of cooling tubes,inlet coolant temperature,the coolant flow rate,and other factors on the heat dissipation performance of the battery pack,initially determined a reasonable value for each design parameter.A control strategy is used to regulate the inlet flow rate and coolant temperature of the liquid cooling system in order to make full use of the latent heat of the composite PCM and reduce the pump’s energy consumption.The simulation results show that the maximum battery pack temperature of 309.8 K and the temperature difference of 4.6 K between individual cells with the control strategy are in the optimal temperature operating range of the power battery,and the utilization rate of the composite PCM is up to 90%.

基于PMS 3.0系统的设备运检大数据精益化管理

为适应电网内外部形势,解决传统设备(资产)运维精益管理系统(PMS 2.0)存在支撑能力不足等问题,以保障设备资产精益管理高效运营为核心,构建新一代设备资产精益管理系统(PMS 3.0)。通过PMS 3.0系统建设和应用过程中的经验,详细阐述了其建设的背景意义、实施方法、具体应用以及实践成效。推进“技术架构、安全策略、应用协同”三个升级,实现“设备、作业、管理、协同”四个数字化,有效提升了巡视效率,缩短停电时间,减少负荷损失,提升百姓的生活质量。

Energy Management System with Power Offering Strategy for a Microgrid Integrated VPP

In the context of both the Virtual Power Plant (VPP) and microgrid(MG), the Energy Management System (EMS) is a key decision-maker forintegrating Distributed renewable Energy Resources (DERs) efficiently. TheEMS is regarded as a strong enabler of providing the optimized schedulingcontrol in operation and management of usage of disperse DERs and RenewableEnergy reSources (RES) such as a small-size wind-turbine (WT) andphotovoltaic (PV) energies. The main objective to be pursued by the EMSis the minimization of the overall operating cost of the MG integrated VPPnetwork. However, the minimization of the power peaks is a new objective andopen issue to a well-functional EMS, along with the maximization of profitin the energy market. Thus, both objectives have to be taken into accountat the same time. Thus, this paper proposes the EMS application incorporatingpower offering strategy applying a nature-inspired algorithm such asParticle Swarm Optimization (PSO) algorithm, in order to find the optimalsolution of the objective function in the context of the overall operating cost,the coordination of DERs, and the energy losses in a MG integrated VPPnetwork. For a fair DERs coordination with minimized power fluctuationsin the power flow, the power offering strategies with an active power controland re-distribution are proposed. Simulation results show that the proposedMG integrated VPP model with PSO-based EMS employing EgalitarianreDistribution (ED) power offering strategy is most feasible option for theoverall operating cost of VPP revenue. The total operating cost of the proposedEMS with ED strategy is 40.98$ compared to 432.8$ of MGs only withoutEMS. It is concluded that each MGs in the proposed VPP model intelligentlyparticipates in energy trading market compliant with the objective function,to minimize the overall cost and the power fluctuation.

Development of Energy Management System for Micro Grid Operation

The introduction of several small and large-scale industries,malls,shopping complexes,and domestic applications has significantly increased energy consumption.The aim of the work is to simulate a technically viable and economically optimum hybrid power system for residential buildings.The proposed micro-grid model includes four power generators:solar power,wind power,Electricity Board(EB)source,and a Diesel Generator(DG)set,with solar and wind power performing as major sources and the EB supply and DG set serving as backup sources.The core issue in direct current to alternate current conversion is harmonics distortion,a five-stage multilevel inverter is employed with the assistance of an intelligent control system is simulated and the optimum system configuration is estimated to reduce harmonics and improve the power quality.The monthly demand for residential buildings is 13-15 Megawatts.So,almost 433 Kilo-Watts(KW)of electricity is required every day,and if it is used for 8 h per day,50-60 KW of electricity is needed per hour.The overall micro-grid model’s operation and performance are established using MATLAB/SIMULINK software,and simulation results are provided.The simulation results show that the developed system is both cost-effective and environment friendly resulting in yearly cost reductions.

"Emperor's Power Far Away from the Countryside"and"Town in Charge of Village Affairs":The Extreme Grass-roots Management System is Not Conducive to the Healthy Development of the Countryside

This paper compares the two different rural management methods of"emperor’s power far away from the countryside"and"town in charge of village affairs",which shows that the extreme grass-roots management system is not conducive to rural development.This paper also points out that rural development needs to find a road of sustainable development in line with its own characteristics,which is the fundamental shortcut to change poverty and become rich for a long time.

Application and Innovation of Equipment Reliability Management at Nuclear Power Stations

To achieve excellent production capability and maintain high security for nuclear power stations, equipment reliability is studied as a key issue. As the main branch, equipment reliability management is considered as an effective approach to make plant management strategy and organize routine work. Some achievements on research and application of equipment reliability management at Daya Bay Nuclear Power Station are introduced in this paper. By studying and implementing 1NPO （Institute of Nuclear Power Operations） AP-913 equipment reliability process, reliability-centered maintenance （RCM）, critical component management （CCM）, and many other similar methods, equipment reliability management system has been established at Daya Bay. And by continuous effort on improving application effect of these technologies, some innovation has also been made. Some innovative products, such as iSOM Intelligent Expert System, reliability and technique centered maintenance （RtCM）, predictive maintenance system （PdM）, and so on, have been developed. Based on these achievements, Daya Bay Nuclear Power Station has achieved excellent operation performance and won several prizes in WANO （World Association of Nuclear Operators） competition every year.

“OperaPMS”在酒店管理与数字化运营专业教学应用的途径与方法

为提升客人入住体验,酒店专业人才不仅需要熟练操作智能化系统,还需要基于客人实际需求灵活应用智能化功能与服务,体现个性化服务与细微服务。基于“Opera PMS”在酒店管理与数字化运营专业教学应用中的重要性,以浙江旅游职业学院、唐山工业职业技术学院、湖南工程职业技术学院3所高职院校的“Opera PMS”课程为研究对象,实际调研并对比分析教学实施情况,剖析教学过程中存在的问题及原因,就如何将“Opera PMS”技术与专业课程教学有机融合的问题,分别从重构专业核心能力课程体系,推进线上线下相结合的理实一体项目化教学,完善与落实机房管理制度以及持续性优化教师专业综合能力等方面提出“Opera PMS”教学应用的途径与方法。

数据可视化Power BI在职业院校学生管理中的应用

职业院校学生管理是一个重要而复杂的任务,需要学校管理人员的精心组织和有效执行。随着信息技术的发展和校园信息化建设的需求,部分职业院校的学生管理服务系统已初步建成。BI数据可视化可以有效地利用大量的系统数据,为院校管理者提高决策和治理水平提供依据。本文通过对BI数据可视化过程和结构进行分析,比较Power BI与传统型BI的差异,通过对Power BI数据可视化在职业院校学生管理中的应用分析和实践案例,验证数据可视化PowerBI在学生管理中的重要作用。

Optimal Power Management for Antagonizing Between Radar and Jamming Based on Continuous Game Theory

To solve the problem of dynamic power resource allocation for cooperative penetration combat,the continuous game theory is introduced and a two-person general-sum continuous-game-based model is put forward with a common payoff function named collaborative detection probability of netted radar countermeasures.Comparing with traditional optimization methods,an obvious advantage of game-based model is an adequate consideration of the opposite potential strategy.This model guarantees a more effective allocation of the both sides′power resource and a higher combat efficiency during a combat.Furthermore,an analysis of the complexity of the proposed model is given and a hierarchical processing method is presented to simplify the calculating process.Simulation results show the validity of the proposed scheme.

Analysis and management strategies for the low voltage problems of rural power grid based on the distribution network flow calculation method

For a long time, because of the lack of investment capital and enough attentions, the overall constructions of rural power grid were far behind than the urban power grid in Chongqing Jiangbei Power Company. The low voltage problems were highlighted in the rural power grid due to the characteristics of rural power grid. Using the distribution network flow calculation method, we evaluated the low voltage problems of the rural power grid which belongs to Chongqing Jiangbei Power Company. In addition, we collected the data of distribution transformers in electricity consumption peak period. Some practical management strategies were proposed by the analysis and evaluation of potential and appeared low voltage problems.

Power management unit chip design for automobile active-matrix organic light-emitting diode display module

A power management unit （PMU） chip supplying dual panel supply voltage, which has a low electro-magnetic interference （EMI） characteristic and is favorable for miniaturization, is designed. A two-phase charge pump circuit using external pumping capacitor increases its pumping current and works out the charge-loss problem by using bulk-potential biasing circuit. A low-power start-up circuit is also proposed to reduce the power consumption of the band-gap reference voltage generator. And the ring oscillator used in the ELVSS power circuit is designed with logic devices by supplying the logic power supply to reduce the layout area. The PMU chip is designed with MagnaChip＇s 0.25 μ high-voltage process. The driving currents of ELVDD and ELVSS are more than 50 mA when a SPICE simulation is done.

Optimal Energy Management for Virtual Power Plant with Renewable Generation

The nature of variable and uncertainty from renewable energy sources (RESs) makes them challenging to be integrated into the main grid separately. A Virtual Power Plant (VPP) is proposed to aggregate the capacities of RESs and facilitate the integration and management in a decentralized manner. In this paper, a novel framework for optimal energy management of VPP considering key features such as handling uncertainties with RESs, reducing operating costs and regulating system voltage levels is proposed, and a two-stage stochastic simulation is formulated to address the uncertainties of RESs generation and electricity prices. Simulation result show that the framework can benefit from ensuring the energy balance and system security, as well as reducing the operation costs.

Improving SINR via Joint Beam and Power Management for GEO and LEO Spectrum-Sharing Satellite Communication Systems

In this paper,we investigate a geosynchronous earth orbit(GEO)and low earth orbit(LEO)coexisting satellite communication system.To decrease the interference imposed on the GEO user caused by LEO satellites,we propose a joint beammanagement and power-allocation(JBMPA)scheme to maximize signal-to-interference plus noise ratio(SINR)at the GEO user,whilst maintaining the ongoing wireless links spanning from LEO satellites to their corresponding users.Specifically,we first analyze the overlapping coverage among GEO and LEO satellites,to obtain the LEO-satellite set in which their beams impose interference on the GEO user.Then,considering the traffic of LEO satellites in the obtained set,we design a beam-management method to turn off and switch interference beams of LEO satellites.Finally,we further propose a deep Q-network(DQN)aided power allocation algorithm to allocate the transmit power for the ongoing LEO satellites in the obtained set,whose beams are unable to be managed.Numerical results show that comparing with the traditional fixed beam with power allocation(FBPA)scheme,the proposed JBMPA can achieve a higher SINR and a lower outage probability,whilst guaranteeing the ongoing wireless transmissions of LEO satellites.

Study on green power supply modes for heavy load in Remote Areas

In this study,the present situation and characteristics of power supply in remote areas are summarized.By studying the cases of power supply projects in remote areas,the experience is analyzed and described,and the applicability of related technologies,such as grid-forming storage and power load management,is studied,including grid-connection technologies,such as grid-forming converters and power load management.On this basis,three power-supply modes were proposed.The application scenarios and advantages of the three modes were compared and analyzed.Based on the local development situation,the temporal sequences of the three schemes are described,and a case study was conducted.The study of the heavy-load power supply mode in remote areas contributes to solving the problem of heavy-load green power consumption in remote areas and promoting the further development of renewable energy.

IoT-Enabled Plant Monitoring System with Power Optimization and Secure Authentication

Global food security is a pressing issue that affects the stability and well-being of communities worldwide.While existing Internet of Things(IoT)enabled plant monitoring systems have made significant strides in agricultural monitoring,they often face limitations such as high power consumption,restricted mobility,complex deployment requirements,and inadequate security measures for data access.This paper introduces an enhanced IoT application for agricultural monitoring systems that address these critical shortcomings.Our system strategically combines power efficiency,portability,and secure access capabilities,assisting farmers in monitoring and tracking crop environmental conditions.The proposed system includes a remote camera that captures images of surrounding plants and a sensor module that regularly monitors various environmental factors,including temperature,humidity,and soil moisture.We implement power management strategies to minimize energy consumption compared to existing solutions.Unlike conventional systems,our implementation utilizes the Amazon Web Services(AWS)cloud platform for reliable data storage and processing while incorporating comprehensive security measures,including Two-Factor Authentication(2FA)and JSON Web Tokens(JWT),features often overlooked in current agricultural IoT solutions.Users can access this secure monitoring system via a developed Android application,providing convenient mobile access to the gathered plant data.We validate our system’s advantages by implementing it with two potted garlic plants on Okayama University’s rooftop.Our evaluation demonstrates high sensor reliabil-ity,with strong correlations between sensor readings and reference data,achieving determination coefficients(R2)of 0.979 for temperature and 0.750 for humidity measurements.The implemented power management strategies extend battery life to 10 days on a single charge,significantly outperforming existing systems that typically require daily recharging.Furthermore,our dual-layer security implementation utilizing 2FA and JWT successfully protects sensitive agricultural data from unauthorized access.

船机PMS控制技术及应用

本文介绍了功率管理系统的功能和特点,以及功率管理控制器在船机项目中的应用。

Conceptual Strategy for Mitigating the Risk of Hydrogen as an Internal Hazard in Case of Severe Accidents at Nuclear Power Plant Considering Existing Risks and Uncertainties Associated with the Use of Traditional Strategies

Hydrogen challenge mitigation stands as one of the main objectives in the management of severe accidents at Nuclear Power Plants (NPPs). Key strategies for hydrogen control include atmospheric inertization and hydrogen removal with Passive Autocatalytic Recombiners (PARs) being a commonly accepted approach. However, an examination of PAR operation specificity reveals potential inefficiencies and reliability issues in certain severe accident scenarios. Moreover, during the in-vessel stage of severe accident development, in some severe accident scenarios PARs can unexpectedly become a source of hydrogen detonation. The effectiveness of hydrogen removal systems depends on various factors, including the chosen strategies, severe accident scenarios, reactor building design, and other influencing factors. Consequently, a comprehensive hydrogen mitigation strategy must effectively incorporate a combination of strategies rather than be based on one strategy, taking into consideration the probabilistic risks and uncertainties associated with the implementation of PARs or other traditional methods. In response to these considerations, within the framework of this research it has been suggested a conceptual strategy to mitigate the hydrogen challenge during the in-vessel stage of severe accident development.

Power Management Integrated Circuit with 90Plus Efficiency Used in AC/DC Converter

Recently, resonant AC/DC converter has been accepted by the industry. However, the efficiency will be decreased at light load. So, a novel topology with critical controlling mode combined with resonant ones is proposed in this paper. The new topology can correspond to a 90 plus percent of power converting. So,a novel topology of an state of-art integrated circuit, which can be used as power management circuit, has been designed based on the above new topology. A simulator which is specific suitable for the power controller has been founded in this work and it has been used for the simulation of the novel architecture and the proposed integrated circuit.