Reinforcement Learning-Based Energy Management for Hybrid Power Systems:State-of-the-Art Survey,Review,and Perspectives

The new energy vehicle plays a crucial role in green transportation,and the energy management strategy of hybrid power systems is essential for ensuring energy-efficient driving.This paper presents a state-of-the-art survey and review of reinforcement learning-based energy management strategies for hybrid power systems.Additionally,it envisions the outlook for autonomous intelligent hybrid electric vehicles,with reinforcement learning as the foundational technology.First of all,to provide a macro view of historical development,the brief history of deep learning,reinforcement learning,and deep reinforcement learning is presented in the form of a timeline.Then,the comprehensive survey and review are conducted by collecting papers from mainstream academic databases.Enumerating most of the contributions based on three main directions—algorithm innovation,powertrain innovation,and environment innovation—provides an objective review of the research status.Finally,to advance the application of reinforcement learning in autonomous intelligent hybrid electric vehicles,future research plans positioned as“Alpha HEV”are envisioned,integrating Autopilot and energy-saving control.

Reliability-BasedModel for Incomplete Preventive ReplacementMaintenance of Photovoltaic Power Systems

At present,the operation and maintenance of photovoltaic power generation systems mainly comprise regular maintenance,breakdown maintenance,and condition-based maintenance,which is very likely to lead to over-or under-repair of equipment.Therefore,a preventive maintenance and replacement strategy for PV power generation systems based on reliability as a constraint is proposed.First,a hybrid failure function with a decreasing service age factor and an increasing failure rate factor is introduced to describe the deterioration of PV power generation equipment,and the equipment is replaced when its reliability drops to the replacement threshold in the last cycle.Then,based on the reliability as a constraint,the average maintenance cost and availability of the equipment are considered,and the non-periodic incomplete maintenance model of the PV power generation system is established to obtain the optimal number of repairs,each maintenance cycle and the replacement cycle of the PV power generation system components.Next,the inverter of a PV power plant is used as a research object.The model in this paper is compared and analyzed with the equal cycle maintenance model without considering reliability and the maintenance model without considering the equipment replacement threshold,Through model comparison,when the optimal maintenance strategy is(0.80,4),the average maintenance cost of this paper’s model are decreased by 20.3%and 5.54%and the availability is increased by 0.2395% and 0.0337%,respectively,compared with the equal-cycle maintenance model without considering the reliability constraint and the maintenance model without considering the equipment replacement threshold.Therefore,this maintenance model can ensure the high reliability of PV plant operation while increasing the equipment availability to improve the system economy.

Energy Control of Plug-In Hybrid Electric Vehicles Using Model Predictive Control With Route Preview

The paper proposes an adoption of slope,elevation,speed and route distance preview to achieve optimal energymanagement of plug-in hybrid electric vehicles(PHEVs).Theapproach is to identify route features from historical and real-time traffic data,in which information fusion model and trafficprediction model are used to improve the information accuracy.Then,dynamic programming combined with equivalent con-sumption minimization strategy is used to compute an optimalsolution for real-time energy management.The solution is thereference for PHEV energy management control along the route.To improve the system's ability of handling changing situation,the study further explores predictive control model in the real-time control of the energy.A simulation is performed to modelPHEV under above energy control strategy with route preview.The results show that the average fuel consumption of PHEValong the previewed route with model predictive control(MPC)strategy can be reduced compared with optimal strategy andbase control strategy.

Simulation research of energy management strategy for dual mode plug-in hybrid electrical vehicles

In this paper, a plug-in hybrid electrical vehicle(PHEV) is taken as the research object, and its dynamic performance and economic performance are taken as the research goals. Battery charge-sustaining(CS) period is divided into power mode and economy mode. Energy management strategy designing methods of power mode and economy mode are proposed. Maximum velocity, acceleration performance and fuel consumption are simulated during the CS period in the AVL CRUISE simulation environment. The simulation results indicate that the maximum velocity and acceleration time of the power mode are better than those in the economy mode. Fuel consumption of the economy mode is better than that in the power mode. Fuel consumption of PHEV during the CS period is further improved by using the methods proposed in this paper, and this is meaningful for research and development of PHEV.

Hybrid Simulation of ±500 kV HVDC Power Transmission Project Based on Advanced Digital Power System Simulator

In order to effectively imitate the dynamic operation characteristics of the HVDC （high voltage direct current） power transmission system at a real ±500kV HVDC transmission project, the electromechanical-electromagnetic transient hybrid simulation was carried out based on advanced digital power system simulator （ADPSS）. In the simulation analysis, the built hybrid model＇s dynamic response outputs under three different fault conditions are considered, and by comparing with the selected fault recording waveforms, the validities of the simulation waveforms are estimated qualitatively. It can be ascertained that the hybrid simulation model has the ability to describe the HVDC system＇s dynamic change trends well under some special fault conditions.

Variable Parameter Self-Adaptive Control Strategy Based on Driving Condition Identification for Plug-In Hybrid Electric Bus

A variable parameter self-adaptive control strategy based on driving condition identification is proposed to take full advantage of the fuel saving potential of the plug-in hybrid electric bus(PHEB).Firstly,the principal component analysis(PCA)and the fuzzy c-means clustering(FCM)algorithm is used to construct the comprehensive driving cycle,congestion driving cycle,urban driving cycle and suburban driving cycle of Chinese urban buses.Secondly,an improved particle swarm optimization(IPSO)algorithm is proposed,and is used to optimize the control parameters of PHEB under different driving cycles,respectively.Then,the variable parameter self-adaptive control strategy based on driving condition identification is given.Finally,for an actual running vehicle,the driving condition is identified by relevance vector machine(RVM),and the corresponding control parameters are selected to control the vehicle.The simulation results show that the fuel consumption of using the variable parameter self-adaptive control strategy is reduced by 4.2% compared with that of the fixed parameter control strategy,and the feasibility of the variable parameter self-adaptive control strategy is verified.

Hybrid Power Systems Energy Controller Based on Neural Network and Fuzzy Logic

This paper presents a novel adaptive scheme for energy management in stand-alone hybrid power systems. The proposed management system is designed to manage the power flow between the hybrid power system and energy storage elements in order to satisfy the load requirements based on artificial neural network (ANN) and fuzzy logic controllers. The neural network controller is employed to achieve the maximum power point (MPP) for different types of photovoltaic (PV) panels. The advance fuzzy logic controller is developed to distribute the power among the hybrid system and to manage the charge and discharge current flow for performance optimization. The developed management system performance was assessed using a hybrid system comprised PV panels, wind turbine (WT), battery storage, and proton exchange membrane fuel cell (PEMFC). To improve the generating performance of the PEMFC and prolong its life, stack temperature is controlled by a fuzzy logic controller. The dynamic behavior of the proposed model is examined under different operating conditions. Real-time measured parameters are used as inputs for the developed system. The proposed model and its control strategy offer a proper tool for optimizing hybrid power system performance, such as that used in smart-house applications.

Performance of a Wind-Diesel Hybrid Power System with STATCOM as a Reactive Power Compensator

The paper deals with automatic reactive power control of an isolated wind-diesel hybrid power system. The power is generated by diesel engine and wind turbine as prime movers with electrical power conversion by permanent-magnet synchronous generator (PMSG) and permanent-magnet induction generator (PMIG) respectively. The mathematical model of the system developed is based on reactive power flow equations. The paper investigates the dynamic performance of the hybrid system for 1% step increase in reactive power load with 1% step increase in input wind power.

Analysis of Hybrid Rechargeable Energy Storage Systems in Series Plug-In Hybrid Electric Vehicles Based on Simulations

In this paper, an extended analysis of the performance of different hybrid Rechargeable Energy Storage Systems (RESS) for use in Plug-in Hybrid Electric Vehicle (PHEV) with a series drivetrain topology is analyzed, based on simulations with three different driving cycles. The investigated hybrid energy storage topologies are an energy optimized lithium-ion battery (HE) in combination with an Electrical Double-Layer Capacitor (EDLC) system, in combination with a power optimized lithium-ion battery (HP) system or in combination with a Lithium-ion Capacitor (LiCap) system, that act as a Peak Power System. From the simulation results it was observed that hybridization of the HE lithium-ion based energy storage system resulted from the three topologies in an increased overall energy efficiency of the RESS, in an extended all electric range of the PHEV and in a reduced average current through the HE battery. The lowest consumption during the three driving cycles was obtained for the HE-LiCap topology, where fuel savings of respectively 6.0%, 10.3% and 6.8% compared with the battery stand-alone system were achieved. The largest extension of the range was achieved for the HE-HP configuration (17% based on FTP-75 driving cycle). HP batteries however have a large internal resistance in comparison to EDLC and LiCap systems, which resulted in a reduced overall energy efficiency of the hybrid RESS. Additionally, it was observed that the HP and LiCap systems both offer significant benefits for the integration of a peak power system in the drivetrain of a Plug-in Hybrid Electric Vehicle due to their low volume and weight in comparison to that of the EDLC system.

向电动车看齐 PRIUS PLUG-IN HYBRID

单从环保方面来说,纯电动车无疑是最优秀的,但是充电设施的不完善以及自身续航里程有限等因素依然制约着纯电动车的发展,而单纯的混合动力车型在控制CO2排放方面能力有限,于是一种名为"PHEV"的车型诞生了。

Research and practice of designing hydro/ photovoltaic hybrid power system in microgrid

Small-hydro power station is often used in remote areas beside a river,but it doesn't match electricity demand so well,especially in dry seasons. A photovoltaic (PV) system with battery is a suitable option to complement the electricity gap. In this paper,a new structure of megawatt-class PV system integrating battery at DC-bus (DC: direct current) is proposed to be used in hydro/PV hybrid power system,and 4 main designing considerations and several key equipments are discussed. In 2011,a 2 MWp PV station with the proposed structure was built up in Yushu,China. From stability analysis,the station shows a strong stability under load cut-in/off and solar irradiance's fluctuation.

Hybrid Power System Power Flow Analysis

Hybrid power supply system consists of a number of independent and different sources of electrical energy with different operating times during different seasons and with energy storage system. Deployment of a hybrid power system is expected in places outside the normal distribution network. For the further research and improvements it is necessary to know in detail the power flow from various sources to the load or to storage battery depending on different seasons. The paper presents data analysis results computed by application developed for detailed analysis of power flows within hybrid power system. Developed application analyses the data from the monitoring system. Data has been acquired and recorded within last year. This data is visualized as power flows in the individual hybrid power system circuits. Together with electrical power the effectiveness and performance parameters of rectifier and DC/AC converter are evaluated. The paper describes achieved results and needs for further improvements of such solution.

Effect of Probabilistic Pattern on System Voltage Stability in Decentralized Hybrid Power System

This paper presents an proportional integral (PI) based voltage-reactive power control for wind diesel based decentralized hybrid power system with wide range of disturbances to demonstrate the compensation effect on system with intelligent tuning methods such as genetic algorithm (GA), artificial neural network (ANN) and adaptive neuro fuzzy inference system (ANFIS). The effect of probabilistic load and/or input power pattern is introduced which is incorporated in MATLAB simulink model developed for the study of decentralized hybrid power system. Results show how tuning method becomes important with high percentage of probabilistic pattern in system. Testing of all tuning methods shows that GA, ANN and ANFIS can preserve optimal performances over wide range of disturbances with superiority to GA in terms of settling time using Integral of Square of Errors (ISE) criterion as fitness function.

Hybrid Power System Options for Off-Grid Rural Electrification in Northern Kenya

For domestic consumers in the rural areas of northern Kenya, as in other developing countries, the typical source of electrical supply is diesel generators. However, diesel generators are associated with both CO2 emissions, which adversely affect the environment and increase diesel fuel prices, which inflate the prices of consumer goods. The Kenya government has taken steps towards addressing this issue by proposing The Hybrid Mini-Grid Project, which involves the installation of 3 MW of wind and solar energy systems in facilities with existing diesel generators. However, this project has not yet been implemented. As a contribution to this effort, this study proposes, simulates and analyzes five different configurations of hybrid energy systems incorporating wind energy, solar energy and battery storage to replace the stand-alone diesel power systems servicing six remote villages in northern Kenya. If implemented, the systems proposed here would reduce Kenya’s dependency on diesel fuel, leading to reductions in its carbon footprint. This analysis confirms the feasibility of these hybrid systems with many configurations being profitable. A Multi-Attribute Trade-Off Analysis is employed to determine the best hybrid system configuration option that would reduce diesel fuel consumption and jointly minimize CO2 emissions and net present cost. This analysis determined that a wind-diesel-battery configuration consisting of two 500 kW turbines, 1200 kW diesel capacity and 95,040 Ah battery capacity is the best option to replace a 3200 kW stand-alone diesel system providing electricity to a village with a peak demand of 839 kW. It has the potential to reduce diesel fuel consumption and CO2 emissions by up to 98.8%.

大佬的环保生活 NEW BENZ S 500 PLUG-IN HYBRID

众所周知，以丰田为代表的日系车企在混合动力及插电式混合动力领域一直处于行业领先水平，但是其他车企并未坐以待毙，奔驰公司曾以老款S级轿车为基础研发混合动力及插电式混合动力技术，并于2009正式推出S 400 Hybrid车型以及S 500 Plug-in Hybrid概念车。如今，经过4年的进化和发展，插电式混合动力技术也更趋成熟，于是今年的法兰克福车展就成了奔驰S 500 Plug-in Hybrid量产车型首发亮相的最佳舞台。

OPEL GRANDLAND X PLUG-IN HYBRID4 能“混”才行

'随着各家车企都在新能源领域进行着自己的努力,似乎再不行动的汽车品牌就会被这个时代抛弃。日前,在中国已很少见却在欧洲混得风生水起的欧宝推出了旗下首款插电混合动力车型——Grandland X Plug-in Hybrid4,正如其名称所写的那样,新车型是基于Grandland X打造而来。'

混出精彩 VOLVO XC60 PLUG-IN HYBRID CONCEPT

凭借着高大宽敞的空间和底盘的高通过性,在自驾游越来越盛行的今天,SUV车型慢慢成了市场上的＂香馍馍＂,其市场热度毫不逊色于小排量车型。但高油耗和高排放的环保问题成为制约其进一步发展的瓶颈,于是开发混合动力的SUV车型成为汽车厂商研发的一个重点。

Plug-in Hybrid启示录

2009年的法兰克福和东京车展中，奔驰、宝马、丰田、铃木、三菱等都展出了他们的插电式混合动力车，这是否代表这种技术已经是新一代混合动力车的趋势？

起亚Ray Plug-In Hybrid

全新Ray概念车乃由Kia美国设计中心操刀，旨在将Kia新一代设计元素，融合在Plug—in Hybrid插电式油电混合车款之中。目前正在研究替代动力的方案。而Kia也计划在今年内，将LPG Hybrid液化石油气混合动力车款导入市售量产阶段，并在韩国开售。