Enhanced Deep Reinforcement Learning Strategy for Energy Management in Plug-in Hybrid Electric Vehicles with Entropy Regularization and Prioritized Experience Replay

Plug-in Hybrid Electric Vehicles(PHEVs)represent an innovative breed of transportation,harnessing diverse power sources for enhanced performance.Energy management strategies(EMSs)that coordinate and control different energy sources is a critical component of PHEV control technology,directly impacting overall vehicle performance.This study proposes an improved deep reinforcement learning(DRL)-based EMSthat optimizes realtime energy allocation and coordinates the operation of multiple power sources.Conventional DRL algorithms struggle to effectively explore all possible state-action combinations within high-dimensional state and action spaces.They often fail to strike an optimal balance between exploration and exploitation,and their assumption of a static environment limits their ability to adapt to changing conditions.Moreover,these algorithms suffer from low sample efficiency.Collectively,these factors contribute to convergence difficulties,low learning efficiency,and instability.To address these challenges,the Deep Deterministic Policy Gradient(DDPG)algorithm is enhanced using entropy regularization and a summation tree-based Prioritized Experience Replay(PER)method,aiming to improve exploration performance and learning efficiency from experience samples.Additionally,the correspondingMarkovDecision Process(MDP)is established.Finally,an EMSbased on the improvedDRLmodel is presented.Comparative simulation experiments are conducted against rule-based,optimization-based,andDRL-based EMSs.The proposed strategy exhibitsminimal deviation fromthe optimal solution obtained by the dynamic programming(DP)strategy that requires global information.In the typical driving scenarios based onWorld Light Vehicle Test Cycle(WLTC)and New European Driving Cycle(NEDC),the proposed method achieved a fuel consumption of 2698.65 g and an Equivalent Fuel Consumption(EFC)of 2696.77 g.Compared to the DP strategy baseline,the proposed method improved the fuel efficiency variances(FEV)by 18.13%,15.1%,and 8.37%over the Deep QNetwork(DQN),Double DRL(DDRL),and original DDPG methods,respectively.The observational outcomes demonstrate that the proposed EMS based on improved DRL framework possesses good real-time performance,stability,and reliability,effectively optimizing vehicle economy and fuel consumption.

Novel flexible hybrid electric system and adaptive online-optimal energy management controller for plug-in hybrid electric vehicles

In order to achieve the improvement of the driving comfort and energy efficiency,an new e-CVT flexible full hybrid electric system(E2FHS) is proposed,which uses an integrated main drive motor and generator to take the place of the original automatic or manual transmission to realize the functions of continuously variable transmission(e-CVT).The design and prototype realization of the E2FHS system for a plug-in hybrid vehicle(PHEV) is performed.In order to analyze and optimize the parameters and the power flux between different parts of the E2FHS,simulation software is developed.Especially,in order to optimize the performance of the energy economy improvement of the E2FHS,the effect of the different energy management controllers is investigated,and an adaptive online-optimal energy management controller for the E2FHS is built and validated by the prototype PHEV.

Energy Control of Plug-In Hybrid Electric Vehicles Using Model Predictive Control With Route Preview

The paper proposes an adoption of slope,elevation,speed and route distance preview to achieve optimal energymanagement of plug-in hybrid electric vehicles(PHEVs).Theapproach is to identify route features from historical and real-time traffic data,in which information fusion model and trafficprediction model are used to improve the information accuracy.Then,dynamic programming combined with equivalent con-sumption minimization strategy is used to compute an optimalsolution for real-time energy management.The solution is thereference for PHEV energy management control along the route.To improve the system's ability of handling changing situation,the study further explores predictive control model in the real-time control of the energy.A simulation is performed to modelPHEV under above energy control strategy with route preview.The results show that the average fuel consumption of PHEValong the previewed route with model predictive control(MPC)strategy can be reduced compared with optimal strategy andbase control strategy.

Simulation research of energy management strategy for dual mode plug-in hybrid electrical vehicles

In this paper, a plug-in hybrid electrical vehicle(PHEV) is taken as the research object, and its dynamic performance and economic performance are taken as the research goals. Battery charge-sustaining(CS) period is divided into power mode and economy mode. Energy management strategy designing methods of power mode and economy mode are proposed. Maximum velocity, acceleration performance and fuel consumption are simulated during the CS period in the AVL CRUISE simulation environment. The simulation results indicate that the maximum velocity and acceleration time of the power mode are better than those in the economy mode. Fuel consumption of the economy mode is better than that in the power mode. Fuel consumption of PHEV during the CS period is further improved by using the methods proposed in this paper, and this is meaningful for research and development of PHEV.

Analysis of Hybrid Rechargeable Energy Storage Systems in Series Plug-In Hybrid Electric Vehicles Based on Simulations

In this paper, an extended analysis of the performance of different hybrid Rechargeable Energy Storage Systems (RESS) for use in Plug-in Hybrid Electric Vehicle (PHEV) with a series drivetrain topology is analyzed, based on simulations with three different driving cycles. The investigated hybrid energy storage topologies are an energy optimized lithium-ion battery (HE) in combination with an Electrical Double-Layer Capacitor (EDLC) system, in combination with a power optimized lithium-ion battery (HP) system or in combination with a Lithium-ion Capacitor (LiCap) system, that act as a Peak Power System. From the simulation results it was observed that hybridization of the HE lithium-ion based energy storage system resulted from the three topologies in an increased overall energy efficiency of the RESS, in an extended all electric range of the PHEV and in a reduced average current through the HE battery. The lowest consumption during the three driving cycles was obtained for the HE-LiCap topology, where fuel savings of respectively 6.0%, 10.3% and 6.8% compared with the battery stand-alone system were achieved. The largest extension of the range was achieved for the HE-HP configuration (17% based on FTP-75 driving cycle). HP batteries however have a large internal resistance in comparison to EDLC and LiCap systems, which resulted in a reduced overall energy efficiency of the hybrid RESS. Additionally, it was observed that the HP and LiCap systems both offer significant benefits for the integration of a peak power system in the drivetrain of a Plug-in Hybrid Electric Vehicle due to their low volume and weight in comparison to that of the EDLC system.

An optimal energy management development for various configuration of plug-in and hybrid electric vehicle

Due to soaring fuel prices and environmental concerns, hybrid electric vehicle(HEV) technology attracts more attentions in last decade. Energy management system, configuration of HEV and traffic conditions are the main factors which affect HEV's fuel consumption, emission and performance. Therefore, optimal management of the energy components is a key element for the success of a HEV. An optimal energy management system is developed for HEV based on genetic algorithm. Then, different powertrain system component combinations effects are investigated in various driving cycles. HEV simulation results are compared for default rule-based, fuzzy and GA-fuzzy controllers by using ADVISOR. The results indicate the effectiveness of proposed optimal controller over real world driving cycles. Also, an optimal powertrain configuration to improve fuel consumption and emission efficiency is proposed for each driving condition. Finally, the effects of batteries in initial state of charge and hybridization factor are investigated on HEV performance to evaluate fuel consumption and emissions. Fuel consumption average reduction of about 14% is obtained for optimal configuration data in contrast to default configuration. Also results indicate that proposed controller has reduced emission of about 10% in various traffic conditions.

The Future Trend of E-Mobility in Terms of Battery Electric Vehicles and Their Impact on Climate Change: A Case Study Applied in Hungary

The transportation sector is responsible for 25% of the total Carbon dioxide (CO2) emissions, whereas 60.6% of this sector represents small and medium passenger cars. However, as noted by the European Union Long-term strategy, there are two ways to reduce the amount of CO2 emissions in the transportation sector. The first way is characterized by creating more efficient vehicles. In contrast, the second way is characterized by changing the fuel used. The current study addressed the second way, changing the fuel type. The study examined the potential of battery electric vehicles (BEVs) as an alternative fuel type to reduce CO2 emissions in Hungarys transportation sector. The study used secondary data retrieved from Statista and stata.com to analyze the future trends of BEVs in Hungary. The results showed that the percentage of BEVs in Hungary in 2022 was 0.4% compared to the total number of registered passenger cars, which is 3.8 million. The simple exponential smoothing (SES) time series forecast revealed that the number of BEVs is expected to reach 84,192 in 2030, indicating a percentage increase of 2.21% in the next eight years. The study suggests that increasing the number of BEVs is necessary to address the negative impact of CO2 emissions on society. The Hungarian Ministry of Innovation and Technologys strategy to reduce the cost of BEVs may increase the percentage of BEVs by 10%, resulting in a potential average reduction of 76,957,600 g/km of CO2 compared to gasoline, diesel, hybrid electric vehicles (HEVs), and plug-in hybrid vehicles (PHEVs).

Vehicle-to-grid power system services with electric and plug - in vehicles based on flexibility in unidirectional charging

With proper power scheduling and dynamic pricing,a unidirectional charger can provide benefits and regulation services to the electricity grid,at a level approaching that of bidirectional charging.Power scheduling and schedule flexibility of electric and plug-in hybrid vehicles are addressed.The use of electric vehicles(EVs)as flexibility resources and associated unidirectional vehicle-to-grid benefits are investigated.Power can be scheduled with the EV charger in control of charging or via control by a utility or an aggregator.Charging cost functions suitable for charger-and utility-controlled power scheduling are presented.Ancillary service levels possible with unidirectional vehicle-to-grid are quantified using sample charging scenarios from published data.Impacts of various power schedules and vehicle participation as a flexibility resource on electricity locational prices are evaluated.These include benefits to both owners and load-serving entities.Frequency regulation is considered in the context of unidirectional charging.

Applications of Serial-Parallel Compensated Resonant Topology in Wireless Charger System Used in Electric Vehicles

There are lots of factors that can influence the wireless charging efficiency in practice, such as misalignment and air-gap difference, which can also change all the charging parameters. To figure out the relationship between those facts and system, this paper presents a serial-parallel compensated(SPC) topology for electric vehicle/plug-in hybrid electric vehicle(EV/PHEV) wireless charger and provides all the parameters changing with corresponding curves. An ANSYS model is built to extract the coupling coefficient of coils. When the system is works at constant output power, the scan frequency process can be applied to wireless power transfer(WPT) and get the resonant frequency. In this way, it could determine the best frequency for system to achieve zero voltage switching status and force the system to hit the maximum transmission efficiency. Then frequency tracking control(FTC) is used to obtain the highest system efficiency. In the paper, the designed system is rated at 500 W with 15 cm air-gap, the overall efficiency is 92%. At the end, the paper also gives the consideration on how to improve the system efficiency.

Plug-In Vehicle Acceptance and Probable Utilization Behaviour

This paper presents a study undertaken to understand the plug-in vehicle acceptance and probable utilization behaviour in terms of charging habits and utility factor (probability of driving in electrical mode). A survey was designed to be answered via World Wide Web, throughout 3 months and only accessible to Portuguese inhabitants. The survey was composed by biographical and car ownership info, mobility patterns, awareness toward plug-in vehicle technologies, price premium and, finally, potential buyer’s attitudes regarding charging vehicles with electricity from the grid. An explanation of how each vehicle technology works in the case of a regular hybrid (HEV), a plug-in hybrid (PHEV) and a pure electric vehicle (EV) was provided. A total sample of 809 volunteers answered the survey, aged above 18 years old, 50% male and 50% female. The results allowed the estimation of the typical daily driving distance, the Utility Factor curve for plug-in hybrid future users, the charging preferences for future users of pure electric or plug-in hybrid vehicles and the necessary feebates to promote the market penetration of such technologies. Other correlations were also analyzed between driving patterns, type of owned car, price premium and the willingness to buy pure electric and plug-in hybrid vehicles. The main policy implications are that an increase of awareness campaigns is necessary if the government intends to support the plug-in electric vehicle technology widespread and a minimum of 5000 € investment per ton of avoided CO2 will be necessary in a year.

Study on ultracapacitor-battery hybrid power system for PHEV applications

For the battery only power system is hard to meet the energy and power requirements reasonably, a hybrid power system with uhracapacitor and battery is studied. A Topology structure is analyzed that the uhracapacitor system is connected with battery pack parallel after a bidirectional DC/DC converter. The ultracapacitor, battery and the hybrid power system are modeled. For the plug-in hybrid electric vehicle （PHEV） application, the control target and control strategy of the hybrid power system are put forward. From the simulation results based on the Chinese urban driving cycle, the hybrid power system could meet the peak power requirements reasonably while the battery pack＇ s current is controlled in a reasonable limit which will be helpful to optimize the battery pack＇ s working conditions to get long cycling life and high efficiency.

Microgrid economic operation considering plug-in hybrid electric vehicles integration

In this paper,the microgrid economic scheduling mathematical model considering the integration of plug-in hybrid electric vehicles(PHEVs)is presented and the influence of different charging and discharging modes on microgrid economic operation is analyzed.The generic algorithm is used to find an economically optimal solution for the microgrid and PHEV owners.The scheduling of PHEVs and the microgrid are optimized to reduce daily electricity cost and the potential benefits of controlled charging/discharging are explored systematically.Constraints caused by vehicle utilization as well as technical limitations of distributed generation and energy storage system are taken into account.The proposed economic scheduling is evaluated through a simulation by using a typical grid-connected microgrid model.

Combined Prediction for Vehicle Speed with Fixed Route

Achieving accurate speed prediction provides the most critical support parameter for high-level energy management of plug-in hybrid electric vehicles.Nowadays,people often drive a vehicle on fixed routes in their daily travels and accurate speed predictions of these routes are possible with random prediction and machine learning,but the prediction accuracy still needs to be improved.The prediction accuracy of traditional prediction algorithms is difficult to further improve after reaching a certain accuracy;problems,such as over fitting,occur in the process of improving prediction accuracy.The combined prediction model proposed in this paper can abandon the transitional dependence on a single prediction.By combining the two prediction algorithms,the fusion of prediction performance is achieved,the limit of the single prediction performance is crossed,and the goal of improving vehicle speed prediction performance is achieved.In this paper,an extraction method suitable for fixed route vehicle speed is designed.The application of Markov and back propagation(BP)neural network in predictions is introduced.Three new combined prediction methods,all named Markov and BP Neural Network(MBNN)combined prediction algorithm,are proposed,which make full use of the advantages of Markov and BP neural network algorithms.Finally,the comparison among the prediction methods has been carried out.The results show that the three MBNN models have improved by about 19%,28%,and 29%compared with the Markov prediction model,which has better performance in the single prediction models.Overall,the MBNN combined prediction models can improve the prediction accuracy by 25.3%on average,which provides important support for the possible optimization of plug-in hybrid electric vehicle energy consumption.

Design and Strategy of Series-Parallel Hybrid System Based on BSFC

In this paper,a drive control strategy is developed based on the characteristics of series-parallel plug-in hybrid system.Energy management strategies in various modes are established with the basis on the minimum brake specific fuel consumption(BSFC)curve of engine.The control strategy,which is based on rules and system efficiency,is adopted to determine the entry/exit mechanisms of various modes according to battery state of charge(SOC),required power and required speed.The vehicle test results verify that the proposed control strategy can improve vehicle economy efficiently and makes a good effect on engine control.

Powertrain design and energy management of a novel coaxial series-parallel plug-in hybrid electric vehicle

For a series plug-in hybrid electric vehicle,higher working efficiency can be achieved by the drive system with two small motors in parallel than that with one big motor alone.However,the overly complex structure will inevitably lead to a substantial increase in the development cost.To improve the system price-performance ratio,a new kind of series-parallel hybrid system evolved from the series plug-in hybrid system is designed.According to the technical parameters of the selected components,the system model is established,and the vehicle dynamic property and pure electric drive economy are evaluated.Based on the dynamic programming,the energy management strategy for the drive system under the city driving cycle is developed,and the superiority validation of the system is completed.For the studied vehicle driven by the designed series-parallel plug-in hybrid system,compared with the one driven by the described series plug-in hybrid system,the dynamic property is significantly improved because of the multi-power coupling,and the fuel consumption is reduced by 11.4%with 10 city driving cycles.In a word,with the flexible configuration of the designed hybrid system and the optimized control strategy of the energy management,the vehicle performance can be obviously improved.

Global Optimization‑Based Energy Management Strategy for Series–Parallel Hybrid Electric Vehicles Using Multi‑objective Optimization Algorithm

The study of series–parallel plug-in hybrid electric vehicles(PHEVs)has become a research hotspot in new energy vehicles.The global optimal Pareto solutions of energy management strategy(EMS)play a crucial role in the development of PHEVs.This paper presents a multi-objective global optimization algorithm for the EMS of PHEVs.The algorithm combines the Radau Pseudospectral Knotting Method(RPKM)and the Nondominated Sorting Genetic Algorithm(NSGA)-II to optimize both energy conservation and battery lifespan under the suburban driving conditions of the New European Driving Cycle.The driving conditions are divided into stages at evident mode switching points and the optimal objectives are computed using RPKM.The RPKM results serve as the fitness values in iteration through the NSGA-II method.The results of the algorithm applied to a PHEV simulation show a 26.74%–53.87%improvement in both objectives after 20 iterations compared to the solutions obtained using only RPKM.The proposed algorithm is evaluated against the weighting dynamic programming and is found to be close to the global optimality,with the added benefits of faster and more uniform solutions.

A Predictive Energy Management Strategies for Mining Dump Trucks

The plug-in hybrid vehicles(PHEV)technology can effectively address the issues of poor dynamics and higher energy consumption commonly found in traditional mining dump trucks.Meanwhile,plug-in hybrid electric trucks can achieve excellent fuel economy through efficient energy management strategies(EMS).Therefore,a series hybrid system is constructed based on a 100-ton mining dump truck in this paper.And inspired by the dynamic programming(DP)algorithm,a predictive equivalent consumption minimization strategy(P-ECMS)based on the DP optimization result is proposed.Based on the optimal control manifold and the SOC reference trajectory obtained by the DP algorithm,the P-ECMS strategy performs real-time stage parameter optimization to obtain the optimal equivalent factor(EF).Finally,applying the equivalent consumption minimization strategy(ECMS)realizes real-time control.The simulation results show that the equivalent fuel consumption of the P-ECMS strategy under the experimentally collected mining cycle conditions is 150.8 L/100 km,which is 10.9%less than that of the common CDCS strategy(169.3 L/100 km),and achieves 99.47%of the fuel saving effect of the DP strategy(150 L/100 km).

A multivariable output neural network approach for simulation of plug-in hybrid electric vehicle fuel consumption

This study is laser focused on the simulation of fuel consumption and fuel economy label parameters of plug-in hybrid electric vehicles.While fuel economy is a key factor in the design of plug-in hybrid electric vehicles,a fuel economy label can educate customers about the economic advantage of purchasing a particular car.The fuel economy label of a PHEV consists of parameters like driving range,electrical energy consumption,fuel economy for city,highway,and combined use,battery recharge time,and fuel consumption rates.The study used an inverse function model of an artificial neural network to simulate and calculate the parameters of the fuel economy labels of PHEVs.Firstly,the selected parameters of the fuel economy label of plug-in hybrid electric vehicles were used to develop a single output model.The output variable of the single output model was then merged with dummy functions to form input variables for the inverse function model.The output variables simulated were engine size in litres;estimated driving range when the battery is fully charged in km,battery recharged time in hours,city fuel consumption(L/100 km),highway fuel consumption(L/100 km),combined fuel consumption(L/100 km),estimated driving range when the tank is full,carbon dioxide(CO_(2))emission in grams/km,electric motor power in kW,number of cylinders,and electrical charges consumed in kWh/100 km.Different cases of input variables were considered for the inverse function model.The accuracy of the model was 29.1 times greater than that of the conventional inverse artificial neural network model.

Contemporary Trends in Power Electronics Converters for Charging Solutions of Electric Vehicles

Electrifying the transport sector requires new possibilities for power electronics converters to attain reliable and efficient charging solutions for electric vehicles(EVs).With the continuous development in power electronics converters,the desire to reduce gasoline consumption and to increase the battery capacity for more electric range is achievable for EVs in the near future.The main interface between the power network and EV battery system is a power electronics converter,therefore,there is a considerable need of new power converters with low cost and high reliability for the advance charging mechanism of EVs.The rapid growth in power converter topologies brings substantial opportunities in EV charging process.In view of this fact,this paper investigates the significant aspects,current progress,and challenges associated with several power converters to suggest further improvements in charging systems of EVs.In particular,an extensive analysis of front-end as well as back-end converter configurations is presented.Moreover,the comparative properties of resonant converter topologies along with other DCDC converters are discussed in detail.Additionally,isolated,and non-isolated topologies with soft switching techniques are classified and rigorously analyzed with a view to their respective issues and benefits.It is foreseen that this paper would be a valuable addition and a worthy source of information for researchers exploring the area of power converter topologies for charging solutions of EVs.

用于电动汽车电池充电的非接触式动力转换系统(英文)

为了给电动汽车再次充电,需要结构紧凑、轻量化的非接触式动力转换系统。根据高效率、大气隙、有一定的误接宽容度的准则,开发了一种采用串并联电容器、具有矩形铁芯和双边缠绕的新型变换器,其尺寸为240mm×300mm×40mm,气隙为(70±20)mm,横向误接宽容度为±125mm,次级绕组质量为4.6kg。在次级绕组连接了充电控制电路和铅酸电池的情况下,测量了该系统的性能,在正常位置上获得了1.5kW的输出功率和95%的效率。结果表明:该系统结构紧凑、轻量化,满足了上述判据。