Enhanced Deep Reinforcement Learning Strategy for Energy Management in Plug-in Hybrid Electric Vehicles with Entropy Regularization and Prioritized Experience Replay

Plug-in Hybrid Electric Vehicles(PHEVs)represent an innovative breed of transportation,harnessing diverse power sources for enhanced performance.Energy management strategies(EMSs)that coordinate and control different energy sources is a critical component of PHEV control technology,directly impacting overall vehicle performance.This study proposes an improved deep reinforcement learning(DRL)-based EMSthat optimizes realtime energy allocation and coordinates the operation of multiple power sources.Conventional DRL algorithms struggle to effectively explore all possible state-action combinations within high-dimensional state and action spaces.They often fail to strike an optimal balance between exploration and exploitation,and their assumption of a static environment limits their ability to adapt to changing conditions.Moreover,these algorithms suffer from low sample efficiency.Collectively,these factors contribute to convergence difficulties,low learning efficiency,and instability.To address these challenges,the Deep Deterministic Policy Gradient(DDPG)algorithm is enhanced using entropy regularization and a summation tree-based Prioritized Experience Replay(PER)method,aiming to improve exploration performance and learning efficiency from experience samples.Additionally,the correspondingMarkovDecision Process(MDP)is established.Finally,an EMSbased on the improvedDRLmodel is presented.Comparative simulation experiments are conducted against rule-based,optimization-based,andDRL-based EMSs.The proposed strategy exhibitsminimal deviation fromthe optimal solution obtained by the dynamic programming(DP)strategy that requires global information.In the typical driving scenarios based onWorld Light Vehicle Test Cycle(WLTC)and New European Driving Cycle(NEDC),the proposed method achieved a fuel consumption of 2698.65 g and an Equivalent Fuel Consumption(EFC)of 2696.77 g.Compared to the DP strategy baseline,the proposed method improved the fuel efficiency variances(FEV)by 18.13%,15.1%,and 8.37%over the Deep QNetwork(DQN),Double DRL(DDRL),and original DDPG methods,respectively.The observational outcomes demonstrate that the proposed EMS based on improved DRL framework possesses good real-time performance,stability,and reliability,effectively optimizing vehicle economy and fuel consumption.

Optimization Control of Multi-Mode Coupling All-Wheel Drive System for Hybrid Vehicle

The all-wheel drive(AWD)hybrid system is a research focus on high-performance new energy vehicles that can meet the demands of dynamic performance and passing ability.Simultaneous optimization of the power and economy of hybrid vehicles becomes an issue.A unique multi-mode coupling(MMC)AWD hybrid system is presented to realize the distributed and centralized driving of the front and rear axles to achieve vectored distribution and full utilization of the system power between the axles of vehicles.Based on the parameters of the benchmarking model of a hybrid vehicle,the best model-predictive control-based energy management strategy is proposed.First,the drive system model was built after the analysis of the MMC-AWD’s drive modes.Next,three fundamental strategies were established to address power distribution adjustment and battery SOC maintenance when the SOC changed,which was followed by the design of a road driving force observer.Then,the energy consumption rate in the average time domain was processed before designing the minimum fuel consumption controller based on the equivalent fuel consumption coefficient.Finally,the advantage of the MMC-AWD was confirmed by comparison with the dynamic performance and economy of the BYD Song PLUS DMI-AWD.The findings indicate that,in comparison to the comparative hybrid system at road adhesion coefficients of 0.8 and 0.6,the MMC-AWD’s capacity to accelerate increases by 5.26%and 7.92%,respectively.When the road adhesion coefficient is 0.8,0.6,and 0.4,the maximum climbing ability increases by 14.22%,12.88%,and 4.55%,respectively.As a result,the dynamic performance is greatly enhanced,and the fuel savings rate per 100 km of mileage reaches 12.06%,which is also very economical.The proposed control strategies for the new hybrid AWD vehicle can optimize the power and economy simultaneously.

Ballistic design and testing of a composite armour reinforced by CNTs suitable for armoured vehicles

This paper is investigating the use of composite armour reinforced by nanomaterials, for the protection of light armoured(LAV) and medium armoured military vehicles(MAV), and the interaction between the composite materials and high-performance ballistic projectiles. Four armour materials, consisted of front hybrid fibre reinforced polymer cover layer, ceramic strike-face, fibre reinforced polymer intermediate layer and the metal matrix composite reinforced backplate, were manufactured and assembled by adhesive technology. The proposed laminated protection system is suitable for armoured ground vehicles;however, it could be used as armour on ground, air and naval platforms. The design of the protection system, including material selection and thickness, was elaborated depending on the performance requirements of Level 4 + STANAG 4569 military standard(projectile 14.5 mm × 114 mm API B32) and especially on a design philosophy which is analysed with the specifications. The backplate of this new composite is a hybrid material of Metal Matrix Composite(MMC) reinforced with carbon nanotubes(CNTs), manufactured with the use of powder metallurgy technique. The composite backplate material was morphologically, mechanically and chemically analysed. Results show that all plates are presenting high mechanical properties and ballistic characteristics, compared to commonly used armour plates. Real military ballistic tests according to AEP-STANAG 4569 were carried out for the total composite armour systems. After the ballistic tests, AA2024-CNT3 showed the best protection results, compared with the other plates(AA2024-CNT1 and AA2024-CNT2), with the projectile being unable to fully penetrate the composite plate.

The Future Trend of E-Mobility in Terms of Battery Electric Vehicles and Their Impact on Climate Change: A Case Study Applied in Hungary

The transportation sector is responsible for 25% of the total Carbon dioxide (CO2) emissions, whereas 60.6% of this sector represents small and medium passenger cars. However, as noted by the European Union Long-term strategy, there are two ways to reduce the amount of CO2 emissions in the transportation sector. The first way is characterized by creating more efficient vehicles. In contrast, the second way is characterized by changing the fuel used. The current study addressed the second way, changing the fuel type. The study examined the potential of battery electric vehicles (BEVs) as an alternative fuel type to reduce CO2 emissions in Hungarys transportation sector. The study used secondary data retrieved from Statista and stata.com to analyze the future trends of BEVs in Hungary. The results showed that the percentage of BEVs in Hungary in 2022 was 0.4% compared to the total number of registered passenger cars, which is 3.8 million. The simple exponential smoothing (SES) time series forecast revealed that the number of BEVs is expected to reach 84,192 in 2030, indicating a percentage increase of 2.21% in the next eight years. The study suggests that increasing the number of BEVs is necessary to address the negative impact of CO2 emissions on society. The Hungarian Ministry of Innovation and Technologys strategy to reduce the cost of BEVs may increase the percentage of BEVs by 10%, resulting in a potential average reduction of 76,957,600 g/km of CO2 compared to gasoline, diesel, hybrid electric vehicles (HEVs), and plug-in hybrid vehicles (PHEVs).

Implementation of Fuzzy Logic Control into an Equivalent Minimization Strategy for Adaptive Energy Management of A Parallel Hybrid Electric Vehicle

As government agencies continue to tighten emissions regulations due to the continued increase in greenhouse gas production, automotive industries are seeking to produce increasingly efficient vehicle technology. Hybrid electric vehicles (HEVs) have been introduced to mitigate problems while improving fuel economy. HEVs have led to the demand of creating more advanced controls software to consider multiple components for propulsive power in a vehicle. A large section in the software development process is the implementation of an optimal energy management strategy meant to improve the overall fuel efficiency of the vehicle. Optimal strategies can be implemented when driving conditions are known a prior. The Equivalent Consumption Minimization Strategy (ECMS) is an optimal control strategy that uses an equivalence factor to equate electrical to mechanical power when performing torque split determination between the internal combustion engine and electric motor for propulsive and regenerative torque. This equivalence factor is determined from offline vehicle simulations using a sensitivity analysis to provide optimal fuel economy results while maintaining predetermined high voltage battery state of charge (SOC) constraints. When the control hierarchy is modified or different driving styles are applied, the analysis must be redone to update the equivalence factor. The goal of this work is to implement a fuzzy logic controller that dynamically updates the equivalence factor to improve fuel economy, maintain a strict charge sustaining window of operation for the high voltage battery, and reduce computational time required during algorithm development. The adaptive algorithm is validated against global optimum fuel economy and charge sustaining results from a sensitivity analysis performed for multiple drive cycles. Results show a maximum fuel economy improvement of 9.82% when using a mild driving style and a 95% success rate when maintaining an ending SOC within 5% of the desired SOC regardless of starting SOC.

Parameters Matching and Control Method of Hydraulic Hybrid Vehicles with Secondary Regulation Technology

Hydraulic hybrid vehicles （HHV） with secondary regulation technology has the potential of improving fuel economy by operating the engine in the optimum efficiency range and making use of regenerative braking. Hydrostatic transmission technology has the advantage of higher power density and the ability to accept the high rates and high frequencies of charging and discharging, both of which are not favorable for batteries, but the lower energy density requires special power matching design and control strategy to coordinate all the powertrain components in an optimal manner. A multi-objective optimization method is proposed to distinguish the components size values of HHV by considering the requirements of driving cycles and technology aspects. The regenerative braking strategy and energy control strategy based on the optimized HHV is proposed to recovery the braking energy and distribute the regenerated braking energy. Simulation results show that by taking the optimized configuration of HHV, adopting the regenerative braking strategy and energy control strategy are helpful to improve the system efficiency and fuel economy of HHV under urban driving cycles.

Synthetical Efficiency-based Optimization for the Power Distribution of Power-split Hybrid Electric Vehicles

Now the optimization strategies for power distribution are researched widely, and most of them are aiming to the optimal fuel economy and the driving cycle must be preknown. Thus if the actual driving condition deviates from the scheduled driving cycle, the effect of optimal results will be declined greatly. Therefore, the instantaneous optimization strategy carried out on-line is studied in this paper. The power split path and the transmission efficiency are analyzed based on a special power-split scheme and the efficiency models of the power transmitting components are established. The synthetical efficiency optimization model is established for enhancing the transmission efficiency and the fuel economy. The identification of the synthetical efficiency as the optimization objective and the constrain group are discussed emphatically. The optimization is calculated by the adaptive simulated annealing （ASA） algorithm and realized on-line by the radial basis function （RBF）-based similar models. The optimization for power distribution of the hybrid vehicle in an actual driving condition is carried out and the road test results are presented. The test results indicate that the synthetical efficiency optimization method can enhance the transmission efficiency and the fuel economy of the power-split hybrid electric vehicle （HEV） observably. Compared to the rules-based strategy the optimization strategy is optimal and achieves the approximate global optimization solution for the power distribution. The synthetical efficiency optimization solved by ASA algorithm can give attentions to both optimization quality and calculation efficiency, thus it has good application foreground for the power distribution of power-split HEV.

A comprehensive review on hybrid electric vehicles: architectures and components

The rapid consumption of fossil fuel and increased environmental damage caused by it have given a strong impetus to the growth and development of fuelefficient vehicles. Hybrid electric vehicles (HEVs) have evolved from their inchoate state and are proving to be a promising solution to the serious existential problem posed to the planet earth. Not only do HEVs provide better fuel economy and lower emissions satisfying environmental legislations, but also they dampen the effect of rising fuel prices on consumers. HEVs combine the drive powers of an internal combustion engine and an electrical machine. The main components of HEVs are energy storage system, motor, bidirectional converter and maximum power point trackers (MPPT, in case of solar-powered HEVs). The performance of HEVs greatly depends on these components and its architecture. This paper presents an extensive review on essential components used in HEVs such as their architectures with advantages and disadvantages, choice of bidirectional converter to obtain high efficiency, combining ultracapacitor with battery to extend the battery life, traction motors’ role and their suitability for a particular application. Inclusion of photovoltaic cell in HEVs is a fairly new concept and has been discussed in detail. Various MPPT techniques used for solar-driven HEVs are also discussed in this paper with their suitability.

STEADY-STATE AND IDLE OPTIMIZA-TION OF INTERNAL COMBUSTION ENGINE CONTROL STRATEGIES FOR HYBRID ELECTRIC VEHICLES

A novel steady-state optimization （SSO） of internal combustion engine （ICE） strategy is proposed to maximize the efficiency of the overall powertrain for hybrid electric vehicles, in which the ICE efficiency, the efficiencies of the electric motor （EM） and the energy storage device are all explicitly taken into account. In addition, a novel idle optimization of ICE strategy is implemented to obtain the optimal idle operating point of the ICE and corresponding optimal parking generation power of the EM using the view of the novel SSO of ICE strategy. Simulations results show that potential fuel economy improvement is achieved relative to the conventional one which only optimized the ICE efficiency by the novel SSO of ICE strategy, and fuel consumption per voltage increment decreases a lot during the parking charge by the novel idle optimization of ICE strategy.

ENERGY MANAGEMENT STRATEGY FOR PARALLEL HYBRID ELECTRIC VEHICLES

Energy management strategy (EMS) is the core of the real-time controlalgorithm of the hybrid electric vehicle (HEV). A novel EMS using the logic threshold approach withincorporation of a stand-by optimization algorithm is proposed. The aim of it is to minimize theengine fuel consumption and maintain the battery state of charge (SOC) in its operation range, whilesatisfying the vehicle performance and drivability requirements. The hybrid powertrain bench testis carried out to collect data of the engine, motor and battery pack, which are used in the EMS tocontrol the powertrain. Computer simulation model of the HEV is established in the MATLAB/Simulinkenvironment according to the bench test results. Simulation results are presented for behaviors ofthe engine, motor and battery. The proposed EMS is implemented for a real parallel hybrid carcontrol system and validated by vehicle field tests.

Estimation Method of State-of-Charge For Lithium-ion Battery Used in Hybrid Electric Vehicles Based on Variable Structure Extended Kalman Filter

Since the main power source of hybrid electric vehicle（HEV） is supplied by the power battery,the predicted performance of power battery,especially the state-of-charge（SOC） estimation has attracted great attention in the area of HEV.However,the value of SOC estimation could not be greatly precise so that the running performance of HEV is greatly affected.A variable structure extended kalman filter（VSEKF）-based estimation method,which could be used to analyze the SOC of lithium-ion battery in the fixed driving condition,is presented.First,the general lower-order battery equivalent circuit model（GLM）,which includes column accumulation model,open circuit voltage model and the SOC output model,is established,and the off-line and online model parameters are calculated with hybrid pulse power characteristics（HPPC） test data.Next,a VSEKF estimation method of SOC,which integrates the ampere-hour（Ah） integration method and the extended Kalman filter（EKF） method,is executed with different adaptive weighting coefficients,which are determined according to the different values of open-circuit voltage obtained in the corresponding charging or discharging processes.According to the experimental analysis,the faster convergence speed and more accurate simulating results could be obtained using the VSEKF method in the running performance of HEV.The error rate of SOC estimation with the VSEKF method is focused in the range of 5% to 10% comparing with the range of 20% to 30% using the EKF method and the Ah integration method.In Summary,the accuracy of the SOC estimation in the lithium-ion battery cell and the pack of lithium-ion battery system,which is obtained utilizing the VSEKF method has been significantly improved comparing with the Ah integration method and the EKF method.The VSEKF method utilizing in the SOC estimation in the lithium-ion pack of HEV can be widely used in practical driving conditions.

Novel flexible hybrid electric system and adaptive online-optimal energy management controller for plug-in hybrid electric vehicles

In order to achieve the improvement of the driving comfort and energy efficiency,an new e-CVT flexible full hybrid electric system(E2FHS) is proposed,which uses an integrated main drive motor and generator to take the place of the original automatic or manual transmission to realize the functions of continuously variable transmission(e-CVT).The design and prototype realization of the E2FHS system for a plug-in hybrid vehicle(PHEV) is performed.In order to analyze and optimize the parameters and the power flux between different parts of the E2FHS,simulation software is developed.Especially,in order to optimize the performance of the energy economy improvement of the E2FHS,the effect of the different energy management controllers is investigated,and an adaptive online-optimal energy management controller for the E2FHS is built and validated by the prototype PHEV.

Energy Control of Plug-In Hybrid Electric Vehicles Using Model Predictive Control With Route Preview

The paper proposes an adoption of slope,elevation,speed and route distance preview to achieve optimal energymanagement of plug-in hybrid electric vehicles(PHEVs).Theapproach is to identify route features from historical and real-time traffic data,in which information fusion model and trafficprediction model are used to improve the information accuracy.Then,dynamic programming combined with equivalent con-sumption minimization strategy is used to compute an optimalsolution for real-time energy management.The solution is thereference for PHEV energy management control along the route.To improve the system's ability of handling changing situation,the study further explores predictive control model in the real-time control of the energy.A simulation is performed to modelPHEV under above energy control strategy with route preview.The results show that the average fuel consumption of PHEValong the previewed route with model predictive control(MPC)strategy can be reduced compared with optimal strategy andbase control strategy.

Hybrid Excited Permanent Magnet Machines for Electric and Hybrid Electric Vehicles

This paper reviews various hybrid excited(HE)machines from the perspective of location of PM and DC excitation,series/parallel connection of PM and DC excited magnetic fields,and 2D/3D magnetic fields,respectively.The advantages as well as drawbacks of each category are analyzed.Since an additional control degree,i.e.DC excitation,is introduced in the HE machine,the flux weakening control strategies are more complex.The flux weakening performance as well as efficiency are compared with different control strategies.Then,the potential to mitigate the risk of uncontrolled overvoltage fault at high speed operation is highlighted by controlling the field excitation.Since additional DC coils are usually required for HE machines compared with pure PM excitation,the spatial confliction inevitably results in electromagnetic performance reduction.Finally,the technique to integrate the field and armature windings with open-winding drive circuit is introduced,and novel HE machines without a DC coil are summarized.

Regenerative braking control for hybrid electric vehicles under decelerating condition

The operating mode of a single shaft hybrid electric vehicle （SSHEV） in which the electric motor exerts negative torque on the shaft to imitate engine braking is analyzed. The method of determining the quantity of regenerative braking torque is proposed with the premise that the braking intensity required by the driver is satisfied. On this basis, factors that affect torque generated by the motor are listed, and how the battery＇ s temperature and state of charge （ SOC ） restrict and correct the braking torque is expounded. Finally, road test results show that the motor＇ s constant power or constant torque control is an effective way to recover the mechanical energy during decelerating.

Identification of dynamic model parameters for lithium-ion batteries used in hybrid electric vehicles

An electrical equivalent circuit model for lithium-ion batteries used for hybrid electric vehicles （HEV） is presented. The model has two RC networks characterizing battery activation and concentration polarization process. The parameters of the model are identified using combined experimental and extended Kalman filter （EKF） recursive methods. The open-circuit voltage and ohmic resistance of the battery are directly measured and calculated from experimental measurements, respectively. The rest of the coupled dynamic parameters, i.e. the RC network parameters, are estimated using the EKF method. Experimental and simulation results are presented to demonstrate the efficacy of the proposed circuit model and parameter identification techniques for simulating battery dynamics.

Multi-objective comprehensive optimization of fuel consumption and emission for hybrid electric vehicles

Aiming to reduce fuel consumption and emissions of a dual-clutch hybrid electric vehicle during cold start, multiobjective optimization for fuel consumption and HC/CO emission from a TWC(three-way catalytic converter) outlet is presented in this paper. DP(dynamic programming) considering dual-state variables is proposed based on the Bellman optimality principle. Both the battery SOC(state of charge) and the temperature of TWC monolith are considered in the algorithm simultaneously. In this way the global optimal control strategy and the Pareto optimal solution of multi-objective function are derived. Simulation results show that the proposed method is able to promote the TWC light-off significantly by decreasing the engine's load and improving exhaust temperature from the outlet of the engine, in comparison with original DP considering the single battery SOC. Compared to the results achieved by rule-based control strategy, fuel economy and emission of TWC outlet for cold start are optimized comprehensively. Each indicator of Pareto solution set shows the significant improvement.

The Combination of Two Control Strategies for Series Hybrid Electric Vehicles

With most countries paying attention to the environment protection, hybrid electric vehicles have become a focus of automobile research and development due to the characteristics of energy saving and low emission. Power follower control strategy(PFCS) and DC-link voltage control strategy are two sorts of control strategies for series hybrid electric vehicles(HEVs). Combining those two control strategies is a new idea for control strategy of series hybrid electric vehicles. By tuning essential parameters which are the defined constants under DClink voltage control and under PFCS, the points of minimum mass of equivalent fuel consumption(EFC) corresponding to a series of variables are marked for worldwide harmonized light vehicles test procedure(WLTP). The fuel economy of series HEVs with the combination control schemes performs better compared with individual control scheme. The results show the effects of the combination control schemes for series HEVs driving in an urban environment.

Simulation research of energy management strategy for dual mode plug-in hybrid electrical vehicles

In this paper, a plug-in hybrid electrical vehicle(PHEV) is taken as the research object, and its dynamic performance and economic performance are taken as the research goals. Battery charge-sustaining(CS) period is divided into power mode and economy mode. Energy management strategy designing methods of power mode and economy mode are proposed. Maximum velocity, acceleration performance and fuel consumption are simulated during the CS period in the AVL CRUISE simulation environment. The simulation results indicate that the maximum velocity and acceleration time of the power mode are better than those in the economy mode. Fuel consumption of the economy mode is better than that in the power mode. Fuel consumption of PHEV during the CS period is further improved by using the methods proposed in this paper, and this is meaningful for research and development of PHEV.

Shift scheduling strategy development for parallel hybrid construction vehicles

The shift scheduling system of the transmission has an important effect on the dynamic and economic performance of hybrid vehicles. In this work, shift scheduling strategies are developed for parallel hybrid construction vehicles. The effect of power distribution and direction on shift characteristics of the parallel hybrid vehicle with operating loads is evaluated, which must be considered for optimal shift control. A power distribution factor is defined to accurately describe the power distribution and direction in various parallel hybrid systems. This paper proposes a Levenberg-Marquardt algorithm optimized neural network shift scheduling strategy. The methodology contains two objective functions, it is a dynamic combination of a dynamic shift schedule for optimal vehicle acceleration, and an energy-efficient shift schedule for optimal powertrain efficiency. The study is performed on a test bench under typical operating conditions of a wheel loader. The experimental results show that the proposed strategies offer effective and competitive shift performance.