A review of artificial intelligence applications in high-speed railway systems

In recent years,the global surge of High-speed Railway(HSR)revolutionized ground transportation,providing secure,comfortable,and punctual services.The next-gen HSR,fueled by emerging services like video surveillance,emergency communication,and real-time scheduling,demands advanced capabilities in real-time perception,automated driving,and digitized services,which accelerate the integration and application of Artificial Intelligence(AI)in the HSR system.This paper first provides a brief overview of AI,covering its origin,evolution,and breakthrough applications.A comprehensive review is then given regarding the most advanced AI technologies and applications in three macro application domains of the HSR system:mechanical manufacturing and electrical control,communication and signal control,and transportation management.The literature is categorized and compared across nine application directions labeled as intelligent manufacturing of trains and key components,forecast of railroad maintenance,optimization of energy consumption in railroads and trains,communication security,communication dependability,channel modeling and estimation,passenger scheduling,traffic flow forecasting,high-speed railway smart platform.Finally,challenges associated with the application of AI are discussed,offering insights for future research directions.

A discussion about the limitations of the Eurocode’s high-speed load model for railway bridges

High-speed railway bridges are subjected to normative limitations concerning maximum permissible deck accelerations.For the design of these structures,the European norm EN 1991-2 introduces the high-speed load model(HSLM)—a set of point loads intended to include the effects of existing high-speed trains.Yet,the evolution of current trains and the recent development of new load models motivate a discussion regarding the limits of validity of the HSLM.For this study,a large number of randomly generated load models of articulated,conventional,and regular trains are tested and compared with the envelope of HSLM effects.For each type of train,two sets of 100,000 load models are considered:one abiding by the limits of the EN 1991-2 and another considering wider limits.This comparison is achieved using both a bridge-independent metric(train signatures)and dynamic analyses on a case study bridge(the Canelas bridge of the Portuguese Railway Network).For the latter,a methodology to decrease the computational cost of moving loads analysis is introduced.Results show that some theoretical load models constructed within the stipulated limits of the norm can lead to effects not covered by the HSLM.This is especially noted in conventional trains,where there is a relation with larger distances between centres of adjacent vehicle bogies.

Influence of pier height on the safety of trains running on high-speed railway bridges during earthquakes

Sudden earthquakes pose a threat to the running safety of trains on high-speed railway bridges,and the stiffness of piers is one of the factors affecting the dynamic response of train-track-bridge system.In this paper,a experiment of a train running on a high-speed railway bridge is performed based on a dynamic experiment system,and the corresponding numerical model is established.The reliability of the numerical model is verified by experiments.Then,the experiment and numerical data are analyzed to reveal the pier height effects on the running safety of trains on bridges.The results show that when the pier height changes,the frequency of the bridge below the 30 m pier height changes greater;the increase of pier height causes the transverse fundamental frequency of the bridge close to that of the train,and the shaking angle and lateral displacement of the train are the largest for bridge with 50 m pier,which increases the risk of derailment;with the pier height increases from 8 m to 50 m,the derailment coefficient obtained by numerical simulations increases by 75% on average,and the spectral intensity obtained by experiments increases by 120% on average,two indicators exhibit logarithmic variation.

Field survey and analysis on near-fault severely damaged high-speed railway bridge in 2022 M6.9 Menyuan earthquake

The 2022 M6.9 Menyuan earthquake caused severe damage to a high-speed railway bridge,which was designed for high-speed trains running at speeds of above 250 km/h and is located right next to the fault.Bridges of this type have been widely used for rapidly constructing the high-speed railway network,but few bridges have been tested by near-fault devastating earthquakes.The potential severe impact of the earthquake on the high-speed railway is not only the safety of the infrastructure,trains and passengers,but also economic loss due to interrupted railway use.Therefore,a field survey was carried out immediately after the earthquake to collect time-sensitive data.The damage to the bridge was carefully investigated,and quantitative analyses were conducted to better understand the mechanism of the bridge failure.It was found that seismic action perpendicular to the bridge’s longitudinal direction caused severe damage to the girders and rails,while none of the piers showed obvious deformation or cracking.The maximum values of transverse displacement,out-of-plane rotation and twisting angle of girders reached 212.6 cm,3.1 degrees and 19.9 degrees,respectively,causing severe damage to the bearing supports and anti-seismic retaining blocks.These observations provide a basis for improving the seismic design of high-speed railway bridges located in near-fault areas.

Noise reduction mechanism of high-speed railway box-girder bridges installed with MTMDs on top plate

The issue of low-frequency structural noise radiated from high-speed railway(HSR) box-girder bridges(BGBs) is a significant challenge worldwide. Although it is known that vibrations in BGBs caused by moving trains can be reduced by installing multiple tuned mass dampers(MTMDs) on the top plate, there is limited research on the noise reduction achieved by this method. This study aims to investigate the noise reduction mechanism of BGBs installed with MTMDs on the top plate. A sound radiation prediction model for the BGB installed with MTMDs is developed, based on the vehicle–track–bridge coupled dynamics and acoustics boundary element method. After being verified by field tested results, the prediction model is employed to study the reduction of vibration and noise of BGBs caused by the MTMDs. It is found that installing MTMDs on top plate can significantly affect the vibration distribution and sound radiation law of BGBs. However, its impact on the sound radiation caused by vibrations dominated by the global modes of BGBs is minimal. The noise reduction achieved by MTMDs is mainly through changing the acoustic radiation contributions of each plate of the bridge. In the lower frequency range, the noise reduction of BGB caused by MTMDs can be more effective if the installation of MTMDs can modify the vibration frequency and distribution of the BGB to avoid the influence of small vibrations and disperse the sound radiation from each plate.

Research on digital twin technology and its application in intelligent operation and maintenance of highspeed railway infrastructure

Purpose–This paper analyzes the application of digital twin technology in the field of intelligent operation and maintenance of high-speed railway infrastructure from the perspective of top-level design.Design/methodology/approach–This paper provides a comprehensive overview of the definition,connotations,characteristics and key technologies of digital twin technology.It also conducts a thorough analysis of the current state of digital twin applications,with a particular focus on the overall requirements for intelligent operation and maintenance of high-speed railway infrastructure.Using the Jinan Yellow River Bridge on the Beijing–Shanghai high-speed railway as a case study,the paper details the construction process of the twin system from the perspectives of system architecture,theoretical definition,model construction and platform design.Findings–Digital twin technology can play an important role in the whole life cycle management,fault prediction and condition monitoring in the field of high-speed rail operation and maintenance.Digital twin technology is of great significance to improve the intelligent level of high-speed railway operation and management.Originality/value–This paper systematically summarizes the main components of digital twin railway.The general framework of the digital twin bridge is given,and its application in the field of intelligent operation and maintenance is prospected.

Reflection on methodology of the correlation between electromagnetic interference and safety in high-speed railway

Purpose – In the continuous development of high-speed railways, ensuring the safety of the operation controlsystem is crucial. Electromagnetic interference (EMI) faults in signaling equipment may cause transportationinterruptions, delays and even threaten the safety of train operations. Exploring the impact of disturbances onsignaling equipment and establishing evaluation methods for the correlation between EMI and safety isurgently needed.Design/methodology/approach – This paper elaborates on the necessity and significance of studying theimpact of EMI as an unavoidable and widespread risk factor in the external environment of high-speed railwayoperations and continuous development. The current status of research methods and achievements from theperspectives of standard systems, reliability analysis and safety assessment are examined layer by layer.Additionally, it provides prospects for innovative ideas for exploring the quantitative correlation between EMIand signaling safety.Findings – Despite certain innovative achievements in both domestic and international standard systems andrelated research for ensuring and evaluating railway signaling safety, there’s a lack of quantitative and strategic research on the degradation of safety performance in signaling equipment due to EMI. A quantitativecorrelation between EMI and safety has yet to be established. On this basis, this paper proposes considerationsfor research methods pertaining to the correlation between EMI and safety.Originality/value – This paper overviews a series of methods and outcomes derived from domestic andinternational studies regarding railway signaling safety, encompassing standard systems, reliability analysisand safety assessment. Recognizing the necessity for quantitatively describing and predicting the impact ofEMI on high-speed railway signaling safety, an innovative approach using risk assessment techniques as abridge to establish the correlation between EMI and signaling safety is proposed.

Experimental study on the acoustic roughness spectrum of high-speed railway rails

Purpose–This study aims to investigate the acoustic roughness of rails on China’s high-speed railways,with a focus on short-wavelength irregularities(less than 80 cm),which are known to significantly contribute to noise.The goal is to develop a specific acoustic roughness spectrum tailored for China’s high-speed railway system,as no such spectrum currently exists.Design/methodology/approach–A long-term tracking study was conducted on major railway lines in China,monitoring rail roughness throughout the initial operational period and the rails’service life.Data preprocessing techniques such as peak removal and curvature correction were applied for acoustic adjustments.A spatial-wavelength domain transformation was performed,providing the distribution patterns and statistical characteristics of acoustic roughness on China’s high-speed rails.Based on these analyses,a model for constructing the acoustic roughness spectrum was developed.Findings–The study found that the acoustic roughness of China’s high-speed railway rails follows aχ2 distribution with six degrees of freedom.For wavelengths greater than 8 cm,the acoustic roughness spectrum remains below the ISO specified limits.In the wavelength range of 3.2 cm to 6.3 cm,the roughness is comparable to or within the limits specified by ISO 3095:2005 and ISO 3095:2013.However,for wavelengths shorter than 2.5 cm,the roughness exceeds ISO limits.Originality/value–This research fills the gap in the lack of a specific acoustic roughness spectrum for China’s high-speed railways.By establishing a tailored spectrum based on long-term data analysis,the findings provide valuable insights for noise control and rail maintenance in the context of China’s high-speed rail system.

Research on safety control technology of high-speed railway combined test based on threatening event analysis

Purpose–Safety management is a key point and poses a challenge in joint testing.To detect and address potential accidents’hidden dangers early,this paper conducts research on the safety control technology for high-speed railway joint tests by incorporating the concept of hazardous events.Design/methodology/approach–Aiming at ensuring the safety of high-speed railway combined inspections and trials,this paper starts from the dual prevention mechanism.It introduces the concept of threatening events,defines them and analyzes the differences between threatening events and railway accidents.The paper also proposes a cause model for threatening events in high-speed railway combined inspections and trials,based on three types of hazard sources.Furthermore,it conducts research on the control strategies for these threatening events.Findings–The research on safety control technology for high-speed railway combined operation and testing,based on the analysis of threatened events,offers a new perspective for safety management in these operations.It also provides theoretical and practical support for the transition from passive prevention to active risk pre-control,which holds significant theoretical and practical value.Originality/value–The innovation mainly includes the following three aspects:(1)Building on the traditional dual prevention mechanism,which includes risk hierarchical management and control as well as hidden danger investigation and management,a triple prevention mechanism is proposed.This new mechanism adds the management of threatening events as the third line of defense.The aim is to more comprehensively identify and address potential security risks,thereby enhancing the efficiency and effectiveness of security management.(2)In this paper,the definition of a railway threatening event is clarified,and the causative model of a high-speed railway threatening event based on three kinds of danger sources is proposed.(3)This paper puts forward the control strategy of the high-speed railway combined operation and trial,which includes five key links:identification,reporting,analysis,rectification and feedback,which provides a new perspective for the safety management of the high-speed railway combined operation and trial and has important theoretical and application value.

Current status and prospects of research on safety situation awareness of high speed railway operation environment

Purpose–The safety of high-speed rail operation environments is an important guarantee for the safe operation of high-speed rail.The operating environment of the high-speed rail is complex,and the main factors affecting the safety of high-speed rail operating environment include meteorological disasters,perimeter intrusion and external environmental hazards.The purpose of the paper is to elaborate on the current research status and team research progress on the perception of safety situation in high-speed rail operation environment and to propose directions for further research in the future.Design/methodology/approach–In terms of the mechanism and spatio-temporal evolution law of the main influencing factors on the safety of high-speed rail operation environments,the research status is elaborated,and the latest research progress and achievements of the team are introduced.This paper elaborates on the research status and introduces the latest research progress and achievements of the team in terms of meteorological,perimeter and external environmental situation perception methods for high-speed rail operation.Findings–Based on the technical route of“situational awareness evaluation warning active control,”a technical system for monitoring the safety of high-speed train operation environments has been formed.Relevant theoretical and technical research and application have been carried out around the impact of meteorological disasters,perimeter intrusion and the external environment on high-speed rail safety.These works strongly support the improvement of China’s railway environmental safety guarantee technology.Originality/value–With the operation of CR450 high-speed trains with a speed of 400 kmper hour and the application of high-speed train autonomous driving technology in the future,new and higher requirements have been put forward for the safety of high-speed rail operation environments.The following five aspects of work are urgently needed:(1)Research the single factor disaster mechanism of wind,rain,snow,lightning,etc.for high-speed railways with a speed of 400 kms per hour,and based on this,study the evolution characteristics of multiple safety factors and the correlation between the high-speed driving safety environment,revealing the coupling disastermechanism ofmultiple influencing factors;(2)Research covers multi-source data fusion methods and associated features such as disaster monitoring data,meteorological information,route characteristics and terrain and landforms,studying the spatio-temporal evolution laws of meteorological disasters,perimeter intrusions and external environmental hazards;(3)In terms of meteorological disaster situation awareness,research high-precision prediction methods for meteorological information time series along high-speed rail lines and study the realization of small-scale real-time dynamic and accurate prediction of meteorological disasters along high-speed rail lines;(4)In terms of perimeter intrusion,research amulti-modal fusion perception method for typical scenarios of high-speed rail operation in all time,all weather and all coverage and combine artificial intelligence technology to achieve comprehensive and accurate perception of perimeter security risks along the high-speed rail line and(5)In terms of external environment,based on the existing general network framework for change detection,we will carry out research on change detection and algorithms in the surrounding environment of highspeed rail.

Influence of span-to-depth ratio on dynamic response of vehicle-turnoutbridge system in high-speed railway

For high-speed railways,the smoothness of the railway line significantly affects the operational speed of trains.When the train passes through the turnout on a long-span bridge,the wheel-rail impacts caused by the turnout structure irregularities,and the instability arising from the bridge's flexural deformation lead to a strong coupling effect in the vehicle-turnout-bridge system.This significantly affects both ride comfort and operational safety.For addressing this issue,the present study considered a long-span continuous rigid-frame bridge as an example and established a train-turnout-bridge coupled dynamic model of high-speed railway.Utilizing a selfdeveloped dynamic simulation program,the study analysed the dynamic response characteristics when the train passes through the turnouts on the bridge.It also investigated the influence of different span-to-depth ratios of the bridge on the vehicle dynamic response when the train passes through the main line and branch line of turnouts and then proposed a span-to-depth ratio limit value for a long-span continuous rigid-frame bridge.The research findings suggest that the changes in the span-to-depth ratio have a relatively minor impact on the train’s operational performance but significantly affect the dynamic characteristics of the bridge structure.Based on the findings and a comprehensive assessment of safety indicators,it is advisable to establish a span-to-depth ratio limit of 1/4500 for a long-span continuous rigid-frame bridge.

Risk assessment of high-speed railway CTC system based on improved game theory and cloud model

Purpose-In order to solve the problem of inaccurate calculation of index weights,subjectivity and uncertainty of index assessment in the risk assessment process,this study aims to propose a scientific and reasonable centralized traffic control(CTC)system risk assessment method.Design/methodologylapproach-First,system-theoretic process analysis(STPA)is used to conduct risk analysis on the CTC system and constructs risk assessment indexes based on this analysis.Then,to enhance the accuracy of weight calculation,the fuzzy analytical hierarchy process(FAHP),fuzzy decision-making trial and evaluation laboratory(FDEMATEL)and entropy weight method are employed to calculate the subjective weight,relative weight and objective weight of each index.These three types of weights are combined using game theory to obtain the combined weight for each index.To reduce subjectivity and uncertainty in the assessment process,the backward cloud generator method is utilized to obtain the numerical character(NC)of the cloud model for each index.The NCs of the indexes are then weighted to derive the comprehensive cloud for risk assessment of the CTC system.This cloud model is used to obtain the CTC system's comprehensive risk assessment.The model's similarity measurement method gauges the likeness between the comprehensive risk assessment cloud and the risk standard cloud.Finally,this process yields the risk assessment results for the CTC system.Findings-The cloud model can handle the subjectivity and fuzziness in the risk assessment process well.The cloud model-based risk assessment method was applied to the CTC system risk assessment of a railway group and achieved good results.Originality/value-This study provides a cloud model-based method for risk assessment of CTC systems,which accurately calculates the weight of risk indexes and uses cloud models to reduce uncertainty and subjectivity in the assessment,achieving effective risk assessment of CTC systems.It can provide a reference and theoretical basis for risk management of the CTC system.

Eddy current quantitative evaluation of high-speed railway contact wire cracks based on neural network

Purpose–The purpose of this study is to study the quantitative evaluation method of contact wire cracks by analyzing the changing law of eddy current signal characteristics under different cracks of contact wire of high-speed railway so as to provide a new way of thinking and method for the detection of contact wire injuries of high-speed railway.Design/methodology/approach–Based on the principle of eddy current detection and the specification parameters of high-speed railway contact wires in China,a finite element model for eddy current testing of contact wires was established to explore the variation patterns of crack signal characteristics in numerical simulation.A crack detection system based on eddy current detection was built,and eddy current detection voltage data was obtained for cracks of different depths and widths.By analyzing the variation law of eddy current signals,characteristic parameters were obtained and a quantitative evaluation model for crack width and depth was established based on the back propagation(BP)neural network.Findings–Numerical simulation and experimental detection of eddy current signal change rule is basically consistent,based on the law of the selected characteristics of the parameters in the BP neural network crack quantitative evaluation model also has a certain degree of effectiveness and reliability.BP neural network training results show that the classification accuracy for different widths and depths of the classification is 100 and 85.71%,respectively,and can be effectively realized on the high-speed railway contact line cracks of the quantitative evaluation classification.Originality/value–This study establishes a new type of high-speed railway contact wire crack detection and identification method,which provides a new technical means for high-speed railway contact wire injury detection.The study of eddy current characteristic law and quantitative evaluation model for different cracks in contact line has important academic value and practical significance,and it has certain guiding significance for the detection technology of contact line in high-speed railway.

High-speed railway track components inspection framework based on YOLOv8 with high-performance model deployment

Railway inspection poses significant challenges due to the extensive use of various components in vast railway networks,especially in the case of high-speed railways.These networks demand high maintenance but offer only limited inspection windows.In response,this study focuses on developing a high-performance rail inspection system tailored for high-speed railways and railroads with constrained inspection timeframes.This system leverages the latest artificial intelligence advancements,incorporating YOLOv8 for detection.Our research introduces an efficient model inference pipeline based on a producer-consumer model,effectively utilizing parallel processing and concurrent computing to enhance performance.The deployment of this pipeline,implemented using C++,TensorRT,float16 quantization,and oneTBB,represents a significant departure from traditional sequential processing methods.The results are remarkable,showcasing a substantial increase in processing speed:from 38.93 Frames Per Second(FPS)to 281.06 FPS on a desktop system equipped with an Nvidia RTX A6000 GPU and from 19.50 FPS to 200.26 FPS on the Nvidia Jetson AGX Orin edge computing platform.This proposed framework has the potential to meet the real-time inspection requirements of high-speed railways.

Study on the Influence of Lanzhou-Urumqi High-Speed Railway on Regional Accessibility and Economic Development

The Lanzhou-Urumqi high-speed railway is an important part of the railway network connecting Gansu,Qinghai,and Xinjiang,and it is of far-reaching significance in facilitating China’s western development.An accessibility model and a double difference model were built to analyze the impact of the Lanzhou-Urumqi high-speed railway on regional accessibility and economic development of the areas along the line before(2012-2014)and after(2017-2019)its opening.The results show that the regional accessibility remains unchanged before and after the operation of this railway line.However,there is a spatial difference in improvement,that of central cities being better.The opening of the high-speed railway is conducive to driving the overall economic development of the region and promoting the comprehensive and coordinated development of regional economies.

Xi’an-Chengdu High-Speed Railway Starts Operation

High-speed trains linking Xihn, capital of Northwest Chinas Shaanxi Province, and southwestern metropolis Chengdu, capital of Sichuan Province, began operation on December 6, 2017.

JR East aims for driverless Shinkansen operation

East Japan Railway Company(JR East)is aiming to“realize driverless train operation”as one of the key measures to respond to rapid changes in the business environment.Currently,Automatic Train Operation(ATO)equipment is not installed on the Shinkansen,but there are plans to introduce ATO or driverless operation in the near future.From 2018-2021,the Ministry of Land,Infrastructure,Transport and Tourism(MLIT)held the“ATO Technology Study Group for Railways”in which the concept of technical requirements necessary for driverless operation was discussed.In 2021,JR East conducted the GOA4 demonstration test on the Joetsu Shinkansen.In this test,we were able to confirm the basic functions of Shinkansen vehicles such as automatic departure control,speed control,fixed position stop control,and remote stop control using ATO.We aim to realize unattended operation(GOA4)for deadhead trains between Niigata Station and the Niigata Shinkansen Rolling Stock Center by the end of the 2020 s,and driverless operation(GOA3)for passenger trains of the Joetsu Shinkansen by the mid-2030s and continue to develop the necessary technologies and build systems.

KL-SG High-Speed Rail-a catalyst for national economic development Sri Viknesh Permalu and Karthigesu Nagarajoo

Purpose-In an increasingly interconnected world,transportation infrastructure has emerged as a critical determinant of economic growth and global competitiveness.High-speed rail(HSR),characterized by its exceptional speed and efficiency,has garnered widespread attention as a transformative mode of transportation that transcends borders and fosters economic development.The Kuala Lumpur-Singapore(KL-SG)HSR project stands as a prominent exemplar of this paradigm,symbolizing the potential of HSR to serve as a catalyst for national economic advancement.Design/methodologylapproach-This paper is prepared to provide an insight into the benefits and advantages of HSR based on proven case studies and references from global HSRs,including China,Spain,France and Japan.Findings-The findings that have been obtained focus on enhanced connectivity and accessibility,attracting foreign direct investment,revitalizing regional economies,urban development and city regeneration,boosting tourism and cultural exchange,human capital development,regionai integration and environmental and sustainability benefits.Originality/value-The KL-SG HSR,linking Kuala Lumpur and Singapore,epitomizes the potential for HSR to be a transformative agent in the realm of economic development.This project encapsulates the aspirations of two dynamic Southeast Asian economies,united in their pursuit of sustainable growth,enhanced connectivity and global competitiveness.By scrutinizing the KLSG High-Speed Rail through the lens of economic benchmarking,a deeper understanding emerges of how such projects can drive progress in areas such as cross-border trade,tourism,urban development and technological innovation.

Development of track geometry inspection equipment for high-speed comprehensive inspection train in China

Purpose–This study aims to analyze the development direction of track geometry inspection equipment for high-speed comprehensive inspection train in China.Design/methodology/approach–The development of track geometry inspection equipment for highspeed comprehensive inspection train in China in the past 20 years can be divided into 3 stages.Track geometry inspection equipment 1.0 is the stage of analog signal.At the stage 1.0,the first priority is to meet the China’s railways basic needs of pre-operation joint debugging,safety assessment and daily dynamic inspection,maintenance and repair after operation.Track geometry inspection equipment 2.0 is the stage of digital signal.At the stage 2.0,it is important to improve stability and reliability of track geometry inspection equipment by upgrading the hardware sensors and improving software architecture.Track geometry inspection equipment 3.0 is the stage of lightweight.At the stage 3.0,miniaturization,low power consumption,self-running and green economy are co-developing on demand.Findings–The ability of track geometry inspection equipment for high-speed comprehensive inspection train will be expanded.The dynamic inspection of track stiffness changes will be studied under loaded and unloaded conditions in response to the track local settlement,track plate detachment and cushion plate failure.The dynamic measurement method of rail surface slope and vertical curve radius will be proposed,to reveal the changes in railway profile parameters of high-speed railways and the relationship between railway profile,track irregularity and subsidence of subgrade and bridges.The 200 m cut-off wavelength of track regularity will be researched to adapt to the operating speed of 400 km/h.Originality/value–The research can provide new connotations and requirements of track geometry inspection equipment for high-speed comprehensive inspection train in the new railway stage.

Transformer-Based Macroscopic Regulation for High-Speed Railway Timetable Rescheduling

Unexpected delays in train operations can cause a cascade of negative consequences in a high-speed railway system.In such cases,train timetables need to be rescheduled.However,timely and efficient train timetable rescheduling is still a challenging problem due to its modeling difficulties and low optimization efficiency.This paper presents a Transformer-based macroscopic regulation approach which consists of two stages including Transformer-based modeling and policy-based decisionmaking.Firstly,the relationship between various train schedules and operations is described by creating a macroscopic model with the Transformer,providing the better understanding of overall operation in the high-speed railway system.Then,a policy-based approach is used to solve a continuous decision problem after macro-modeling for fast convergence.Extensive experiments on various delay scenarios are conducted.The results demonstrate the effectiveness of the proposed method in comparison to other popular methods.