Automatic Driving Operation Strategy of Urban Rail Train Based on Improved DQN Algorithm

To realize a better automatic train driving operation control strategy for urban rail trains,an automatic train driving method with improved DQN algorithm(classical deep reinforcement learning algorithm)is proposed as a research object.Firstly,the train control model is established by considering the train operation requirements.Secondly,the dueling network and DDQN ideas are introduced to prevent the value function overestimation problem.Finally,the priority experience playback and“restricted speed arrival time”are used to reduce the useless experience utilization.The experiments are carried out to verify the train operation strategy method by simulating the actual line conditions.From the experimental results,the train operation meets the ATO requirements,the energy consumption is 15.75%more energy-efficient than the actual operation,and the algorithm convergence speed is improved by about 37%.The improved DQN method not only enhances the efficiency of the algorithm but also forms a more effective operation strategy than the actual operation,thereby contributing meaningfully to the advancement of automatic train operation intelligence.

JR East aims for driverless Shinkansen operation

East Japan Railway Company(JR East)is aiming to“realize driverless train operation”as one of the key measures to respond to rapid changes in the business environment.Currently,Automatic Train Operation(ATO)equipment is not installed on the Shinkansen,but there are plans to introduce ATO or driverless operation in the near future.From 2018-2021,the Ministry of Land,Infrastructure,Transport and Tourism(MLIT)held the“ATO Technology Study Group for Railways”in which the concept of technical requirements necessary for driverless operation was discussed.In 2021,JR East conducted the GOA4 demonstration test on the Joetsu Shinkansen.In this test,we were able to confirm the basic functions of Shinkansen vehicles such as automatic departure control,speed control,fixed position stop control,and remote stop control using ATO.We aim to realize unattended operation(GOA4)for deadhead trains between Niigata Station and the Niigata Shinkansen Rolling Stock Center by the end of the 2020 s,and driverless operation(GOA3)for passenger trains of the Joetsu Shinkansen by the mid-2030s and continue to develop the necessary technologies and build systems.

Discussion on the Design of E-commerce Automatic Operation Module

E-commerce refers to a kind of business and trade activities, which are conducted under the situation that buyers and sellers do not meet each other by using a fast, easy and low-cost way. Along with the promotion and application of computer office automation, it is necessary for e-commerce module to develop towards automation, in which the core lies in making a good design for operation module. In this paper, the promotion of e-commerce in the information age is reviewed by the authors, the unique characteristics of e-commerce functional modules are analyzed, and also the most important point of the design of e-commerce automatic operation module is discussed. Hopefully, helps can be provided for relevant follow-up studies in the future.

Discussion on the Design of E-commerce Automatic Operation Module

E-commerce refers to a kind of business and trade activities, which are conducted under the situation that buyers and sellers do not meet each other by using a fast, easy and low-cost way. Along with the promotion and application of computer office automation, it is necessary for e-commerce module to develop towards automation, in which the core lies in making a good design for operation module. In this paper, the promotion of e-commerce in the information age is reviewed by the authors, the unique characteristics of e-commerce functional modules are analyzed, and also the most important point of the design of e-commerce automatic operation module is discussed. Hopefully, helps can be provided for relevant follow-up studies in the future.

Analysis on Operational Safety and Efficiency of FAO System in Urban Rail Transit

This paper discusses two urgent problems that need to be solved in fully automatic operation(FAO)for urban rail transit.The first is the analysis of safety in FAO,while another is the analysis of efficiency in FAO.Firstly,this paper establishes an operational safety evaluation index system from the perspective of operation for the unique or typical risk sources of the FAO system,and uses the analytic hierarchy process(AHP)to evaluate the indicators,analyzes various factors that affect the safe operation of FAO,and provides safety management recommendations for FAO lines operation to maintain the FAO system specifically.Secondly,taking the Yanfang Line as an example,this paper uses OpenTrack software to analyze the efficiency of FAO operation,and conducts simulation calculations for key links such as the mainline tracking interval,train entry and exit,and return limit interval.The fault impact surface of the FAO trains is simulated and discussed to verify whether FAO can meet the long-term operation requirements of Yanfang Line.Finally,this paper compares the simulation data of FAO on the Yanfang Line with manual operation(MO)to verify the advantages of FAO and guide the engineering construction of subsequent fully automated driving lines.

Braking distance prediction for vehicle consist in low-speed on-sight operation:a Monte Carlo approach

The first and last mile of a railway journey, in both freight and transit applications, constitutes a high effort and is either non-productive(e.g. in the case of depot operations) or highly inefficient(e.g. in industrial railways). These parts are typically managed on-sight, i.e. with no signalling and train protection systems ensuring the freedom of movement. This is possible due to the rather short braking distances of individual vehicles and shunting consists. The present article analyses the braking behaviour of such shunting units. For this purpose, a dedicated model is developed. It is calibrated on published results of brake tests and validated against a high-definition model for lowspeed applications. Based on this model, multiple simulations are executed to obtain a Monte Carlo simulation of the resulting braking distances. Based on the distribution properties and established safety levels, the risk of exceeding certain braking distances is evaluated and maximum braking distances are derived. Together with certain parameters of the system, these can serve in the design and safety assessment of driver assistance systems and automation of these processes.

Energy Saving for Automatic Train Control in Moving Block Signaling System

With rapid development of the railway traffic, the moving block signaling system （MBS） method has become more and more important for increasing the track capacity by allowing trains to run in a shorter time-headway while maintaining the required safety margins. In this framework, the tracking target point of the following train is moving forward with its leading train. This paper focuses on the energy saving tracking control of two successive trains in MBS. Nonlinear programming method is used to optimize the energy-saving speed trajectory of the following train. The real-time location of the leading train could be integrated into the optimization process. Due to simplicity, it can be used for online implementation. The feasibility and effectiveness are verified through simulation. The results show that the new method is efficient on energy saving even when disturbances present.

Automatic Train Operation Based on Adaptive Terminal Sliding Mode Control

This paper presents an adaptive terminal sliding mode control(ATSMC) method for automatic train operation. The criterion for the design is keeping high-precision tracking with relatively less adjustment of the control input. The ATSMC structure is designed by considering the nonlinear characteristics of the dynamic model and the parametric uncertainties of the train operation in real time. A nonsingular terminal sliding mode control is employed to make the system quickly reach a stable state within a finite time, which makes the control input less adjust to guarantee the riding comfort. An adaptive mechanism is used to estimate controller parameters to get rid of the need of the prior knowledge about the bounds of system uncertainty. Simulations are presented to demonstrate the effectiveness of the proposed controller, which has robust performance to deal with the external disturbance and system parametric uncertainties. Thereby, the system guarantees the train operation to be accurate and comfortable.

Research on Multi-Objective Real-Time Optimization of Automatic Train Operation(ATO) in Urban Rail Transit

The determination and optimization of Automatic Train Operation(ATO) control strategy is one of the most critical technologies for urban rail train operation. The practical ATO optimal control strategy must consider many goals of the train operation, such as safety, accuracy, comfort, energy saving and so on. This paper designs a set of efficient and universal multi-objective control strategy. Firstly, based on the analysis of urban rail transit and its operating environment, the multi-objective optimization model considering all the indexes of train operation is established by using multi-objective optimization theory. Secondly, Non-dominated Sorting Genetic Algorithm II(NSGA-II) is used to solve the model, and the optimal speed curve of train running is generated.Finally, the intelligent controller is designed by the combination of fuzzy controller algorithm and the predictive control algorithm, which can control and optimize the train operation in real time. Then the robustness of the control system can ensure and the requirements for multi-objective in train operation can be satisfied.

Research on Optimization of Freight Train ATO Based on Elite Competition Multi-Objective Particle Swarm Optimization

In view of the complex problems that freight train ATO (automatic train operation) needs to comprehensively consider punctuality, energy saving and safety, a dynamics model of the freight train operation process is established based on the safety and the freight train dynamics model in the process of its operation. The algorithm of combining elite competition strategy with multi-objective particle swarm optimization technology is introduced, and the winning particles are obtained through the competition between two elite particles to guide the update of other particles, so as to balance the convergence and distribution of multi-objective particle swarm optimization. The performance comparison experimental results verify the superiority of the proposed algorithm. The simulation experiments of the actual line verify the feasibility of the model and the effectiveness of the proposed algorithm.

Model-free adaptive robust control method for high-speed trains

Aiming at the robustness issue in high-speed trains(HSTs)operation control,this article proposes a model-free adaptive control(MFAC)scheme to suppress disturbance.Firstly,the dynamic linearization data model of train system under the action of measurement disturbance is given,and the Kalman filter(KF)based on this model is derived under the minimum variance estimation criterion.Then,according to the KF,an anti-interference MFAC scheme is designed.This scheme only needs the input and output data of the controlled system to realize the MFAC of the train under strong disturbance.Finally,the simulation experiment of CRH380A HSTs is carried out and compared with the traditional MFAC and the MFAC with attenuation factor.The proposed control algorithm can effectively suppress the measurement disturbance,and obtain smaller tracking error and larger signal to noise ratio with better applicability.

Frequency regulation by fuzzy and binary control in a hybrid islanded microgrid

Islanded microgrids must be self-sufficient in terms of frequency and voltage control due to their islanded operation.A control strategy for frequency regulation by combining the operation of a wind generator,a diesel generator,a battery energy storage system and a dump load in a microgrid is proposed in this paper.In the proposed strategy,the control task is partitioned into two subtasks:1)choosing the appropriate element to be used for regulation,and 2)providing frequency regulation.A global controller chooses the element to operate.Then,the frequency regulation is provided by separate individual controllers.The proposed control strategy is tested on a microgrid with mixed types of generation and modeled on Simulink.By monitoring the power of individual elements and system frequency,it is shown that the proposed control strategy operates efficiently.The proposed strategy facilitates the integration of renewable energy sources and enhances frequency regulation.