Recorded recurrent deep reinforcement learning guidance laws for intercepting endoatmospheric maneuvering missiles

This work proposes a recorded recurrent twin delayed deep deterministic(RRTD3)policy gradient algorithm to solve the challenge of constructing guidance laws for intercepting endoatmospheric maneuvering missiles with uncertainties and observation noise.The attack-defense engagement scenario is modeled as a partially observable Markov decision process(POMDP).Given the benefits of recurrent neural networks(RNNs)in processing sequence information,an RNN layer is incorporated into the agent’s policy network to alleviate the bottleneck of traditional deep reinforcement learning methods while dealing with POMDPs.The measurements from the interceptor’s seeker during each guidance cycle are combined into one sequence as the input to the policy network since the detection frequency of an interceptor is usually higher than its guidance frequency.During training,the hidden states of the RNN layer in the policy network are recorded to overcome the partially observable problem that this RNN layer causes inside the agent.The training curves show that the proposed RRTD3 successfully enhances data efficiency,training speed,and training stability.The test results confirm the advantages of the RRTD3-based guidance laws over some conventional guidance laws.

Design and Analysis of Terminal Guidance Law for Kinetic Interceptors based on Pulse Engine

A new terminal guidance law is proposed based on a solid propellant pulse engine and an improved proportional navigation method to address the terminal guidance issue for kinetic interceptors.On this basis,the start-stop curve of the pulse motor during the terminal guidance process is designed,along with its start-up logic.The effectiveness of the proposed guidance strategy is verified through simulation.

Impact point prediction guidance of ballistic missile in high maneuver penetration condition

An impact point prediction(IPP) guidance based on supervised learning is proposed to address the problem of precise guidance for the ballistic missile in high maneuver penetration condition.An accurate ballistic trajectory model is applied to generate training samples,and ablation experiments are conducted to determine the mapping relationship between the flight state and the impact point.At the same time,the impact point coordinates are decoupled to improve the prediction accuracy,and the sigmoid activation function is improved to ameliorate the prediction efficiency.Therefore,an IPP neural network model,which solves the contradiction between the accuracy and the speed of the IPP,is established.In view of the performance deviation of the divert control system,the mapping relationship between the guidance parameters and the impact deviation is analysed based on the variational principle.In addition,a fast iterative model of guidance parameters is designed for reference to the Newton iteration method,which solves the nonlinear strong coupling problem of the guidance parameter solution.Monte Carlo simulation results show that the prediction accuracy of the impact point is high,with a 3 σ prediction error of 4.5 m,and the guidance method is robust,with a 3 σ error of 7.5 m.On the STM32F407 singlechip microcomputer,a single IPP takes about 2.374 ms,and a single guidance solution takes about9.936 ms,which has a good real-time performance and a certain engineering application value.

Integrated guidance and control design for missile with terminal impact angle constraint based on sliding mode control

Aimed at the guidance requirements of some missiles which attack targets with terminal impact angle at the terminal point,a new integrated guidance and control design scheme based on variable structure control approach for missile with terminal impact angle constraint is proposed.First,a mathematical model of an integrated guidance and control model in pitch plane is established,and then nonlinear transformation is employed to transform the mathematical model into a standard form suitable for sliding mode control method design.A sufficient condition for the existence of linear sliding surface is given in terms of linear matrix inequalities（LMIs）,based on which the corresponding reaching motion controller is also developed.To verify the effectiveness of the proposed integrated design scheme,the numerical simulation of missile is made.The simulation results demonstrate that the proposed guidance and control law can guide missile to hit the target with desired impact angle and desired flight attitude angle simultaneously.

Optimal Guidance Law to Maximize Terminal Velocity for Missiles with Impact Angle Constraint

In this paper,an optimal guidance law for missiles with impact angle and miss distance constraints is proposed to achieve the maximal terminal velocity. The normal acceleration command that includes the timevarying coefficients is introduced to satisfy the desired impact angle as well as zero miss distance according to the geometric relation and relative motion parameters between missile and target. The problem is formulated as an optimal control problem by defining the angle of velocity error and flight-path angle as state variables and maximizing a performance index of the terminal velocity. The analytical form of the proposed guidance law is obtained as the solution of the optimal control problem combining optimal control theory and numerical value computation method. Nonlinear simulations of various situations demonstrate the performance and feasibility of the proposed optimal guidance law.

Trajectory tracking guidance of interceptor via prescribed performance integral sliding mode with neural network disturbance observer

This paper investigates interception missiles’trajectory tracking guidance problem under wind field and external disturbances in the boost phase.Indeed,the velocity control in such trajectory tracking guidance systems of missiles is challenging.As our contribution,the velocity control channel is designed to deal with the intractable velocity problem and improve tracking accuracy.The global prescribed performance function,which guarantees the tracking error within the set range and the global convergence of the tracking guidance system,is first proposed based on the traditional PPF.Then,a tracking guidance strategy is derived using the integral sliding mode control techniques to make the sliding manifold and tracking errors converge to zero and avoid singularities.Meanwhile,an improved switching control law is introduced into the designed tracking guidance algorithm to deal with the chattering problem.A back propagation neural network(BPNN)extended state observer(BPNNESO)is employed in the inner loop to identify disturbances.The obtained results indicate that the proposed tracking guidance approach achieves the trajectory tracking guidance objective without and with disturbances and outperforms the existing tracking guidance schemes with the lowest tracking errors,convergence times,and overshoots.

Closed-form guidance law for velocity maximization with impact angle constraint

Final velocity and impact angle are critical to missile guidance.Computationally efficient guidance law with compre-hensive consideration of the two performance merits is challeng-ing yet remains less addressed.Therefore,this paper seeks to solve a type of optimal control problem that maximizes final velocity subject to equality point constraint of impact angle con-straint.It is proved that the crude problem of maximizing final velocity is equivalent to minimizing a quadratic-form cost of cur-vature.The closed-form guidance law is henceforth derived using optimal control theory.The derived analytical guidance law coincides with the widely-used optimal guidance law with impact angle constraint(OGL-IAC)with a set of navigation parameters of two and six.On this basis,the optimal emission angle is determined to further increase the final velocity.The derived optimal value depends solely on the initial line-of-sight angle and impact angle constraint,and thus practical for real-world appli-cations.The proposed guidance law is validated by numerical simulation.The results show that the OGL-IAC is superior to the benchmark guidance laws both in terms of final velocity and missing distance.

Mid-Course Guidance Law for Long Range Multi-Purpose Missiles

A useful mid course guidance law for long range multi purpose missiles is proposed. The law consists of two parts. One is used in the horizontal guidance plane, and the other in the vertical guidance plane. The mid course is combined with variable structure proportional navigation in the homing phase. Simulation results show that the proposed guidance law can meet the demands for starting up the homing phase and so the handing over between mid course guidance and terminal guidance can be carried out successfully.

Optimum Design of the Control System for a Laser Beam Riding Guidance Anti-Tank Missile

The optimum theory and methods were adopted to design the laser beam riding guidance anti tank missile's control system in the short run. Through building the mathematical model of system, selecting a proper method and taking advantage of computer's high speed calculation and logic traits, an optimal controller was designed. Simulation results showed that the designed control system has fair performance and it satisfies the tactical and technical requirements. The results also demonstrate that by the combination of the optimizing methods and the computer the control system could be designed as soon as possible.

Adaptive Dynamic Surface Control for Integrated Missile Guidance and Autopilot

Integrated guidance and control for homing missiles utilizing adaptive dynamic surface control approach is considered based on the three channels independence design idea. A time-varying integrated guidance and control model with unmatched uncertainties is first formulated for the pitch channel, and an adaptive dynamic surface control algorithm is further developed to deal with these unmatched uncertainties. It is proved that the proposed feedback controller can ensure not only the accuracy of target interception, but also the stability of the missile dynamics. Then, the same control approach is further applied to the control design of the yaw and roll channels. The 6-degree-of-freedom （6-DOF） nonlinear missile simulation results demonstrate the feasibility and advantage of the proposed integrated guidance and control design scheme.

Observer-based Guidance Law Accounting for Second-order Dynamics of Missile Autopilots

Accounting for the missile autopilot as second-order dynamics, an observer-based guidance law is designed based on the dynamic surface control method. Some first-order low-pass filters are introduced into the design process to avoid the occurrence of high-order derivatives of the line of sight angle in the expression of guidance law such that it can be implemented in practical applications. The proposed guidance law is effective in compensating the bad influence of the autopilot lag on guidance accuracy. In the simulations of intercepting non maneuvering targets, targets with step acceleration, and targets with sinusoidal acceleration respectively, the guidance law is compared with the adaptive sliding mode guidance law in the presence of missile autopilot lag. The simulation results show that the proposed guidance law is able to guide a missile to accurately intercept a maneuvering target, even if it escapes in a great and fast maneuver and the autopilot has a relatively large lag.

Iterative Learning Control for homing guidance design of missiles

This paper presents an Iterative Learning Control design applied to homing guidance of missiles against maneuvering targets. According to numerical experiments, although an increase of the control energies is appreciated with respect to a previous published base controller for comparison, this strategy, which is simple to realize, is able to reduce the time to reach the head-on condition to target destruction. This fact is important to minimize the missile lateral force-level to fulfill engaging in hyper-sonic target persecutions.

Parameters Design of Pull-off Deceptive Jamming to Terminal Guidance Radar

A deceptive pull-off jamming method to terminal guidance radar is put forward in this paper.The design rules about the important jamming parameters are discussed in detail,including the number of the decoy targets in range dimension,the velocity of the range gate pull-off,and the number of the decoy targets in velocity dimension and the velocity of the Doppler frequency pull-off.Also,the steps to design these parameters are brought out.The rules and design procedure discussed in this paper have important meaning for the choice of the reasonable jamming parameters in the practical applications,which can help to obtain good jamming effect.

Three-dimensional impact angle constrained distributed cooperative guidance law for anti-ship missiles

This paper investigates the problem of distributed cooperative guidance law design for multiple anti-ship missiles in the three-dimensional(3-D)space hitting simultaneously the same target with considering the desired terminal impact angle constraint.To address this issue,the problem formulation including 3-D nonlinear mathematical model description,and communication topology are built firstly.Then the consensus variable is constructed using the available information and can reach consensus under the proposed acceleration command along the line-of-sight(LOS)which satisfies the impact time constraint.However,the normal accelerations are designed to guarantee the convergence of the LOS angular rate.Furthermore,consider the terminal impact angle constraints,a nonsingular terminal sliding mode(NTSM)control is introduced,and a finite time convergent control law of normal acceleration is proposed.The convergence of the proposed guidance law is proved by using the second Lyapunov stability method,and numerical simulations are also conducted to verify its effectiveness.The results indicate that the proposed cooperative guidance law can regulate the impact time error and impact angle error in finite time if the connecting time of the communication topology is longer than the required convergent time.

Integrated guidance and control design of the suicide UCAV for terminal attack

A novel integrated guidance and control (IGC) design method is proposed to solve problems of low control accuracy for a suicide unmanned combat aerial vehicle (UCAV) in the terminal attack stage. First of all, the IGC system model of the UCAV is built based on the three-channel independent design idea, which reduces the difficulties of designing the controller. Then, IGC control laws are designed using the trajectory linearization control (TLC). A nonlinear disturbance observer (NDO) is introduced to the IGC controller to reject various uncertainties, such as the aerodynamic parameter perturbation and the measurement error interference. The stability of the closed-loop system is proven by using the Lyapunov theorem. The performance of the proposed IGC design method is verified in a terminal attack mission of the suicide UCAV. Finally, simulation results demonstrate the superiority and effectiveness in the aspects of guidance accuracy and system robustness.

Trajectory shaping guidance law based on virtual angle with terminal constraints

A trajectory shaping guidance law based on virtua angle （TSGLBVA） is proposed for a re-entry vehicle with the constraints of terminal impact angles and their time derivatives. In the view of differential properties of the maneuvering trajectory, a virtual angle and a virtual radius are defined. Also, the shaping trajectory of the vehicle is established by the polynomials of the virtual angle. Then, four optimized parameters are selected according to the theorem of parameters transformation presented in this paper. Finally, a convergent variant of the Nelder-Mead algorithm is adopted to obtain the reference trajectory, and a trajectory feedback tracking guidance law is designed. The simulation results demonstrate that the TSGLBVA ensures the re-entry vehicle to impact a target precisely from a specified direction with smal terminal load factor command, as well as to obtain a maximum or constrained terminal velocity according to various requirements.

A trajectory shaping guidance law with field-of-view angle constraint and terminal limits

In this paper, a trajectory shaping guidance law,which considers constraints of field-of-view(FOV) angle, impact angle, and terminal lateral acceleration, is proposed for a constant speed missile against a stationary target. First, to decouple constraints of the FOV angle and the terminal lateral acceleration, the third-order polynomial with respect to the line-ofsight(LOS) angle is introduced. Based on an analysis of the relationship between the looking angle and the guidance coefficient,the boundary of the coefficient that satisfies the FOV constraint is obtained. The terminal guidance law coefficient is used to guarantee the convergence of the terminal conditions. Furthermore, the proposed law can be implemented under bearingsonly information, as the guidance command does not involve the relative range and the LOS angle rate. Finally, numerical simulations are performed based on a kinematic vehicle model to verify the effectiveness of the guidance law. Overall, the work offers an easily implementable guidance law with closed-form guidance gains, which is suitable for engineering applications.

Data fusion control and guidance of surface-to-air missile under the complex circumstance based on neural-net technology

Under the complicated electromagnetism circumstance, the model of data fusion control and guidance of surface-to-air missile weapon systems is established. Such ways and theories as Elman-NN, radar tracking and filter＇s data fusion net based on the group method for data-processing （GMRDF） are applied to constructing the model of data fusion. The highly reliable state estimation of the tracking targets and the improvement in accuracy of control and guidance are obtained. The purpose is optimization design of data fusion control and guidance of surface-to-air missile weapon systems and improving the fighting effectiveness of surface-to-air missile weapon systems.

Output-feedback based partial integrated missile guidance and control law design

An output-feedback based partial integrated guidance and control (IGC) law for missile interceptor is proposed with the smooth finite time convergence property. Firstly, a novel outputfeedback based smooth sliding mode control is proposed for a class of nonlinear systems in the presence of immeasurable state and disturbance. The finite time convergence property of this control scheme is proved based on the Lyapunov stability and homogeneous principle. Then, the proposed control method is applied to the design of partial IGC law. A kind of scaling methods is also developed to reach the rapid convergence of the system. An important dominance of this control scheme is the smooth characteristic, which may result in chattering free convergence. The simulation results indicate the high precision and smooth elevator deflection of the proposed output feedback base partial IGC law. © 2016 Beijing Institute of Aerospace Information.

Observability analysis of feature aided terminal guidance systems

Feature aided design of estimators and guidance laws can significantly improve the interception performance of the terminal guidance system. The achieved enhancement can be effectively assessed by observability analysis methods. This paper first analyzes and discusses the existing assessment methods in a typical endgame scenario with target orientation observations. To get over their deficiencies, a novel singular value decomposition（SVD） method is proposed. Employing both theoretical analysis and numerical simulation, the proposed method can represent the degree of state observability which is enhanced by integrating target features more completely and quantitatively.