Recorded recurrent deep reinforcement learning guidance laws for intercepting endoatmospheric maneuvering missiles

This work proposes a recorded recurrent twin delayed deep deterministic(RRTD3)policy gradient algorithm to solve the challenge of constructing guidance laws for intercepting endoatmospheric maneuvering missiles with uncertainties and observation noise.The attack-defense engagement scenario is modeled as a partially observable Markov decision process(POMDP).Given the benefits of recurrent neural networks(RNNs)in processing sequence information,an RNN layer is incorporated into the agent’s policy network to alleviate the bottleneck of traditional deep reinforcement learning methods while dealing with POMDPs.The measurements from the interceptor’s seeker during each guidance cycle are combined into one sequence as the input to the policy network since the detection frequency of an interceptor is usually higher than its guidance frequency.During training,the hidden states of the RNN layer in the policy network are recorded to overcome the partially observable problem that this RNN layer causes inside the agent.The training curves show that the proposed RRTD3 successfully enhances data efficiency,training speed,and training stability.The test results confirm the advantages of the RRTD3-based guidance laws over some conventional guidance laws.

缺乏位置信息的视觉移动机器人leader-following编队控制

针对视觉移动机器人编队在缺乏位置信息情况下的控制问题,提出一种基于视觉的leader-following编队反馈控制方法。该方法利用leader标志物特征点在follower摄像机像平面上的坐标信息设计了观测器,对leader与follower间的相对位置进行估计,基于相对位置估计量与它们速度的关系,设计出leader-following编队反馈控制器,通过Lyapunov理论证明了闭环系统的稳定性。仿真结果表明,该控制方法能有效解决缺乏位置信息情况下视觉移动机器人编队的控制问题。

Active Control of Initial Disturbances for Rockets and Missiles

The active control theory and methods of initial disturbances for rockets and missiles are investigated. The rocket or missile/launcher is simplified as a flexible beam excited by a moving varying velocity rigid body which has two points in contact with the beam. The control force is applied at the supporting point on the beam. Active control strategies based on optimal control theory are proposed and computer simulation is carried out. Simulation results are consistent with the theoretical results, and show that the active control strategies proposed can accomplish the purpose to control the initial disturbances actively. The results show that active control of initial disturbances for rockets and missiles is feasible for application.

Leader-following多自主体系统时变编队跟踪控制

考虑时变时延,研究了高阶leader-following多自主体系统的分布式时变编队跟踪控制问题.针对连续高阶多自主体系统,设计了基于观测器的时变编队跟踪控制协议,通过状态变换,将系统的时变编队跟踪控制问题,转变为误差系统的稳定性问题.然后利用图论及李雅普诺夫稳定定理,研究了系统实现时变编队跟踪控制的充分条件,并且指出时变编队参考函数与时变时延无关.最后,数据仿真结果证明了所设计的协议能使follower自主体实现时变编队,并且跟踪leader自主体的轨迹.

Leader-following多智能体网络分布式编队控制

针对多智能体固定拓扑网络,考虑无时延和有时延两种情况,研究了多智能体网络的分布式编队控制协议.首先,针对无通信时延的多智能体网络,提出了分布式编队控制协议,利用Lyapunov稳定理论,给出了协议有效的充分条件.然后,考虑时变通信时延,利用Lyapunov-Krasovskii函数证明了协议的有效性.最后,利用仿真实验证明了所设计协议的有效性.本文的创新点是对二阶多智能体网络设计分布式编队控制协议时考虑了速度一致性.

Mid-Course Guidance Law for Long Range Multi-Purpose Missiles

A useful mid course guidance law for long range multi purpose missiles is proposed. The law consists of two parts. One is used in the horizontal guidance plane, and the other in the vertical guidance plane. The mid course is combined with variable structure proportional navigation in the homing phase. Simulation results show that the proposed guidance law can meet the demands for starting up the homing phase and so the handing over between mid course guidance and terminal guidance can be carried out successfully.

基于观测器的多智能体网络leader-following编队控制

主要研究了leader-following多智能体网络的分布式编队问题。假设多智能体网络中的每个follower不能实时得到leader的信息,针对每个follower设计相应的分布式观测器。考虑了无时延的切换拓扑多智能体网络和存在时变时延的固定网络两种情况。利用Lyapunov稳定定理,给出了系统稳定和控制协议有效的充分条件。最后,给出了数字仿真结果以验证所设计协议的有效性,即followers形成所要求的编队并且与leader达到速度一致。

Saturation attack based route planning and threat avoidance algorithm for cruise missiles

According to the characteristic of cruise missiles,navigation point setting is simplified,and the principle of route planning for saturation attack and a concept of reference route are put forward.With the help of the shortest-tangent idea in route-planning and the algorithm of back reasoning from targets,a reference route algorithm is built on the shortest range and threat avoidance.Then a route-flight-time algorithm is built on navigation points.Based on the conditions of multi-direction saturation attack,a route planning algorithm of multi-direction saturation attack is built on reference route,route-flight-time,and impact azimuth.Simulation results show that the algorithm can realize missiles fired in a salvo launch reaching the target simultaneously from different directions while avoiding threat.

Iterative Learning Control for homing guidance design of missiles

This paper presents an Iterative Learning Control design applied to homing guidance of missiles against maneuvering targets. According to numerical experiments, although an increase of the control energies is appreciated with respect to a previous published base controller for comparison, this strategy, which is simple to realize, is able to reduce the time to reach the head-on condition to target destruction. This fact is important to minimize the missile lateral force-level to fulfill engaging in hyper-sonic target persecutions.

Leader-following consensus protocols for formation control of multi-agent network

Two protocols are presented,which can make agents reach consensus while achieving and preserving the desired formation in fixed topology with and without communication timedelay for multi-agent network.First,the protocol without considering the communication time-delay is presented,and by using Lyapunov stability theory,the sufficient condition of stability for this multi-agent system is presented.Further,considering the communication time-delay,the effectiveness of the protocol based on Lyapunov-Krasovskii function is demonstrated.The main contribution of the proposed protocols is that,as well as the velocity consensus is considered,the formation control is concerned for multi-agent systems described as the second-order equations.Finally,numerical examples are presented to illustrate the effectiveness of the proposed protocols.

A distributed decision method for missiles autonomous formation based on potential game

The distributed cooperative decision problems of missiles autonomous formation with network packet loss are investigated by using the potential game based on formation principles.In particular,a dynamic target allocation method for missiles formation is provided based on the potential game and formation principles,after the introduction of cooperative guidance and control system of the missiles formation.Then we seek the optimization of a global utility function through autonomous missiles that are capable of making individually rational decisions to optimize their own utility functions.The first important aspect of the problem is to design an individual utility function considering the characteristics of the missiles formation,with which the objective of the missiles are localized to each missile yet aligned with the global utility function.The second is to equip the missiles with an appropriate coordination mechanism with each missile pursuing the optimization of its own utility function.We present the design procedure for the utility,and present a coordination mechanism based on spatial adaptive play and then introduce the idea of“cyclical selected spatial adaptive play”and“negotiation based on time division multiple address(TDMA)protocol formation support network”.Finally,we present simulations for the distributed dynamic target allocation on the comprehensive digital simulation system,and the results illustrate the effectiveness and engineering applicability of the method.

Finite-time consensus for leader-following multi-agent systems over switching network topologies

Finite-time consensus problem of the leader-following multi-agent system under switching network topologies is studied in this paper. Based on the graph theory, matrix theory, homogeneity with dilation, and LaSalle＇s invariance principle, the control protocol of each agent using local information is designed, and the detailed analysis of the leader- following finite-time consensus is provided. Some examples and simulation results are given to illustrate the effectiveness of the obtained theoretical results.

THE GLOBAL DEFORMATION AND LOCAL DAMAGE ANALYSIS OF FILLED METALLIC CYLINDRICAL SHELLS IMPACTED BY MISSILES

A group of theoretical models has been developed for analyzingtransient dynamic re- sponse to filled metallic cylindrical shellsimpacted by flat-nosed missiles at normal obliquity on the ba- sis ofthe analogy modeling method of beam-on-foundation. It can be used forsolving the global defor- mation and the local failure of cylindricalshells in the impact process. the ballistic limit speed and im- pactresponse history have been calculated by this group of theoreticalmodels, and the inner pressure effect on the ballistic limit speedand some parameters are discussed at length.

Leader-following coordination of multi-agent systems with information feedback

Based on the strategy of information feedback from followers to the leader, flocking control of a group of agents with a leader is studied. The leader tracks a pre-defined trajectory and at the same time the leader uses the feedback information from followers to the leader to modify its motion. The advantage of this control scheme is that it reduces the tracking errors and improves the robustness of the team cohesion to followers＇ faults. The results of simulation are provided to illustrate that information feedback can improve the performance of the system.

Target-tracked prioritization to surveille ballistic missiles

The missile-tracked priority assessment for the early warning system monitoring multi-missile very well, is the first task to defend them and useful to perform optimally the sensor-to-missile assignment. The problem of the missile-tracked priority assessment is of incomplete information, of multi-attribute and dynamic. To solve the dificult problem, the index system, which includes six classification indices, is established by means of reducing the target＇s primary information which the early warning system focuses on. The lack of some attributes values, which is caused by the incomplete information, is handled by the approach： first classifying each attribute as unknown one or known one, and then subdividing the latter, last using the expectation and the information entropy if the attribute is known but uncertain. With a view of reality, nine qualitative evaluation criteria are given. Based on them each index is quantified by the eigenvector method. And then based on the improved technique for order preference by similarity to ideal solution （TOPSIS）, the targets-tracked priorities are assessed and sorted by an evaluation function from three aspects： 1） the quantity of the available information, 2） the affirmative or accurate degree of the available information, 3） the classification or trait of the available information.

Robust Leader-Following Output Regulation of Uncertain Multi-Agent Systems With Time-Varying Delay

In this paper, the robust analysis and design of leader-following output regulation for multi-agent systems described by general linear models is given in presence of timevarying delay and model uncertainty. To this aim, a new regulation protocol for the closed-loop multi-agent system under a directed graph is proposed. An important specification of the proposed protocol is to guarantee the leader-following output regulation for uncertain multi-agent systems with both stable and unstable agents. Since many signals can be approximated by a combination of the stationary and ramp signals, the presented results work for adequate variety of the leaders. The analysis and design conditions are presented in terms of certain matrix inequalities. The method proposed can be used for both stationary and ramp leaders. Simulation results are presented to show the effectiveness of the proposed method.

Optimal Guidance Law to Maximize Terminal Velocity for Missiles with Impact Angle Constraint

In this paper,an optimal guidance law for missiles with impact angle and miss distance constraints is proposed to achieve the maximal terminal velocity. The normal acceleration command that includes the timevarying coefficients is introduced to satisfy the desired impact angle as well as zero miss distance according to the geometric relation and relative motion parameters between missile and target. The problem is formulated as an optimal control problem by defining the angle of velocity error and flight-path angle as state variables and maximizing a performance index of the terminal velocity. The analytical form of the proposed guidance law is obtained as the solution of the optimal control problem combining optimal control theory and numerical value computation method. Nonlinear simulations of various situations demonstrate the performance and feasibility of the proposed optimal guidance law.

RUPTURE OF THIN METAL TUBES BY NORMAL AND OBLIQUE IMPACT OF BLUNT CONICALNOSED MISSILES:EXPERIMENTS

Impact tests at both normal and oblique angles of incidence were conducted on thin mild tubes using a moderate size of 90 degrees conical-nosed missiles. The minimum impact speed that generated cracks through the thickness of the wall, termed the speed for rupture, was measured, and various modes of rupture were identified. For a thin tube hit by a missile at a normal angle of obliquity at the speed for rupture, the contact region spreads across the nose of the missile, and the transverse shear deformation is predominant in the final failure process. If the angle of obliquity is 30 degrees, the missile pierces a hole through the wall of the tube. At the speed for rupture, the kinetic energy of the missile for oblique angle 30 degrees is only about 45% that required for plugging at a normal angle of obliquity.

Damage effectiveness assessment method for anti-ship missiles based on double hierarchy linguistic term sets and evidence theory

The research on the damage effectiveness assessment of anti-ship missiles involves system science and weapon science, and has essential strategic research significance. With comprehensive analysis of the specific process of the damage assessment process of anti-missile against ships, a synthetic damage effectiveness assessment process is proposed based on the double hierarchy linguistic term set and the evidence theory. In order to improve the accuracy of the expert ’s assessment information, double hierarchy linguistic terms are used to describe the assessment opinions of experts. In order to avoid the loss of experts ’ original information caused by information fusion rules, the evidence theory is used to fuse the assessment information of various experts on each case. Good stability of the assessment process can be reflected through sensitivity analysis, and the fluctuation of a certain parameter does not have an excessive influence on the assessment results. The assessment process is accurate enough to be reflected through comparative analysis and it has a good advantage in damage effectiveness assessment.

Event-triggered leader-following formation control for multi-agent systems under communication faults: application to a fleet of unmanned aerial vehicles

The main contribution of this paper is the design of an event-triggered formation control for leader-following consensus in second-order multi-agent systems(MASs)under communication faults.All the agents must follow the trajectories of a virtual leader despite communication faults considered as smooth time-varying delays dependent on the distance between the agents.Linear matrix inequalities(LMIs)-based conditions are obtained to synthesize a controller gain that guarantees stability of the synchronization error.Based on the closed-loop system,an event-triggered mechanism is designed to reduce the control law update and information exchange in order to reduce energy consumption.The proposed approach is implemented in a real platform of a fleet of unmanned aerial vehicles(UAVs)under communication faults.A comparison between a state-of-the-art technique and the proposed technique has been provided,demonstrating the performance improvement brought by the proposed approach.