Task assignment in ground-to-air confrontation based on multiagent deep reinforcement learning

The scale of ground-to-air confrontation task assignments is large and needs to deal with many concurrent task assignments and random events.Aiming at the problems where existing task assignment methods are applied to ground-to-air confrontation,there is low efficiency in dealing with complex tasks,and there are interactive conflicts in multiagent systems.This study proposes a multiagent architecture based on a one-general agent with multiple narrow agents(OGMN)to reduce task assignment conflicts.Considering the slow speed of traditional dynamic task assignment algorithms,this paper proposes the proximal policy optimization for task assignment of general and narrow agents(PPOTAGNA)algorithm.The algorithm based on the idea of the optimal assignment strategy algorithm and combined with the training framework of deep reinforcement learning(DRL)adds a multihead attention mechanism and a stage reward mechanism to the bilateral band clipping PPO algorithm to solve the problem of low training efficiency.Finally,simulation experiments are carried out in the digital battlefield.The multiagent architecture based on OGMN combined with the PPO-TAGNA algorithm can obtain higher rewards faster and has a higher win ratio.By analyzing agent behavior,the efficiency,superiority and rationality of resource utilization of this method are verified.

Cluster DetectionMethod of Endogenous Security Abnormal Attack Behavior in Air Traffic Control Network

In order to enhance the accuracy of Air Traffic Control(ATC)cybersecurity attack detection,in this paper,a new clustering detection method is designed for air traffic control network security attacks.The feature set for ATC cybersecurity attacks is constructed by setting the feature states,adding recursive features,and determining the feature criticality.The expected information gain and entropy of the feature data are computed to determine the information gain of the feature data and reduce the interference of similar feature data.An autoencoder is introduced into the AI(artificial intelligence)algorithm to encode and decode the characteristics of ATC network security attack behavior to reduce the dimensionality of the ATC network security attack behavior data.Based on the above processing,an unsupervised learning algorithm for clustering detection of ATC network security attacks is designed.First,determine the distance between the clustering clusters of ATC network security attack behavior characteristics,calculate the clustering threshold,and construct the initial clustering center.Then,the new average value of all feature objects in each cluster is recalculated as the new cluster center.Second,it traverses all objects in a cluster of ATC network security attack behavior feature data.Finally,the cluster detection of ATC network security attack behavior is completed by the computation of objective functions.The experiment took three groups of experimental attack behavior data sets as the test object,and took the detection rate,false detection rate and recall rate as the test indicators,and selected three similar methods for comparative test.The experimental results show that the detection rate of this method is about 98%,the false positive rate is below 1%,and the recall rate is above 97%.Research shows that this method can improve the detection performance of security attacks in air traffic control network.

KGTLIR:An Air Target Intention Recognition Model Based on Knowledge Graph and Deep Learning

As a core part of battlefield situational awareness,air target intention recognition plays an important role in modern air operations.Aiming at the problems of insufficient feature extraction and misclassification in intention recognition,this paper designs an air target intention recognition method(KGTLIR)based on Knowledge Graph and Deep Learning.Firstly,the intention recognition model based on Deep Learning is constructed to mine the temporal relationship of intention features using dilated causal convolution and the spatial relationship of intention features using a graph attention mechanism.Meanwhile,the accuracy,recall,and F1-score after iteration are introduced to dynamically adjust the sample weights to reduce the probability of misclassification.After that,an intention recognition model based on Knowledge Graph is constructed to predict the probability of the occurrence of different intentions of the target.Finally,the results of the two models are fused by evidence theory to obtain the target’s operational intention.Experiments show that the intention recognition accuracy of the KGTLIRmodel can reach 98.48%,which is not only better than most of the air target intention recognition methods,but also demonstrates better interpretability and trustworthiness.

An air combat maneuver pattern extraction based on time series segmentation and clustering analysis

Target maneuver recognition is a prerequisite for air combat situation awareness,trajectory prediction,threat assessment and maneuver decision.To get rid of the dependence of the current target maneuver recognition method on empirical criteria and sample data,and automatically and adaptively complete the task of extracting the target maneuver pattern,in this paper,an air combat maneuver pattern extraction based on time series segmentation and clustering analysis is proposed by combining autoencoder,G-G clustering algorithm and the selective ensemble clustering analysis algorithm.Firstly,the autoencoder is used to extract key features of maneuvering trajectory to remove the impacts of redundant variables and reduce the data dimension;Then,taking the time information into account,the segmentation of Maneuver characteristic time series is realized with the improved FSTS-AEGG algorithm,and a large number of maneuver primitives are extracted;Finally,the maneuver primitives are grouped into some categories by using the selective ensemble multiple time series clustering algorithm,which can prove that each class represents a maneuver action.The maneuver pattern extraction method is applied to small scale air combat trajectory and can recognize and correctly partition at least 71.3%of maneuver actions,indicating that the method is effective and satisfies the requirements for engineering accuracy.In addition,this method can provide data support for various target maneuvering recognition methods proposed in the literature,greatly reduce the workload and improve the recognition accuracy.

Airfoil friction drag reduction based on grid-type and super-dense array plasma actuators

To improve the cruise flight performance of aircraft, two new configurations of plasma actuators(grid-type and super-dense array) were investigated to reduce the turbulent skin friction drag of a low-speed airfoil. The induced jet characteristics of the two actuators in quiescent air were diagnosed with high-speed particle image velocimetry(PIV), and their drag reduction efficiencies were examined under different operating conditions in a wind tunnel. The results showed that the grid-type plasma actuator was capable of producing a wall-normal jet array(peak magnitude: 1.07 m/s) similar to that generated in a micro-blowing technique, while the superdense array plasma actuator created a wavy wall-parallel jet(magnitude: 0.94 m/s) due to the discrete spanwise electrostatic forces. Under a comparable electrical power consumption level,the super-dense array plasma actuator array significantly outperformed the grid-type configuration,reducing the total airfoil friction drag by approximately 22% at a free-stream velocity of 20 m/s.The magnitude of drag reduction was proportional to the dimensionless jet velocity ratio(r), and a threshold r = 0.014 existed under which little impact on airfoil drag could be discerned.

Autonomous air combat maneuver decision using Bayesian inference and moving horizon optimization

To reach a higher level of autonomy for unmanned combat aerial vehicle(UCAV) in air combat games, this paper builds an autonomous maneuver decision system. In this system,the air combat game is regarded as a Markov process, so that the air combat situation can be effectively calculated via Bayesian inference theory. According to the situation assessment result,adaptively adjusts the weights of maneuver decision factors, which makes the objective function more reasonable and ensures the superiority situation for UCAV. As the air combat game is characterized by highly dynamic and a significant amount of uncertainty,to enhance the robustness and effectiveness of maneuver decision results, fuzzy logic is used to build the functions of four maneuver decision factors. Accuracy prediction of opponent aircraft is also essential to ensure making a good decision; therefore, a prediction model of opponent aircraft is designed based on the elementary maneuver method. Finally, the moving horizon optimization strategy is used to effectively model the whole air combat maneuver decision process. Various simulations are performed on typical scenario test and close-in dogfight, the results sufficiently demonstrate the superiority of the designed maneuver decision method.

Dynamic assessment method of air target threat based on improved GIFSS

As the air combat environment becomes more complicated and changeable, accurate threat assessment of air target has a significant impact on air defense operations. This paper proposes an improved generalized intuitionistic fuzzy soft set (GIFSS) method for dynamic assessment of air target threat. Firstly, the threat assessment index is reasonably determined by analyzing the typical characteristics of air targets. Secondly, after the GIFSS at different time is obtained, the index weight is determined by the intuitionistic fuzzy set entropy and the relative entropy theory. Then, the inverse Poisson distribution method is used to determine the weight of time series, and then the time-weighted GIFSS is obtained. Finally, threat assessment of five air targets is carried out by using the improved GIFSS (I-GIFSS) and comparison methods. The validity and superiority of the proposed method are verified by calculation and comparison.

Situation assessment for air combat based on novel semi-supervised naive Bayes

A method is proposed to resolve the typical problem of air combat situation assessment. Taking the one-to-one air combat as an example and on the basis of air combat data recorded by the air combat maneuvering instrument, the problem of air combat situation assessment is equivalent to the situation classification problem of air combat data. The fuzzy C-means clustering algorithm is proposed to cluster the selected air combat sample data and the situation classification of the data is determined by the data correlation analysis in combination with the clustering results and the pilots＇ description of the air combat process. On the basis of semi-supervised naive Bayes classifier, an improved algorithm is proposed based on data classification confidence, through which the situation classification of air combat data is carried out. The simulation results show that the improved algorithm can assess the air combat situation effectively and the improvement of the algorithm can promote the classification performance without significantly affecting the efficiency of the classifier.

Strength characteristics of modified polypropylene fiber and cement-reinforced loess

The reinforcement and stabilization of loess soil are duscussed by using fibers as the reinforcement and cement as the stabilization materials.To study the strength characteristics of loess soil reinforced by modified polypropylene(MPP) fiber and cement,samples were prepared with six different fiber contents,three different cement contents,three different curing periods and three kinds of fiber length.The samples were tested under submergence and non-submergence conditions for the unconfined compressive strength(UCS),the splitting tensile strength and the compressive resilient modulus.The results indicated that combined reinforcement by PP fiber and cement could significantly improve the early strength of loess to 3.65–5.99 MPa in three days.With an increase in cement content,the specimens exhibited brittle fracture.However,the addition of fibers gradually modified the mode of fracture from brittle to ductile to plastic.The optimal dosage of fiber to reinforce loess was in the range of 0.3%–0.45% and the optimum fiber length was 12 mm,for which the unconfined compressive strength and tensile strength reached their maxima.Based on the analysis of failure properties,cement-reinforced loess specimens were susceptible to brittle damage under pressure,and the effect of modified polypropylene fiber as the connecting "bridge" could help the specimens achieve a satisfactory level of ductility when under pressure.

Intervention decision-making in MAV/UAV cooperative engagement based on human factors engineering

Aiming at the intervention decision-making problem in manned/unmanned aerial vehicle（MAV/UAV） cooperative engagement, this paper carries out a research on allocation strategy of emergency discretion based on human factors engineering（HFE）.Firstly, based on the brief review of research status of HFE, it gives structural description to emergency in the process of cooperative engagement and analyzes intervention of commanders. After that,constraint conditions of intervention decision-making of commanders based on HFE（IDMCBHFE） are given, and the mathematical model, which takes the overall efficiency value of handling emergencies as the objective function, is established. Then, through combining K-best and variable neighborhood search（VNS） algorithm, a K-best optimization variable neighborhood search mixed algorithm（KBOVNSMA） is designed to solve the model. Finally,through three groups of simulation experiments, effectiveness and superiority of the proposed algorithm are verified.

Approach to WTA in air combat using IAFSA-IHS algorithm

In this paper, a static weapon target assignment（WTA）problem is studied. As a critical problem in cooperative air combat,outcome of WTA directly influences the battle. Along with the cost of weapons rising rapidly, it is indispensable to design a target assignment model that can ensure minimizing targets survivability and weapons consumption simultaneously. Afterwards an algorithm named as improved artificial fish swarm algorithm-improved harmony search algorithm（IAFSA-IHS） is proposed to solve the problem. The effect of the proposed algorithm is demonstrated in numerical simulations, and results show that it performs positively in searching the optimal solution and solving the WTA problem.

A Chaos Sparrow Search Algorithm with Logarithmic Spiral and Adaptive Step for Engineering Problems

The sparrow search algorithm(SSA)is a newly proposed meta-heuristic optimization algorithm based on the sparrowforaging principle.Similar to other meta-heuristic algorithms,SSA has problems such as slowconvergence speed and difficulty in jumping out of the local optimum.In order to overcome these shortcomings,a chaotic sparrow search algorithm based on logarithmic spiral strategy and adaptive step strategy(CLSSA)is proposed in this paper.Firstly,in order to balance the exploration and exploitation ability of the algorithm,chaotic mapping is introduced to adjust the main parameters of SSA.Secondly,in order to improve the diversity of the population and enhance the search of the surrounding space,the logarithmic spiral strategy is introduced to improve the sparrow search mechanism.Finally,the adaptive step strategy is introduced to better control the process of algorithm exploitation and exploration.The best chaotic map is determined by different test functions,and the CLSSA with the best chaotic map is applied to solve 23 benchmark functions and 3 classical engineering problems.The simulation results show that the iterative map is the best chaotic map,and CLSSA is efficient and useful for engineering problems,which is better than all comparison algorithms.

Investigation on the shockwave induced by surface arc plasma in quiescent air

The shockwave induced by surface direct-current （DC） arc discharge is investigated both experimentally and numer- ically. In the experiment, the shockwave generated by rapid gas heating is clearly observed from Schlieren images. The peak velocity of the shockwave is measured to be over 410 m/s; during its upright movement, it gradually falls to about 340 m/s; no remarkable difference is seen after changing the discharge voltage and the pulse frequency. In the modeling of the arc plasma, the arc domain is not simulated as a boundary condition with fixed temperature or pressure, but a source term with a time-varying input power density, which could better reflect the influence of the heating process. It is found that with a reference power density of 2.8× 1012 W/m2, the calculated peak velocity is higher than the measured one, but they quickly （in 30 Its） become agreed with each other. The peak velocity also rises while increasing the power density, the maximum velocity acquired in the simulation is over 468 m/s, which is expected to be effective for high speed flow control.

Approach for air-to-air confrontment based on uncertain interval information conditions

Model combat information conditions are always uncertain and varied, the uncertain interval theory is therefore introduced into the research of multiple fighters suppressing the integrated air defense system(IADS) problem. Considering that the combat information conditions are uncertain intervals, the payoff function of the game for multiple fighters suppressing the IADS is modeled.Using the operation rules for interval numbers and the possibility degree, an improved chaotic particle swarm optimization(CPSO)is designed to solve the proposed model so as to obtain the optimal game solution. Comparison simulations are performed to analyze the influence of the weapons consumption and the distances of non-escaped zone and jamming on air combat result. Simulation results suggest that Nash equilibrium is achieved and verify the effectiveness of the proposed method.

Fuzzy Q learning algorithm for dual-aircraft path planning to cooperatively detect targets by passive radars

The problem of passive detection discussed in this paper involves searching and locating an aerial emitter by dualaircraft using passive radars. In order to improve the detection probability and accuracy, a fuzzy Q learning algorithrn for dual-aircraft flight path planning is proposed. The passive detection task model of the dual-aircraft is set up based on the partition of the target active radar＇s radiation area. The problem is formulated as a Markov decision process （MDP） by using the fuzzy theory to make a generalization of the state space and defining the transition functions, action space and reward function properly. Details of the path planning algorithm are presented. Simulation results indicate that the algorithm can provide adaptive strategies for dual-aircraft to control their flight paths to detect a non-maneuvering or maneu- vering target.

Ripple-effect analysis for operational architecture of air defense systems with supernetwork modeling

In order to solve the problem that the ripple-effect analy- sis for the operational architecture of air defense systems （OAADS） is hardly described in quantity with previous modeling approaches, a supernetwork modeling approach for the OAADS is put for- ward by extending granular computing. Based on that operational units and links are equal to different information granularities, the supernetwork framework of the OAADS is constructed as a “four- network within two-layer” structure by forming dynamic operating coalitions, and measuring indexes of the ripple-effect analysis for the OAADS are given combining with Laplace spectral radius. In this framework, via analyzing multidimensional attributes which inherit relations between operational units in different granular scales, an extended granular computing is put forward integrating with a topological structure. Then the operation process within the supernetwork framework, including transformation relations be- tween two layers in the vertical view and mapping relations among functional networks in the horizontal view, is studied in quantity. As the application case shows, comparing with previous modeling approaches, the supernetwork model can validate and analyze the operation mechanism in the air defense architecture, and the ripple-effect analysis can be used to confirm the key operational unit with micro and macro viewpoints.

Experimental Investigation on Airfoil Shock Control by Plasma Aerodynamic Actuation

An experimental investigation on airfoil （NACA64-215） shock control is performed by plasma aerodynamic actuation in a supersonic tunnel （Ma -= 2）. The results of schlieren and pressure measurement show that when plasma aerodynamic actuation is applied, the position moves forward and the intensity of shock at the head of the airfoil weakens. With the increase in actuating voltage, the total pressure measured at the head of the airfoil increases, which means that the shock intensity decreases and the control effect increases. The best actuation effect is caused by upwind-direction actuation with a magnetic field, and then downwind-direction actuation with a magnetic field, while the control effect of aerodynamic actuation without a magnetic field is the most inconspicuous. The mean intensity of the normal shock at the head of the airfoil is relatively decreased by 16.33%, and the normal shock intensity is relatively reduced by 27.5% when 1000 V actuating voltage and upwind-direction actuation are applied with a magnetic field. This paper theoretically analyzes the Joule heating effect generated by DC discharge and the Lorentz force effect caused by the magnetic field. The discharge characteristics are compared for all kinds of actuation conditions to reveal the mechanism of shock control by plasma aerodynamic actuation.

Task assignment under constraint of timing sequential for cooperative air combat

According to the previous achievement, the task assignment under the constraint of timing continuity for a cooperative air combat is studied. An extensive task assignment scenario with the background of the cooperative air combat is proposed. The utility and time of executing a task as well as the continuous combat ability are defined. The concept of the matching method of weapon and target is modified based on the analysis of the air combat scenario. The constraint framework is also redefined according to a new objective function. The constraints of timing and continuity are formulated with a new method, at the same time, the task assignment and integer programming models of the cooperative combat are established. Finally, the assignment problem is solved using the integrated linear programming software and the simulation shows that it is feasible to apply this modified model in the cooperative air combat for tasks cooperation and it is also efficient to optimize the resource assignment.

Evaluation method and optimization strategies of resilience for air&space defense system of systems based on kill network theory and improved self-information quantity

Resilience of air&space defense system of systems(SoSs)is critical to national air defense security.However,the research on it is still scarce.In this study,the resilience of air&space defense SoSs is firstly defined and the kill network theory is established by combining super network and kill chain theory.Two cases of the SoSs are considered:(a)The kill chains are relatively homogenous;(b)The kill chains are relatively heterogenous.Meanwhile,two capability assessment methods,which are based on the number of kill chains and improved self-information quantity,respectively,are proposed.The improved self-information quantity modeled based on nodes and edges can achieve qualitative and quantitative assessment of the combat capability by using linguistic Pythagorean fuzzy sets.Then,a resilient evaluation index consisting of risk response,survivability,and quick recovery is proposed accordingly.Finally,network models for regional air defense and anti-missile SoSs are established respectively,and the resilience measurement results are verified and analyzed under different attack and recovery strategies,and the optimization strategies are also proposed.The proposed theory and method can meet different demands to evaluate combat capability and optimize resilience of various types of air&space defense and similar SoSs.

Finite-time adaptive sliding mode control for heavyweight airdrop operations

This paper investigates the problem of designing a fast convergent sliding mode flight controller of a transport aircraft for heavyweight airdrop operations in the presence of bounded uncertainties without the prior knowledge of the bounds. On the basis of feedback linearization of the aircraft-cargo motion system, a novel integral sliding mode flight control law with gains adaptation is proposed. It contains a nominal control law used to achieve finite-time stabilization performance and a compensated control law used to reject the uncertainties. The switching gains of the compensated control law are tuned using adaptation algorithms, and the knowledge of the bounds of the uncertainties is not required to be known in advance. Meanwhile, the severe chattering of the sliding mode control that caused by high switching gains is effectively reduced. The controller and its performance are evaluated on a transport aircraft performing a maximum load airdrop task in a number of simulation scenarios.