A deep multimodal fusion and multitasking trajectory prediction model for typhoon trajectory prediction to reduce flight scheduling cancellation

Natural events have had a significant impact on overall flight activity,and the aviation industry plays a vital role in helping society cope with the impact of these events.As one of the most impactful weather typhoon seasons appears and continues,airlines operating in threatened areas and passengers having travel plans during this time period will pay close attention to the development of tropical storms.This paper proposes a deep multimodal fusion and multitasking trajectory prediction model that can improve the reliability of typhoon trajectory prediction and reduce the quantity of flight scheduling cancellation.The deep multimodal fusion module is formed by deep fusion of the feature output by multiple submodal fusion modules,and the multitask generation module uses longitude and latitude as two related tasks for simultaneous prediction.With more dependable data accuracy,problems can be analysed rapidly and more efficiently,enabling better decision-making with a proactive versus reactive posture.When multiple modalities coexist,features can be extracted from them simultaneously to supplement each other’s information.An actual case study,the typhoon Lichma that swept China in 2019,has demonstrated that the algorithm can effectively reduce the number of unnecessary flight cancellations compared to existing flight scheduling and assist the new generation of flight scheduling systems under extreme weather.

A Meta-Learning Approach for Aircraft Trajectory Prediction

The aviation industry has seen significant advancements in safety procedures over the past few decades, resulting in a steady decline in aviation deaths worldwide. However, the safety standards in General Aviation (GA) are still lower compared to those in commercial aviation. With the anticipated growth in air travel, there is an imminent need to improve operational safety in GA. One way to improve aircraft and operational safety is through trajectory prediction. Trajectory prediction plays a key role in optimizing air traffic control and improving overall flight safety. This paper proposes a meta-learning approach to predict short- to mid-term trajectories of aircraft using historical real flight data collected from multiple GA aircraft. The proposed solution brings together multiple models to improve prediction accuracy. In this paper, we are combining two models, Random Forest Regression (RFR) and Long Short-term Memory (LSTM), using k-Nearest Neighbors (k-NN), to output the final prediction based on the combined output of the individual models. This approach gives our model an edge over single-model predictions. We present the results of our meta-learner and evaluate its performance against individual models using the Mean Absolute Error (MAE), Absolute Altitude Error (AAE), and Root Mean Squared Error (RMSE) evaluation metrics. The proposed methodology for aircraft trajectory forecasting is discussed in detail, accompanied by a literature review and an overview of the data preprocessing techniques used. The results demonstrate that the proposed meta-learner outperforms individual models in terms of accuracy, providing a more robust and proactive approach to improve operational safety in GA.

Air combat target maneuver trajectory prediction based on robust regularized Volterra series and adaptive ensemble online transfer learning

Target maneuver trajectory prediction is an important prerequisite for air combat situation awareness and maneuver decision-making.However,how to use a large amount of trajectory data generated by air combat confrontation training to achieve real-time and accurate prediction of target maneuver trajectory is an urgent problem to be solved.To solve this problem,in this paper,a hybrid algorithm based on transfer learning,online learning,ensemble learning,regularization technology,target maneuvering segmentation point recognition algorithm,and Volterra series,abbreviated as AERTrOS-Volterra is proposed.Firstly,the model makes full use of a large number of trajectory sample data generated by air combat confrontation training,and constructs a Tr-Volterra algorithm framework suitable for air combat target maneuver trajectory prediction,which realizes the extraction of effective information from the historical trajectory data.Secondly,in order to improve the real-time online prediction accuracy and robustness of the prediction model in complex electromagnetic environments,on the basis of the TrVolterra algorithm framework,a robust regularized online Sequential Volterra prediction model is proposed by integrating online learning method,regularization technology and inverse weighting calculation method based on the priori error.Finally,inspired by the preferable performance of models ensemble,ensemble learning scheme is also incorporated into our proposed algorithm,which adaptively updates the ensemble prediction model according to the performance of the model on real-time samples and the recognition results of target maneuvering segmentation points,including the adaptation of model weights;adaptation of parameters;and dynamic inclusion and removal of models.Compared with many existing time series prediction methods,the newly proposed target maneuver trajectory prediction algorithm can fully mine the prior knowledge contained in the historical data to assist the current prediction.The rationality and effectiveness of the proposed algorithm are verified by simulation on three sets of chaotic time series data sets and a set of real target maneuver trajectory data sets.

A Flight Trajectory Prediction Method Based on Internal Relationships between Attributes

The rapid development of the aviation industry urgently requires airspace traffic management,and flight trajectory prediction is a core component of airspace traffic management.Flight trajectory is a multidimensional time series with rich spatio-temporal characteristics,and existing flight trajectory prediction methods only target the trajectory point temporal relationships,but not the implicit interrelationships among the trajectory point attributes.In this paper,a graph convolutional network(AR-GCN)based on the intra-attribute relationships is proposed for solving the flight track prediction problem.First,the network extracts the temporal features of each attribute and fuses them with the original features of the attribute to obtain the enhanced attribute features,then extracts the implicit relationships between attributes as inter-attribute relationship features.Secondly,the enhanced attribute features are used as nodes and the inter-attribute relationship features are used as edges to construct the inter-attribute relationship graph.Finally,the graph convolutional network is used to aggregate the attribute features.Based on the full fusion of the above features,we achieved high accuracy prediction of the trajectory.In this paper,experiments are conducted on ADS-B historical track data.We compare our method with the classical method and the proposed method.Experimental results show that our method achieves significant improvement in prediction accuracy.

Target maneuver trajectory prediction based on RBF neural network optimized by hybrid algorithm

Target maneuver trajectory prediction plays an important role in air combat situation awareness and threat assessment.To solve the problem of low prediction accuracy of the traditional prediction method and model,a target maneuver trajectory prediction model based on phase space reconstruction-radial basis function(PSR-RBF)neural network is established by combining the characteristics of trajectory with time continuity.In order to further improve the prediction performance of the model,the rival penalized competitive learning(RPCL)algorithm is introduced to determine the structure of RBF,the Levenberg-Marquardt(LM)and the hybrid algorithm of the improved particle swarm optimization(IPSO)algorithm and the k-means are introduced to optimize the parameter of RBF,and a PSR-RBF neural network is constructed.An independent method of 3D coordinates of the target maneuver trajectory is proposed,and the target manuver trajectory sample data is constructed by using the training data selected in the air combat maneuver instrument(ACMI),and the maneuver trajectory prediction model based on the PSR-RBF neural network is established.In order to verify the precision and real-time performance of the trajectory prediction model,the simulation experiment of target maneuver trajectory is performed.The results show that the prediction performance of the independent method is better,and the accuracy of the PSR-RBF prediction model proposed is better.The prediction confirms the effectiveness and applicability of the proposed method and model.

NSHV trajectory prediction algorithm based on aerodynamic acceleration EMD decomposition

Aiming at the problem of gliding near space hypersonic vehicle(NSHV)trajectory prediction,a trajectory prediction method based on aerodynamic acceleration empirical mode decomposition(EMD)is proposed.The method analyzes the motion characteristics of the skipping gliding NSHV and verifies that the aerodynamic acceleration of the target has a relatively stable rule.On this basis,EMD is used to extract the trend of aerodynamic acceleration into multiple sub-items,and aggregate sub-items with similar attributes.Then,a prior basis function is set according to the aerodynamic acceleration stability rule,and the aggregated data are fitted by the basis function to predict its future state.After that,the prediction data of the aerodynamic acceleration are used to drive the system to predict the target trajectory.Finally,experiments verify the effectiveness of the method.In addition,the distribution of prediction errors in space is discussed,and the reasons are analyzed.

Aircraft Trajectory Prediction Based on Modified Interacting Multiple Model Algorithm

In order to realize the aircraft trajectory prediction,a modified interacting multiple model(M-IMM) algorithm is proposed,which is based on the performance analysis of the standard interacting multiple model(IMM) algorithm.In the proposed M-IMM algorithm,a new likelihood function is defined for the sake of updating flight mode probabilities,in which the influences of interacting to residual's mean error are taken into account and the assumption of likelihood function being a zero mean Gaussian function is discarded.Finally,the proposed M-IMM algorithm is applied to the simulation of the aircraft trajectory prediction,and the comparative studies are conducted to existing algorithms.The simulation results indicate the proposed M-IMM algorithm can predict aircraft trajectory more quickly and accurately.

A Recurrent Attention and Interaction Model for Pedestrian Trajectory Prediction

The movement of pedestrians involves temporal continuity,spatial interactivity,and random diversity.As a result,pedestrian trajectory prediction is rather challenging.Most existing trajectory prediction methods tend to focus on just one aspect of these challenges,ignoring the temporal information of the trajectory and making too many assumptions.In this paper,we propose a recurrent attention and interaction(RAI)model to predict pedestrian trajectories.The RAI model consists of a temporal attention module,spatial pooling module,and randomness modeling module.The temporal attention module is proposed to assign different weights to the input sequence of a target,and reduce the speed deviation of different pedestrians.The spatial pooling module is proposed to model not only the social information of neighbors in historical frames,but also the intention of neighbors in the current time.The randomness modeling module is proposed to model the uncertainty and diversity of trajectories by introducing random noise.We conduct extensive experiments on several public datasets.The results demonstrate that our method outperforms many that are state-ofthe-art.

A Spatial-Temporal Attention Model for Human Trajectory Prediction

Human trajectory prediction is essential and promising in many related applications. This is challenging due to the uncertainty of human behaviors, which can be influenced not only by himself, but also by the surrounding environment. Recent works based on long-short term memory(LSTM) models have brought tremendous improvements on the task of trajectory prediction. However, most of them focus on the spatial influence of humans but ignore the temporal influence. In this paper, we propose a novel spatial-temporal attention(ST-Attention) model,which studies spatial and temporal affinities jointly. Specifically,we introduce an attention mechanism to extract temporal affinity,learning the importance for historical trajectory information at different time instants. To explore spatial affinity, a deep neural network is employed to measure different importance of the neighbors. Experimental results show that our method achieves competitive performance compared with state-of-the-art methods on publicly available datasets.

Interaction-Aware Cut-In Trajectory Prediction and Risk Assessment in Mixed Traffic

Accurately predicting the trajectories of surrounding vehicles and assessing the collision risks are essential to avoid side and rear-end collisions caused by cut-in.To improve the safety of autonomous vehicles in the mixed traffic,this study proposes a cut-in prediction and risk assessment method with considering the interactions of multiple traffic participants.The integration of the support vector machine and Gaussian mixture model(SVM-GMM)is developed to simultaneously predict cut-in behavior and trajectory.The dimension of the input features is reduced through Chebyshev fitting to improve the training efficiency as well as the online inference performance.Based on the predicted trajectory of the cut-in vehicle and the responsive actions of the autonomous vehicles,two risk measurements are introduced to formulate the comprehensive interaction risk through the combination of Sigmoid function and Softmax function.Finally,the comparative analysis is performed to validate the proposed method using the naturalistic driving data.The results show that the proposed method can predict the trajectory with higher precision and effectively evaluate the risk level of a cut-in maneuver compared to the methods without considering interaction.

A Probabilistic Architecture of Long-Term Vehicle Trajectory Prediction for Autonomous Driving

In mixed and dynamic traffic environments,accurate long-term trajectory forecasting of surrounding vehicles is one of the indispensable preconditions for autonomous vehicles to accomplish reasonable behavioral decisions and guarantee driving safety.In this paper,we propose an integrated probabilistic architecture for long-term vehicle trajectory prediction,which consists of a driving inference model(DIM)and a trajectory prediction model(TPM).The DIM is designed and employed to accurately infer the potential driving intention based on a dynamic Bayesian network.The proposed DIM incorporates the basic traffic rules and multivariate vehicle motion information.To further improve the prediction accuracy and realize uncertainty estimation,we develop a Gaussian process-based TPM,considering both the short-term prediction results of the vehicle model and the driving motion characteristics.Afterward,the effectiveness of our novel approach is demonstrated by conducting experiments on a public naturalistic driving dataset under lane-changing scenarios.The superior performance on the task of long-term trajectory prediction is presented and verified by comparing with other advanced methods.

Bayonet-corpus:a trajectory prediction method based on bayonet context and bidirectional GRU

Predicting travel trajectory of vehicles can not only provide personalized services to users,but also have a certain effect on traffic guidance and traffic control.In this paper,we build a Bayonet-Corpus based on the context of traffic intersections,and use it to model a traffic network.Besides,Bidirectional Gated Recurrent Unit(Bi-GRU)is used to predict the sequence of traffic intersections in one single trajectory.Firstly,considering that real traffic networks are usually complex and disorder and cannot reflect the higher dimensional relationship among traffic intersections,this paper proposes a new traffic network modeling algorithm based on the context of traffic intersections:inspired by the probabilistic language model,a Bayonet-Corpus is constructed from traffic intersections in real trajectory sequence,so the high-dimensional similarity between corpus nodes can be used to measure the semantic relation of real traffic intersections.This algorithm maps vehicle trajectory nodes into a high-dimensional space vector,blocking complex structure of real traffic network and reconstructing the traffic network space.Then,the bayonets sequence in real traffic network is mapped into a matrix.Considering the trajectories sequence is bidirectional,and Bi-GRU can handle information from forward and backward simultaneously,we use Bi-GRU to bidirectionally model the trajectory matrix for the purpose of prediction.

Lane-Exchanging Driving Strategy for Autonomous Vehicle via Trajectory Prediction and Model Predictive Control

The cooperation between an autonomous vehicle and a nearby vehicle is critical to ensure driving safety in the laneexchanging scenario.The nearby vehicle trajectory needs to be predicted,from which the autonomous vehicle is controlled to prevent possible collisions.This paper proposes a lane-exchanging driving strategy for the autonomous vehicle to cooperate with the nearby vehicle by integrating vehicle trajectory prediction and motion control.A trajectory prediction method is developed to anticipate the nearby vehicle trajectory.The Gaussian mixture model(GMM),together with the vehicle kinematic model,are synthesized to predict the nearby vehicle trajectory.A potential-feldbased model predictive control(MPC)approach is utilized by the autonomous vehicle to conduct the lane-exchanging maneuver.The potential feld of the nearby vehicle is considered in the controller design for collision avoidance.On-road driving data verifcation shows that the nearby vehicle trajectory can be predicted by the proposed method.CarSim®simulations validate that the autonomous vehicle can perform the lane-exchanging maneuver and avoid the nearby vehicle using the proposed driving strategy.The autonomous vehicle can thus safely perform the laneexchanging maneuver and avoid the nearby vehicle.

Intent Inference Based Trajectory Prediction and Smooth for UAS in Low-Altitude Airspace with Geofence

In order to meet the higher accuracy requirement of trajectory prediction for Unmanned Aircraft System(UAS)in Unmanned Aircraft System Traffic Management(UTM),an Intent Based Trajectory Prediction and Smooth Based on Constrained State-dependent-transition Hybrid Estimation(CSDTHE-IBTPS)algorithm is proposed.Firstly,an intent inference method of UAS is constructed based on the information of ADS-B and geofence system.Moreover,a geofence layering algorithm is proposed.Secondly,the Flight Mode Change Points(FMCP)are used to define the relevant mode transition parameters and design the guard conditions,so as to generate the mode transition probability matrix and establish the continuous state-dependent-transition model.After that,the constrained Kalman filter(CKF)is applied to improve State-dependent-transition Hybrid Estimation(SDTHE)algorithm by applying equality constraint to the velocity of UAS in the straight phase and turning phase,respectively,and thus the constrained state-dependent-transition hybrid estimation(CSDTHE)algorithm is constructed.Finally,the results of intent inference and hybrid estimation are used to make trajectory prediction.Furthermore,each flight segment of trajectory is smoothed respectively by Rauch-Tung-Striebel(RTS)backward smooth method using the proposed CSDTHE-RTS algorithm,so as to obtain more accurate trajectory prediction results.The simulation shows that the proposed algorithm can reduce the errors of trajectory prediction and the time delay of intent inference.

Influence of Kinematic Analysis Parameters of Drag Anchor Trajectory Prediction Using Yield Envelope Method

Drag anchor is widely applied in offshore engineering for offshore mooring systems.The prediction of the invisible trajectory during its drag-in installation is challenging for anchor design in determining the anchor final position for ensuring sufficient holding capacity.The yield envelope method based on deep anchor failure for kinematic analysis was proposed as a promising trajectory prediction method for drag anchor.However,there is a lack of analysis on the effects of the parameters applied in the kinematic analysis.The current work studies the effects of the yield envelope parameters,anchor line bearing capacity factor and the anchor/soil interface friction.It is found that the accuracy of the yield envelope parameters has large impact on the prediction results based on deep yield envelopes.Analyses of cases with smooth fluke predict deeper embedment depth than that from analyses of cases with rough fluke.The decrease of the capacity factor results in the increase of the anchor embedment depth,the anchor line load,the anchor chain angle and the stable value of the normalized horizontal load component for the same drag length,while the stable value of the normalized vertical load component decreases when the capacity factor decreases.This illustrates the importance in applying reasonable parameters and improving the method for more reliable prediction of the anchor trajectory.

Trajectory prediction model for crossing-based target selection

Background Crossing-based target selection motion may attain less error rates and higher interactive speed in some cases.Most of the research in target selection fields are focused on the analysis of the interaction results.Additionally,as trajectories play a much more important role in crossing-based target selection compared to the other interactive techniques,an ideal model for trajectories can help computer designers make predictions about interaction results during the process of target selection rather than at the end of the whole process.Methods In this paper,a trajectory prediction model for crossing based target selection tasks is proposed by taking the reference of a dynamic model theory.Results Simulation results demonstrate that our model performed well with regard to the prediction of trajectories,endpoints and hitting time for target-selection motion,and the average error of trajectories,endpoints and hitting time values were found to be 17.28%,2.73mm and 11.50%,respectively.

Pedestrian trajectory prediction method based on the Social-LSTM model for vehicle collision

Techniques for predicting the trajectory of vulnerable road users are important to the development of perception systems for autonomous vehicles to avoid accidents.The most effective trajectory prediction methods,such as Social-LSTM,are often used to predict pedestrian trajectories in normal passage scenarios.However,they can produce unsatisfactory prediction results and data redundancy,as well as difficulties in predicting trajectories using pixel-based coordinate systems in collision avoidance systems.There is also a lack of validations using real vehicle-to-pedestrian collisions.To address these issues,some insightful approaches to improve the trajectory prediction scheme of Social-LSTM were proposed,such methods included transforming pedestrian trajectory coordinates and converting image coordinates to world coordinates.The YOLOv5 detection model was introduced to reduce target loss and improve prediction accuracy.The DeepSORT algorithm was employed to reduce the number of target transformations in the tracking model.Image Perspective Transformation(IPT)and Direct Linear Transformation(DLT)theories were combined to transform the coordinates to world coordinates,identifying the collision location where the accident could occur.The performance of the proposed method was validated by training tests using MS COCO(Microsoft Common Objects in Context)and ETH/UCY datasets.The results showed that the target detection accuracy was more than 90%and the prediction loss tends to decrease with increasing training steps,with the final loss value less than 1%.The reliability and effectiveness of the improved method were demonstrated by benchmarking system performance to two video recordings of real pedestrian accidents with different lighting conditions.

A Hierarchical LSTM-Based Vehicle Trajectory Prediction Method Considering Interaction Information

Trajectory prediction is an essential component in autonomous driving systems,as it can forecast the future movements of surrounding vehicles,thereby enhancing the decision-making and planning capabilities of autonomous driving systems.Traditional models relying on constant acceleration and constant velocity often experience a reduction in prediction accu-racy as the forecasted timeframe extends.This limitation makes it challenging to meet the demands for medium to long-term trajectory prediction.Conversely,data-driven models,particularly those based on Long Short-Term Memory(LSTM)neural networks,have demonstrated superior performance in medium to long-term trajectory prediction.Therefore,this study introduces a hierarchical LSTM-based method for vehicle trajectory prediction.Considering the difficulty of using a single LSTM model to predict trajectories for all driving intentions,the trajectory prediction task is decomposed into three sequential steps:driving intention prediction,lane change time prediction,and trajectory prediction.Furthermore,given that the driving intent and trajectory of a vehicle are always subject to the influence of the surrounding traffic flow,the predictive model proposed in this paper incorporates the interactional information of neighboring vehicle movements into the model input.The proposed method is trained and validated on the real vehicle trajectory dataset Next Generation Simulation.The results show that the proposed hierarchical LSTM method has a lower prediction error compared to the integral LSTM model.

Optimization of LSTM Ship Trajectory Prediction Based on Hybrid Genetic Algorithm

Accurate prediction of the movement trajectory of sea surface targets holds significant importance in achieving an advantageous position in the sea battle field.This prediction plays a crucial role in ensuring security defense and confrontation,and is essential for effective deployment of military strategy.Accurately predicting the trajectory of sea surface targets using AIS(Automatic Identification System)information is crucial for security defense and confrontation,and holds significant importance for military strategy deployment.In response to the problem of insufficient accuracy in ship trajectory prediction,this study proposes a hybrid genetic algorithm to optimize the Long Short-Term Memory(LSTM)algorithm.The HGA-LSTM algorithm is proposed for ship trajectory prediction.It can converge faster and obtain better parameter solutions,thereby improving the effectiveness of ship trajectory prediction.Compared to traditional LSTM and GA-LSTM algorithms,experimental results demonstrate that this algorithm outperforms them in both single-step and multi-step prediction.

Trajectory prediction in pipeline form for intercepting hypersonic gliding vehicles based on LSTM

The interception problem of Hypersonic Gliding Vehicles(HGVs)has been an important aspect of missile defense systems.In order to provide interceptors with accurate information of target trajectory,a model based on an improved Long Short-Time Memory(LSTM)network for trajectory prediction pipeline is proposed for the interception of a skip gliding hypersonic target.Firstly,for trajectory prediction required by intercepting guidance laws,the altitude,velocity and velocity direction of the target are formulated in the form of analytic functions,consisting of linear decay terms and amplitude decay sinusoidal terms.Then,the dynamic characteristics of the model parameters are analyzed,and the target trajectory prediction pipeline is proposed with the prediction error considered.Finally,an improved LSTM network is designed to estimate parameters in a dynamically-updated manner,and estimation results are used for the calculation of the final trajectory prediction pipeline.The proposed prediction algorithm provides information on the velocity vector for midcourse guidance with the effect of prediction errors on interception taken into account.Simulation is conducted and the results show the high accuracy of the algorithm in HGVs’trajectory prediction which is conducive to increasing the interception success rate.