基于Transformer动态场景信息生成对抗网络的行人轨迹预测方法

Pedestrian Trajectory Prediction Method Using Dynamic Scene Information Based Transformer Generative Adversarial Network

行人轨迹预测是视频监控的重要组成部分,因现有方法未充分利用场景特征信息造成其预测轨迹不符合生活常识,导致行人轨迹预测精度较低出现明显偏离真实轨迹的情况.针对上述不足本文提出一种基于Transformer动态场景信息生成对抗网络(Generative Adversarial Network,GAN)的行人轨迹预测方法.该方法利用动态场景特征提取模块的卷积神经网络(Convolutional Neural Networks,CNN)模型对目标行人的动态场景信息进行特征提取,同时生成器网络中的编码器利用Transformer对行人的社会交互信息特征以及轨迹信息特征进行建模.在ETH和UCY数据集上的实验结果表明,与Social GAN模型相比,本文方法在多个场景下的平均位移误差准确率提高了25.61%,最终位移误差准确率提高了38.44%.

Pedestrian trajectory prediction is an important part of video surveillance.The current methods are not accurate and sometimes violate common senses because scene information is not fully used.To eliminate the above shortcomings,this paper proposes a transformer generated adversarial network(GAN)algorithm which combines dynamic scene information with pedestrian social interaction information.The convolution neural network model of the dynamic scene extraction module is utilized to extract the dynamic scene information features of the target pedestrian,and the encoder in the generator network uses transformer to model the features of social interaction information and trajectory information of pedestrians.Experimental results on ETH and UCY datasets show that,compared with social GAN model,our method improves the accuracy of average displacement error by 25.61%and the accuracy of average final displacement error by 38.44%in multiple scenarios.