外观动作自适应目标跟踪方法

Appearance and action adaptive target tracking method

为降低目标运动时产生的外观形变对目标跟踪的影响,在DaSiamese-RPN基础上进行改进,提出了一种外观动作自适应的目标跟踪方法。在孪生网络的子网络中引入外观动作自适应更新模块,融合目标的时空信息和动作特征;利用2种欧氏距离分别度量真实图和预测图之间的全局和局部差异,并对二者加权融合构建损失函数,加强预测目标特征图与真实目标特征图之间全局和局部信息的关联性。在VOT2016、VOT2018、VOT2019和OTB100数据集上进行测试,实验结果表明:在VOT2016和VOT2018数据集上,预测平均重叠率分别提高4.5%和6.1%;在VOT2019数据集上,准确度提高0.4%,预测平均重叠率降低1%;在OTB100数据集上,跟踪成功率提高0.3%,精确度提高0.2%。

On the basis of DaSiamese-RPN,a target tracking approach of appearance and action adaptation is proposed to limit the effect of appearance deformation on target tracking when the target is moving.First of all,the appearance and action adaptive module is introduced in the subnet of the Siamese network,which integrates the object’s spatial information and action feature.Secondly,the global and local divergence between the actual and predicted feature maps are measured by using two Euclidean distances,and the loss function is constructed by weighting the fusion of the two,so as to strengthen the correlation between the global and local information.Finally,tests were conducted on the VOT2016,VOT2018,VOT2019,and OTB100 datasets.The experimental results showed that the expected average overlap was improved by 4.5%and 6.1%in the VOT2016 and VOT2018 datasets respectively.On the VOT2019 dataset,accuracy increased by 0.4%and expected average overlap decreased by 1%;The tracking success rate was improved by 0.3%and accuracy increased by 0.2%when evaluated on the OTB100 dataset.