基于时空交并比约束的目标跟踪对抗防御方法

Spatio-Temporal IoU Constraints Based Adversarial Defense Method for Object Tracking

随着深度学习在视觉跟踪领域的广泛应用,对抗攻击逐渐成为影响方法性能的关键因素之一,然而针对对抗攻击的防御方法研究还处于初始阶段.因此,文中提出基于时空交并比约束的目标跟踪对抗防御方法.首先,在对抗样本上随机添加高斯噪声约束.然后,根据噪声等高线的切线方向,选择噪声等级相同且时空交并比分数最高的切线约束.通过其法线约束使防御目标向原始图像的方向更新,并将法线约束和切线约束进行正交组合优化.最后,经过不断迭代,选择具有最高时空交并比分数且噪声等级最低的组合向量作为最佳约束,添至对抗样本图像中,同时传递给下一帧图像,从而实现时序防御.在VOT2018、OTB100、GOT-10k、LaSOT跟踪数据集上的实验验证文中方法的有效性.

With the wide application of deep learning in the field of visual tracking,adversarial attack is one of key factors affecting the model performance.However,the research on defense methods for adversarial attack is still in the initial stage.Therefore,a spatio-temporal intersection over union(IoU)constraints based adversarial defense method for object tracking is proposed.In this method,Gaussian noise constraints are firstly added to the adversarial examples.Then,according to the tangent direction of the noise contour,the tangential constraint with the same noise level and the highest spatio-temporal IoU score is selected.The normal constraint is utilized to update the defense target towards the direction of the original image,and the normal and tangential constraints are orthogonally combined and optimized.Finally,the combined vector with the highest spatio-temporal IoU score and the lowest noise level is selected as the best constraint,and it is added to the adversarial example image and transferred to the next frame image,thereby realizing temporal defense.Experiments on VOT2018,OTB100,GOT-10k and LaSOT tracking datasets verify the validity of the proposed method.