引入注意力机制的JDE多目标跟踪方法

JDE Multi-Object Tracking Method with Attention Mechanism

多目标跟踪是计算机视觉领域的一个重要研究内容。JDE(joint detection and embedding)多目标跟踪算法推理速度和精度较高,但是当目标重叠或尺度较小时,该算法的跟踪效果较差。针对以上问题,提出了Attention-JDE,该模型结合了注意力机制、多尺度融合等思想,利用特征金字塔(feature pyramid)和空间金字塔池化(spatial pyramid pooling)提升模型对于小尺度目标的检测和跟踪能力,结合空间域注意力机制和通道域注意力机制改进模型在目标发生重叠时的跟踪效果。此外,还引入了Mish激活函数有效地降低跟踪时的ID切换次数。在MOT16数据集进行验证,结果表明,与原JDE方法以及其他主流方法相比,Attention-JDE具有更高的跟踪精度(MOTA),同时速度能够达到19.5 FPS,实时性较高。

Multi-object tracking is an important research content in the field of computer vision.JDE(joint detection and embedding)multi-object tracking algorithm has high inference speed and accuracy,but when the object overlap or scale is small,the tracking performance of the algorithm is bad.To solve the above problems,this paper proposes AttentionJDE,which combines attention mechanism,multi-scale fusion and other ideas,uses feature pyramid and spatial pyramid pooling to improve the detection and tracking ability of the model for small-scale objects.The spatial attention mechanism and channel attention mechanism are combined to improve the tracking performance when the objects overlap.In addition,this paper also introduces the Mish activation function to effectively reduce the number of ID switching during tracking.Compared with the original JDE method and other SOTA methods,Attention-JDE has higher tracking accuracy(MOTA),inference speed can reach to 19.5 FPS which is high real-time performance.