基于YOLO和RRN的运动目标跟踪方法

Moving object tracking method based on YOLO and recurrent regression network

针对传统的计算机视觉目标跟踪算法无法适应复杂的跟踪变化,处理有遮挡情况鲁棒性差、跟踪精度低等问题,提出一种基于YOLO和RRN的运动目标跟踪算法,它是一种结构简单、运算快速、跟踪准确的深度循环回归网络模型。采用YOLO网络负责物体的外观特征学习,将YOLO的目标检测结果作为输入,与RRN结构中的LSTM网络进行连接,第一个LSTM负责学习物体的运动特征,第二个LSTM负责回归,采用离线的方式训练模型。在跟踪基准VOT 2016数据集上的测试结果表明,YOLO+RRN模型的跟踪精度为68%,跟踪速度可达77 fps,满足高级驾驶辅助系统对目标跟踪的实时性需求,模型对有遮挡情况下的目标跟踪适应性较强,为高级驾驶辅助系统在复杂环境下的目标跟踪性能提供有效保障。

To address the problem of traditional object tracking algorithms,such that it is unable to adapt to complex tracking changes and it shows low robustness and accuracy when tracking target is occluded,a moving object tracking algorithm based on you only look once (YOLO) and recurrent regression network (RRN) was presented,which is a simple,fast and accurate recurrent regression network model. The YOLO was used for moving object detection and appearance feature learning in the model,and the results generated by YOLO was used as input to the long short term memory (LSTM) networks of RRN. The first LSTM was responsible for learning the motion of the object,and the second LSTM was responsible for regression,then the model was trained offline. The tracking benchmark visual object tracking (VOT) 2016 was used as the dataset of moving object tracking experiment. The results show that the precision of YOLO+RRN model reaches 68%,and the speed of tracking is 77 fps,which can meet the real-time requirement for advanced driver assistance system (ADAS). The model also has strong robustness to object tracking with occlusion,which can provide effective guarantee for the tracking performance of ADAS in complex environment.