摘要
为解决人脸跟踪算法光照敏感度高、复杂背景跟踪鲁棒性低等问题,本文基于SiamFC网络提出多模态余弦相似孪生网络人脸跟踪算法。首先,结合可见光图片与红外光图片信息互补的优势,设计多模态输入,借鉴PeleeNet网络、空洞卷积、可分离卷积思想设计轻量化特征提取模块进行特征提取。其次,使用余弦相似操作代替互相关操作,增大相似背景非相似域的距离,提升跟踪定位的准确度。最后,在公共数据集ChokePoin、RGBT234和自制数据集上进行该算法的性能评估。实验结果表明,该算法在跟踪效果上整体性能较高、跟踪速度流畅,推理速度为115.7 fps,能很好地应对遮挡、光线干扰、运动模糊等因素影响,具有较强的实时性和鲁棒性。
In order to solve the problems of high illumination sensitivity and low robustness of complex background tracking,a multi-modal cosine similar siamese network face tracking algorithm is proposed based on SiamFC network.Firstly,combined with the complementary advantages of visible spectrum and infrared spectrum information,multi-modal input was designed,and a lightweight feature extraction module was designed for feature extraction based on the ideas of PeleeNet network,Dilated Convolution and Depthwise Separable Convolution.Secondly,cosine similarity operation was used instead of cross-correlation operation to increase the distance between similar background and non similar domain and improve the accuracy of tracking and positioning.Finally,the performance of the algorithm was evaluated on the public dataset ChokePoin,RGBT234 and self-made databset.The experimental results show that in terms of tracking effect,the overall performance is high,the tracking speed is smooth,and the reasoning speed is 115.7 fps.It can well deal with the influence of occlusion,light interference,motion blur and other factors,and has strong real-time and robustness.
作者
吴凤娇
刘宽
候红涛
孙收余
赵凯
罗子江
Wu Fengjiao;Liu Kuan;Hou Hongtao;Sun Shouyu;Zhao Kai;Luo Zijiang(Guizhou University of Finance and Economics,School of Information,Guiyang 550025;Interjoy,Beijing 101300)
出处
《现代计算机》
2022年第6期32-37,47,共7页
Modern Computer
基金
贵州省领域文献的科学知识图谱构建研究(黔教合YJSCXJH[2020]120)
贵州省科技计划项目(黔科合基础[2020]1Y021)。
关键词
人脸跟踪
孪生网络
余弦相似
多模态人脸跟踪
face tracking
siamese network
cosine similarity
multi-modal face tracking