结合数据增强的跨模态行人重识别轻量网络

Cross-Modal Re-Identification LightWeight Network Combined with Data Enhancement

现有的跨模态行人重识别方法中,轻量化网络的相关研究较少。考虑到硬件部署对轻量化网络的需求,提出新的跨模态行人重识别轻量网络。以Osnet为基础,进行特征提取器和特征嵌入器的拆分。同时使用数据增强操作,利用有限的数据集,最大程度提高了网络的鲁棒性。改进难样本三元组损失函数,在减少计算量的同时缩小模态间差异,提升网络识别准确率。提出的轻量化网络结构简单且效果显著,在SYSU-MM01数据集的全搜索模式下rank-1/mAP分别达到65.56%、61.36%,参数量仅为1.92×10^(6)。

Among the existing cross modal re-identification methods,the research on lightweight network is less.Consid-ering the requirement of hardware deployment for lightweight network,a new cross modal re-identification lightweight network is proposed.Based on Osnet,the feature extractor and feature embedder are split.At the same time,data enhance-ment operations are used to maximize the use of limited data sets to improve network robustness,and the hard triplet loss is improved to further reduce the computation and reduce the difference between modals,so as to improve the accuracy of network identification.The network is lightweight,simple in structure and remarkable in effect.In the all search mode of SYSU-MM01 dataset,the rank-1/mAP of the proposed method reaches 65.56%,61.36%respectively,and the number of parameters is only 1.92×10^(6).