基于双重属性信息的跨模态行人重识别算法

A cross-modal pedestrian Re-ID algorithm based on dual attribute information

通过对跨模态检索问题的研究,属性信息的使用可以增强所提取特征的语义表达性,但现有基于自然语言的跨模态行人重识别算法对行人图片和文本的属性信息利用不够充分。基于双重属性信息的跨模态行人重识别算法充分考虑了行人图片和文本描述的属性信息,构建了基于文本属性和图片属性的双重属性空间,并通过构建基于隐空间和属性空间的跨模态行人重识别端到端网络,提高了所提取图文特征的可区分性和语义表达性。跨模态行人重识别数据集CUHK-PEDES上的实验评估表明,所提算法的检索准确率Top-1达到了56.42%,与CMAAM算法的Top-1(56.68%)具有可比性,Top-5、Top-10相比CMAAM算法分别提升了0.45%、0.29%。针对待检索图片库中可能存在身份标签的应用场景,利用行人的类别信息提取属性特征,可以较大幅度提高跨模态行人图片的检索准确率,Top-1达到64.88%。消融实验证明了所提算法使用的文本属性和图片属性的重要性及基于双重属性空间的有效性。

Through the investigation of cross-modal retrieval,the use of attribute information can enhance the semantic representation of extracted features.The attributes of the pedestrian image and text are not used adequately in the existing cross-modal pedestrian Re-ID algorithms based on natural language.To tackle the above issues,a novel cross-modal pedestrian Re-ID algorithm based on dual attribute information is proposed.Specifically,the attribute information of the pedestrian image and the attribute information of pedestrian text descriptions are fully and simultaneously explored,and the dual attribute space is also built to improve the distinguishability and semantic expression of extracted image and text features.Extensive experimental results on a public cross-modal pedestrian Re-ID dataset CUHK-PEDES demonstrate that the proposed algorithm is comparable with state-of-the-art algorithm CMAAM(Top-156.68%),the retrieval accuracy Top-1 of the proposed algorithm reaches 56.42%,and Top-5 and Top-10 are improved by 0.45%and 0.29%respectively.Besides,the retrieval accuracy of cross-modal pedestrian images can be significantly improved if the class information is provided in the gallery image pool and is used to extract attribute features,and Top-1 can reach 64.88%.The ablation study also proves the importance of the text attribute and image attribute used by the proposed algorithm and the effectiveness of the dual attribute space.