期刊文献+

联合哈希特征和分类器学习的跨模态检索算法 被引量:3

Joint Hashing Feature and Classifier Learning for Cross-Modal Retrieval
下载PDF
导出
摘要 为了解决跨模态检索算法检索准确率较低、训练时间较长等问题,文中提出联合哈希特征和分类器学习的跨模态检索算法(HFCL).采用统一的哈希码描述语义相同的不同模态数据.在训练阶段,利用标签信息学习具有鉴别性的哈希码.第二阶段基于生成的鉴别性哈希码,采用核逻辑回归学习各模态的哈希函数.在测试阶段,给定任意一个模态查询样本,利用学习的哈希函数生成哈希特征,从数据库中检索与之语义相关的另一模态数据.在3个公开数据集上的实验验证HFCL的有效性. To solve the problem of low retrieval accuracy and long training time in cross-modal retrieval algorithms,a cross-modal retrieval algorithm joining hashing feature and classifier learning(HFCL)is proposed.Uniform hash codes are utilized to describe different modal data with the same semantics.In the training stage,label information is utilized to study discriminative hash codes.And the kernel logistic regression is adopted to learn the hash function of each modal.In the testing stage,for any sample,the hash feature is generated by learned hash function,and another modal datum related to its semantics is retrieved from the database.Experiments on three public datasets verify the effectiveness of HFCL.
作者 刘昊鑫 吴小俊 庾骏 LIU Haoxin;WU Xiaojun;YU Jun(Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Intelligence,Jiangnan University,Wuxi 214122)
出处 《模式识别与人工智能》 EI CSCD 北大核心 2020年第2期160-165,共6页 Pattern Recognition and Artificial Intelligence
基金 国家自然科学基金项目(No.61672265,U1836218) 中国教育部111项目(No.B12018)资助。
关键词 哈希学习 分类器学习 矩阵分解 跨模态检索 Hashing Learning Classifier Learning Matrix Factorization Cross-Modal Retrieval
  • 相关文献

参考文献2

二级参考文献53

  • 1McGurk H, MacDonald J. Hearing Lips and Seeing Voices. Nature, 1976, 264(5588) : 746 -748
  • 2Calvert A. Cross-Modal Processing in the Human Brain: Insights from Functional Neuron Imaging Studies. Cerebral Cortex, 2001, 11 (12) : 1120 -1123
  • 3Zhang Hong, Weng Jianguang. Measuring Multi-Modality Similarities via Subspace Learning for Cross-Media Retrieval// Proc of the 7th Pacific-Rim Conference on Multimedia. Hangzhou, China, 2006 : 979 - 988
  • 4Wu Fei, Zhang Hong, Zhuang Yueting. Learning Semantic Correlations for Cross-Media Retrieval // Proc of the 13th IEEE International Conference on Image Processing. Atlanta, USA, 2006: 1465 - 1468
  • 5Li Mingkun, Li Dongge, Dimitrova N, et al. Audio-Visual Talking Face Detection// Proc of the International Conference on Multimedia and Expo. Baltimore, USA, 2003 : 473 -476
  • 6Zhuang Yueting, Yang Yi, Wu Fei. Mining Semantic Correlation of Heterogeneous Multimedia Data for Cross-Media Retrieval IEEE Trans on Multimedia, 2008, 10 ( 2 ) : 221 - 229
  • 7Yang Yi, Zhuang Yueting, Wu Fei, et al. Harmonizing Hierarchical Manifolds for Multimedia Document Semantics Understanding and Cross-Media Retrieval. IEEE Trans on Muhimedia, 2008, 10(3) : 437 - 446
  • 8Naphade M R, Chang E, Smith J R. ICME 2003 Tutorial: Multimedia Semantics and Machine Learning [ EB/OL]. [ 2003 -07 - 06]. https: //www. securecms.com/icme2003/tutorialInfo.asp? Tutorial ID = 1
  • 9Guo Guodong, Li S Z. Content-Based Audio Classification and Retrieval by Support Vector Machines. IEEE Trans on Neural Networks, 2003, 14(1) : 209 -215
  • 10Zhao Rong, Grosky W I. Negotiating the Semantic Gap: From Feature Maps to Semantic Landscapes. Pattern Recognition, 2002, 35 (3) : 593 -600

共引文献4

同被引文献25

引证文献3

二级引证文献2

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部