跨模态检索研究综述

Survey on the cross-modal retrieval research

跨模态检索是对一种模态的查询词,返回与之相关的其他不同模态检索结果的新型检索方法,是跨媒体检索的新兴技术。通过分析跨模态检索的实际需求,给出了跨模态检索问题的定义,综述了目前主流跨模态检索方法的核心思想,列举了常用数据集与评价方法,最后分析了跨模态检索存在的问题以及未来研究趋势。

Cross-modal retrieval is a new search method that returns other related modal retrieval re- sults for a given modal query word, which is a new kind of technology in cross-media retrieval. By ana- lyzing the actual requirements of cross-modal retrieval, we define the problem of cross-modal retrieval, and summarize the main ideas of the current mainstream cross-modal retrieval methods. The commonly used data set and evaluation method are also listed. Finally, existing problems and future research trends are discussed.