摘要
为了总结前人工作,给相关研究者提供思路,首先讨论了当前多模态知识图谱的基本概念,然后从图数据库和知识图谱这两个角度介绍了多模态知识图谱的构建工作,并总结了两种主要方法的思路。还分析了多模态知识图谱的构建和应用中的关键技术和相关工作,如多模态信息提取、表示学习和实体链接。此外,列举了多模态知识图谱在四种场景中的应用,包括推荐系统、跨模态检索、人机交互和跨模态数据管理。最后,从四个方面展望了多模态知识图谱的发展前景。
In order to summarize previous works and provide ideas for related researchers.This paper first discussed the current basic concepts of the multi-modal knowledge graph.Then it introduced the construction of multi-modal knowledge graphs from two perspectives of graph database and knowledge graph,and summarized the ideas of two main methods.It also analyzed the key technologies and related works in the construction and application,such as multi-modal information extraction,representation learning,entity linking.In addition,it enumerated the application of multi-modal knowledge graphs in four scena-rios,including recommender systems,cross-modal retrieval,human-computer interaction and cross-modal data management.Finally,it looked forward to the development prospects of multi-modal knowledge graphs from four aspects.
作者
陈烨
周刚
卢记仓
Chen Ye;Zhou Gang;Lu Jicang(Academy of Data&Target Engineering,Information Engineering University,Zhengzhou 450001,China)
出处
《计算机应用研究》
CSCD
北大核心
2021年第12期3535-3543,共9页
Application Research of Computers
关键词
多模态
知识图谱
构建
应用
multi-modal
knowledge graph
construction
application
