多模态知识图谱在农业中的研究进展

Research Progress of Multimodal Knowledge Graph in Agriculture

多模态知识图谱在传统知识图谱基础上,构建多种模态的实体,以及多模态实体之间的语义关系,能够提供重要的文本、图像以及声音知识,在消除歧义、补充视觉知识等方面具有非常重要的作用。近年来,在农业信息化和智能化飞速发展的背景下,知识图谱技术得到了广泛关注。文章详细介绍了知识图谱和多模态的含义,从图谱构建层面详细叙述了多模态表示学习等技术方法。针对多模态知识图谱在农业领域中的应用,重点总结知识图谱在农业智能问答、病虫害识别、农产品推荐等在农业领域中的应用研究,并对农业多模态知识图谱构建面临的挑战以及多模态知识图谱在农业领域中的发展前景进行展望与分析。

Incorporating entities of multiple modalities and their semantic relationships on the basis of traditional knowledge graph,multimodal knowledge graph provides important information in the form of text,image and sound.It plays an important role in eliminating ambiguity and supplementing visual knowledge.In recent years,under the background of the rapid development of agricultural informatization and intelligence,knowledge graph technology has attracted extensive attention.In this article,the concepts of knowledge graph and multimodality are introduced in detail.Meanwhile,technical methods such as multimodal representation learning are elaborated from the perspective of graph construction.For the applications of multimodal knowledge graph in agriculture,we focus on the research of agricultural intelligent question answering system,plant diseases and pests’identification,agricultural product recommendation and so on.At the same time,the challenges in construction and development of agricultural multimodal knowledge graphs are prospected and analyzed.