一种基于级联架构与多模型融合的知识型对话系统

A Cascading-Architecture and Multi-Model Fusion Based Knowledge-Grounded Dialogue System

知识对话任务旨在借助外部知识生成富信息的回复,主要包括用于知识检索的Query生成和融合知识的对话生成两方面。如何有效地生成知识检索Query以及高效地利用所检索到的知识生成对话仍是一个挑战。为了解决以上的问题,该文提出了一种基于级联式架构和多模型融合的知识型对话系统。针对知识检索Query生成任务,为了高精确率地检索知识,提出级联式解耦策略,即将知识检索Query生成任务划分为知识检索判别任务和检索Query生成任务。针对融合知识的对话生成任务,为了提高对话的一致性和多样性,首先进行了对话任务预训练,然后引入了多种对话训练策略进行训练,得到了多个高质量对话生成模型。基于不同对话模型产生的回复,提出了一种基于互投票的重排序策略。最终,该文所介绍的系统在“2022语言与智能技术竞赛:知识对话任务”中取得了自动评估第一名、人工评估第三名的成绩。

Knowledge-grounded dialogue is a task of generating an informative response based on external knowledge,mainly including query generation for knowledge retrieval and knowledge-grounded dialogue generation.This paper presents a cascading-architecture and multi-model fusion based knowledge-grounded dialogue system.For query generation task,this paper proposes a cascade decoupling strategy,that is,knowledge retrieval query generation task is divided into a knowledge retrieval discrimination task and a retrieval query generation task.In order to improve the consistency and diversity of dialogue,this paper introduces a variety of dialogue training strategies after dialogue pre-training to establish several competitive dialogue models with high qualities.For the responses generated by different dialogue models,this paper proposes a re-ranking strategy based on mutual voting.The system proposed in this paper ranked the 1st in the automatic evaluation and 3rd in the human evaluation in the"2022 language and intelligent technology competition:knowledge dialogue track".