基于改进图节点的图神经网络多跳阅读理解研究

Research on Multi-Hop Reading Comprehension Based on Graph Neural Network with Improved Graph Nodes

多跳阅读理解需要基于问题并在多个支撑文档中寻找相关信息进行跳跃式推理来回答问题。针对当前多跳阅读理解模型中所存在的实体图内缺乏关键问题信息以及信息冗余问题,提出一种基于改进图节点的图神经网络多跳阅读理解模型。采用基于指代词的实体提取方法提取实体,将提取到的实体基于问题关联实体构建实体图。对实体图中的节点进行编码预处理,通过门机制的图卷积网络模拟得到推理信息,计算推理信息与问题信息的双向注意力并进行结果预测。在WikiHop数据集上的实验结果表明,该模型在测试集上取得了73.1%的预测准确率,相比基于图神经网络、循环神经网络和注意力机制的多跳阅读理解模型准确率更高、泛化性能更强。

Multi-hop reading comprehension requires searching for question-associated information in supporting documents to perform leaping reasoning to answer the question.The entity graphs of existing multi-hop reading comprehension models lack key information relevant to the question,but contain redundant information.To address this problem,we propose a multi-hop reading comprehension model based on a graph neural network with improved graph nodes.We employ a demonstrative pronoun-based method to extract entities,and use the extracted entities to build an entity graph based on the question-associated entities.After the nodes in the entity graph are preprocessed by encoding,we use the gated Graph Convolutional Network(GCN)to obtain the inference information through simulation.The bidirectional attention between reasoning and question information is calculated,and on this basis the answer is predicted.The experimental results on the WikiHop dataset show that the model achieves a prediction accuracy of 73.1%on the test set.Compared with the multi-hop reading comprehension model based on GCN,Recurrent Neural Network(RNN)and attention mechanism,the proposed model displays higher accuracy and stronger generalization performance.