基于句法结构的神经网络复述识别模型

A Neural Paraphrase Identification Model Based on Syntactic Structure

为解决已有复述语义计算方法未考虑句法结构的问题,提出基于句法结构的神经网络复述识别模型,设计基于树结构的神经网络模型进行语义组合计算,使得语义表示从词语级扩展到短语级。进一步地,提出基于短语级语义表示的句法树对齐机制,利用跨句子注意力机制提取特征。最后,设计自注意力机制来增强语义表示,从而捕获全局上下文信息。在公开英语复述识别数据集Quora上进行评测,实验结果显示,复述识别性能得到改进,达到89.3%的精度,证明了提出的基于句法结构的语义组合计算方法以及基于短语级语义表示的跨句子注意力机制和自注意力机制在改进复述识别性能方面的有效性。

Paraphrase identification involves natural language semantic understanding.Most previous methods regarded sentences as sequential structures,and used sequential neural network for semantic composition.These methods do not consider the influence of syntactic structure on semantic computation.In this paper,we proposed a neural paraphrase identification model based on syntactic structure,and designed a tree-based neural network model for semantic composition,which extended the semantic representation from word level to phrase level.Furthermore,this paper proposed a syntactic tree alignment mechanism based on phrase-level semantic representation,and extracted features by using cross-sentence attention mechanism.Finally,a self-attention mechanism was used to enhance semantic representation,which could effectively model context information based on syntactic structure.Experiments on Quora paraphrase dataset show that the performance of paraphrase identification has been improved to 89.3%accuracy.The results further prove that the proposed semantic composition method based on syntactic structure,phrase-level cross sentence attention and self-attention are effective in improving paraphrase identification.