DAPC:结合双注意力和指针覆盖的文本摘要模型

DAPC:Dual Attention and Pointer-Coverage Network Based Summarization Model

基于注意力机制的序列到序列模型在生成式摘要方法中得到广泛应用,并取得较好的表现。但现有模型方法生成的摘要普遍存在语义无关、句内重复和未登录词等问题。为了解决这些问题,在典型基于注意力机制的序列到序列模型基础上,提出了结合双注意力和指针覆盖机制的生成式文本摘要方法DAPC(Dual Attention and Pointer-Coverage based model)模型。组合局部注意力和卷积神经网络,提取输入文本的更高层次的语言特征;引入指针-生成网络来解决未登录词问题;使用覆盖机制解决模型生成摘要句内重复的问题。实验结果表明,模型在CNN/Daily Mail数据集中有较好的表现。

Attention-based encoder-decoder abstractive summarization methods have been widely used for auto text summarization.However,these methods suffer from three shortcomings:usually producing semantic irrelevance,repeated phrase sentences and Out-Of-Vocabulary(OOV)words.In this work,it proposes an abstractive summarization method,DAPC model that combines dual attention,pointer-generator network and coverage mechanism based on typical attentionbased encoder-decoder framework to solve these problems.First,it uses local attention and convolutional neural network to obtain the deep hidden n-gram language features.Then,based on the typical encoder-decoder with attention model,it adds a pointer-generator network that through the pointing mechanism to copy words from source text,and solves the OOV problem.Last,coverage mechanism is used to solve the problem of repetition.Experiments on non-anonymized CNN/Daily Mail prove that the model has high semantic relevance to the source text and owns the capacity to reduce repetition.