基于头实体注意力的实体关系联合抽取方法

Joint extraction method of entities and relations based on subject attention

实体关系抽取是构建大规模知识图谱及各种信息抽取任务的关键步骤。基于预训练语言模型,提出基于头实体注意力的实体关系联合抽取方法。该方法采用卷积神经网络(CNN)提取头实体关键信息,并采用注意力机制捕获头实体与尾实体之间的依赖关系,构建了基于头实体注意力的联合抽取模型(JSA)。在公共数据集纽约时报语料库(NYT)和采用远程监督方法构建的人工智能领域数据集上进行实验,所提模型的F1值相较于级联二元标记框架(CasRel)分别获得了1.8和8.9个百分点的提升。

Extracting entities and relations is crucial for building large-scale knowledge graph and different knowledge extraction tasks.Based on the pre-trained language model,an entity-oriented joint extraction method combining subject attention was proposed.In this method,the key information of the subject was extracted by using Convolutional Neural Network(CNN)and the dependency relationship between the subject and the object was captured by the attention mechanism.Followed by the above,a Joint extraction model based on Subject Attention(JSA)was built.In experiments on public dataset New York Times corpus(NYT)and the dataset of artificial intelligence built by distant supervision,the F1 score of the proposed model was improved by 1.8 and 8.9 percentage points respectively compared with Cascade binary tagging framework for Relational triple extraction(CasRel).