期刊文献+
共找到2篇文章
< 1 >
每页显示 20 50 100
Targeted BERT Pre-training and Fine-Tuning Approach for Entity Relation Extraction
1
作者 Chao Li Zhao Qiu 《国际计算机前沿大会会议论文集》 2021年第2期116-125,共10页
Entity relation extraction(ERE)is an important task in the field of information extraction.With the wide application of pre-training language model(PLM)in natural language processing(NLP),using PLM has become a brand ... Entity relation extraction(ERE)is an important task in the field of information extraction.With the wide application of pre-training language model(PLM)in natural language processing(NLP),using PLM has become a brand new research direction of ERE.In this paper,BERT is used to extracting entityrelations,and a separated pipeline architecture is proposed.ERE was decomposed into entity-relation classification sub-task and entity-pair annotation sub-task.Both sub-tasks conduct the pre-training and fine-tuning independently.Combining dynamic and static masking,newVerb-MLM and Entity-MLM BERT pre-training tasks were put forward to enhance the correlation between BERT pre-training and TargetedNLPdownstream task-ERE.Inter-layer sharing attentionmechanismwas added to the model,sharing the attention parameters according to the similarity of the attention matrix.Contrast experiment on the SemEavl 2010 Task8 dataset demonstrates that the new MLM task and inter-layer sharing attention mechanism improve the performance of BERT on the entity relation extraction effectively. 展开更多
关键词 entity relation extraction BERT Verb-MLM entity-MLM Inter-layer sharing attention mechanism
原文传递
Annotation and Joint Extraction of Scientific Entities and Relationships in NSFC Project Texts
2
作者 Zhiyuan GE Xiaoxi QI +5 位作者 Fei WANG Tingli LIU Jun GUAN Xiaohong HUANG Yong SHAO Yingmin WU 《Journal of Systems Science and Information》 CSCD 2023年第4期466-487,共22页
Aiming at the lack of classification and good standard corpus in the task of joint entity and relationship extraction in the current Chinese academic field, this paper builds a dataset in management science that can b... Aiming at the lack of classification and good standard corpus in the task of joint entity and relationship extraction in the current Chinese academic field, this paper builds a dataset in management science that can be used for joint entity and relationship extraction, and establishes a deep learning model to extract entity and relationship information from scientific texts. With the definition of entity and relation classification, we build a Chinese scientific text corpus dataset based on the abstract texts of projects funded by the National Natural Science Foundation of China(NSFC) in 2018–2019. By combining the word2vec features with the clue word feature which is a kind of special style in scientific documents, we establish a joint entity relationship extraction model based on the Bi LSTM-CNN-CRF model for scientific information extraction. The dataset we constructed contains 13060 entities(not duplicated) and 9728 entity relation labels. In terms of entity prediction effect, the accuracy rate of the constructed model reaches 69.15%, the recall rate reaches 61.03%, and the F1 value reaches 64.83%. In terms of relationship prediction effect, the accuracy rate is higher than that of entity prediction, which reflects the effectiveness of the input mixed features and the integration of local features with CNN layer in the model. 展开更多
关键词 joint extraction of entities and relations deep learning Chinese scientific information extraction
原文传递
上一页 1 下一页 到第
使用帮助 返回顶部