摘要
采用融合自注意力机制的双向长短期记忆模型(SelfAtt-BILSTM)和条件随机场模型(CRF),构建一种Self-Att-BILSTM-CRF模型,对政策文本进行语义角色标注,以提取政策主要内容。采用某高校政策文件为实验数据集,利用BILSTM模型自动学习序列化语句上下文特征,融合自注意力机制增加重要特征元素的权重,通过CRF层利用特征进行序列标注,提取语义角色,以实现政策文件的主要内容挖掘。经过对比验证,该模型能够有效地提取政策文本内容,在标注数据集上F1值达到78.99%。实验结果同时表明,自注意力机制能够有效提高神经网络模型的语义角色标注效果。
A SelfAtt-BILSTM-CRF model is constructed by combining the Self Attention Mechanism with Bidirectional Long Short-Term Memory(SelfAtt-BILSTM)and Conditional Random Field(CRF).The semantic role of policy text is annotated to extract the main content of policy.This paper takes a college policy file as the experimental data set,uses the BILSTM model to automatically learn the context features of serialized statements,integrates the self attention mechanism to increase the weight of important feature elements,and finally uses the features to sequence annotation through CRF layer to extract the semantic roles,so as to realize the main content mining of policy files.By contrast,the SelfAtt-BILSTM-CRF model can effectively extract the content of policy text,and the F1 value in the annotation data set reaches 78.99%.The experimental results also show that the Self Attention Mechanism can effectively improve the semantic role annotation effect of the neural network model.
作者
徐建国
刘泳慧
刘梦凡
XU Jianguo;LIU Yonghui;LIU Mengfan(College of Computer Science and Engineering,Shandong University of Science and Technology,Qingdao,Shandong 266590,China)
出处
《计算机工程与应用》
CSCD
北大核心
2021年第6期207-211,共5页
Computer Engineering and Applications
基金
2017年山东省高校人文社会科学研究计划(思想政治教育专题研究)(J17ZZ27)
青岛市哲学社会科学规划(QDSKL1601121)
山东科技大学2018年研究生科技创新项目(SDKDYC180339)。
关键词
双向长短期记忆网络
条件随机场
自注意力机制
语义角色标注
深度学习
bidirectional long short-term memory
conditional random field
self attention mechanism
semantic role labeling
deep learning