基于特征融合的无标复句关系识别

Relation Recognition of Unmarked Complex Sentences Based on Feature Fusion

无标复句因缺少关联词的辅助,其关系识别为自然语言处理中的一项较为困难的任务。将词性特征融入到词向量中,训练得到含有外部特征的词向量表示,通过组合BERT模型与BiLSTM模型,将字向量、词向量、词性向量结合进行训练,并在特征融合层添加BiLSTM模型捕获的极性特征信息以及CNN模型捕获的依存句法特征信息。实验结果表明,该方法在汉语复句分类上取得了较好的效果,与基准模型相比在宏F1值与微F1值上均有提升,在顶层分类上取得了83.67%的微F1值,在第二层分类上取得了68.28%的微F1值。

Unlike marked complex sentences,which lack the assistance of relation words,the identification of unmarked complex sentences is a difficult task in natural language processing.Integrating part of speech features into word vectors,and the word vector representation containing external features is obtained by training.By combining the BERT model and the BiLSTM model,the word vector and the part-of-speech vector are combined for training,and the polar feature information captured by BiLSTM model and the dependency syntax feature information captured by CNN model are added to the feature fusion layer.Experimental results show that the methods of adding features and combining multiple deep learning models can achieve better results in classification of Chinese complex sentences.Compared with the benchmark model,the macro F1 value and micro F1 value are improved.The best classification effect achieves 83.67%micro F1 value in the top layer classification and 68.28%micro F1 value in the second layer classification.