基于双向LSTM和GBDT的中医文本关系抽取模型

TCM text relationship extraction model based on bidirectional LSTM and GBDT

为解决采用softmax作为长短期记忆网络分类器导致实体关系识别模型泛化能力不足,不能较好适用中医实体关系抽取等问题,提出一种融合梯度提升树的双向长短期记忆网络的关系识别算法(BILSTM-GBDT)。先采用word2vec对中医文本进行向量化表示,再利用基于注意力机制的双向长短期记忆网络提取高阶特征,最后采用集成分类模型梯度提升树作为特征分类器,提高关系识别效果。在中医等多个关系语料库上的实验结果表明,该模型与传统SVM方法、GBDT方法及其深度学习方法相比,均有更高的精确率、召回率和F值。

In order to solve the problem that the use of softmax as a long-short-term memory network classifier leads to the lack of generalization ability of the entity relationship recognition model,it is not suitable for the extraction of TCM entity relationships. This paper proposed a bidirectional long short-term memory( BILSTM) relational identification algorithm( BILSTM-GBDT) that incorporates a gradient boosting decision tree( GBDT). Firstly,it trained the Chinese medicine text vector by word2 vec,then extracted the high-order features by the bidirectional long short-term memory network based on the attention mechanism. Finally,it used the integrated classification model gradient lifting tree as the feature classifier to improve the relationship recognition effect. Experimental results on multiple relational corpora such as Chinese medicine show that the model has higher accuracy,recall and F value than traditional SVM method,GBDT method and deep learning method.