基于ERNIE-BiGRU-Attention-CRF的电子病历命名实体识别方法

Named Entity Recognition Method of Electronic Medical Records Based on ERNIE-BiGRU-Attention-CRF

目的/意义改善中文电子病历命名实体识别模型的性能,更好地开展医疗信息的组织和挖掘。方法/过程构建ERNIE-BiGRU-Attention-CRF中文电子病历命名实体识别模型,首先采用ERNIE1.0预训练模型生成具有语义特征的词向量,然后利用BiGRU捕获全局语义特征与语法结构特征,通过Attention机制进一步增强语义特征的捕获,最后连接CRF解码层输出全局概率最大的标签序列。结果/结论在公开的医疗文本数据集CCKS2017开展对比实验、消融实验,利用生成的模型进行实例分析,取得较好的识别效果。

Purpose/Significance To improve the performance of named entity recognition(NER)model of Chinese electronic medical records(EMR)for better organization and mining of medical information.Method/Process The ERNIE-BiGRU-Attention-CRF NER model of Chinese EMR is constructed.Firstly,the ERNIE1.0 pre-training model is used to generate word vectors with semantic features,and then BiGRU is utilized to capture the global semantic features and grammatical structural features,which are fed into the Attention mechanism to further enhance the capture of the semantic features,and finally,the CRF decoding layer is connected to output the label sequences with the maximum global probability.Result/Conclusion Comparison experiments and ablation experiments are carried out on the publicly available medical text dataset CCKS2017,and examples analysis is conducted using the generated model.The model proposed in this paper achieves better recognition results.