基于融合条目词嵌入和注意力机制的自动ICD编码

Automated ICD Coding Based on Word Embedding with Entry Embedding and Attention Mechanism

构建一种基于融合条目词嵌入和注意力机制的深度学习模型,可以充分利用电子病案中的多种非结构化文本数据,对病案首页的主要诊断进行自动ICD编码。该模型首先对含有病案条目的文本进行融合条目的词嵌入,并通过关键词注意力来丰富词级别的类别表示;然后利用词语注意力来突出重点词语的作用,增强文本表示;最后通过全连接神经网络分类器进行分类,输出ICD编码。通过在中文电子病案数据集上的消融实验,验证了融合条目词嵌入、关键词注意力和词语注意力的有效性;与多个基准模型相比,所建模型在对81种疾病的分类中取得最好的分类效果,可以有效地提高自动ICD编码的质量。

The authors propose a neural model based on word embedding with entry embedding and attention mechanism,which can make full use of the unstructured text in the electronic medical record to achieve automated ICD coding for the main diagnosis of the medical record home page.This method first embeds the words which contain the medical record entries into word embeddings,and enriches word-level representation based on keyword attention.Then,the word attention is used to highlight the role of key words and enhance the text representation.Finally,ICD codes are output by a fully connected neural network classifier.Ablation study on a Chinese electronic medical record data set shows that word embedding with entry embedding,keyword attention and word attention is effective.The proposed model gets the best results for 81 diseases classification compared with baselines and can effectively improve the quality of automated ICD coding.