基于深度学习的威胁情报领域命名实体识别

Named Entity Recognition in Threat Intelligence Domain Based on Deep Learning

为了从来源不同的威胁情报中提取关键信息,方便政府监管部门开展安全风险评估,针对威胁情报文本中英文混杂严重以及专业词汇生僻导致识别困难的问题,在BiGRU-CRF模型基础上,提出了一种融合边界特征以及迭代膨胀卷积神经网络(IDCNN)的威胁情报命名实体识别方法.该方法根据人工构造的规则词典将边界清晰的实体例如英文单词进行转化以减少模型在处理较长文本时容易造成的信息损失,通过IDCNN和双向门控循环单元(BiGRU)进一步提取了文本的局部和全局特征.通过在威胁情报语料库上进行实验,结果表明所提的方法模型在相关评价指标上均优于其他模型,F值达到87.4%.

In order to extract key information of threat intelligence from different sources and facilitate the government regulatory authorities to carry out security risk assessment,to reduce the difficulty identification caused by the serious mixing of Chinese and English threat intelligence texts and the lack of professional vocabulary,based on BiGRU-CRF model,a threat intelligence named entity recognition(NER)method integrating boundary features and iterated dilated convolution neural network(IDCNN)is proposed.Firstly,entities with clear boundaries,such as English words,are transformed according to the artificially constructed rule dictionary to reduce the loss of information easily caused by the model when processing long texts.The local feature information and the context global feature information are obtained through IDCNN and bidirectional gated recurrent unit(BiGRU),respectively.The results of experiments on threat intelligence corpus show that the proposed model is better than other models in relevant evaluation indexes,and the F-score reaches 87.4%.