一种基于免疫遗传算法的网络新词识别方法

Approach of Internet New Word Identification Based on Immune Genetic Algorithm

随着互联网的发展,网络新词不断涌现,但是目前的分词方法很难及时、准确地对其做出识别。对此提出一种应用免疫遗传算法的网络新词识别方法。在分析网络新词特点的基础上,利用汉语词群现象和词位的概念提取出示范抗体,在遗传算法进行的过程中有针对性地注入该抗体。实验表明,该方法对于分词碎片中符合词群现象的新词有着极高的识别率,对于一般网络新词的识别率也基本令人满意。

The development of Internet leads the internet new word coming into being.These unknown words are difficult to identify timely and accurately by the current Word Segmentation Method,therefore internet new word identification method using Immune genetic algorithm was brought forward.This method is based on the analysis of characteristics of internet new word,using the phenomenon of Chinese words and word groups to extract exemplary antibody,and injecting the antibody targeted during the process of genetic algorithm.The experiment results show that the method not only has a higher recognition rates of the new words consistent with the phenomenon of word groups in word fragments but the result of identifying ordinary internet new word is adequate.