农业搜索引擎中文分词工具对比

Compare about Chinese Word Segmentation Tools to Agricultural Search Engine

中文分词是中文语言处理技术中最关键的部分,被作为其中最重要的预处理手段广泛应用.本文主要分析和比较了ASPSeek、ICTCLAS、Paoding、MMseg、IK与JE六种分词工具对农业搜索引擎的影响.结果表明:在农业搜索引擎的应用效果中,分词准确性最优的是ICTCLAS分词工具,而F1测度最高的是JE分词工具.

Chinese word segmentation technology is the most critical part of Chinese word processing technology, and it is widely used as one of the most important part in pre-processing methods. This paper mainly analyses and compares the influence of ASPSeek, ICTCLAS, Paoding, MMseg, IK and JE six segmentation tools on agricultural search engine.The results showed that ICTCLAS word segmentation has the most optimization in accuracy, while JE word segmentation has the highest measure of F1 in the application effect of agricultural search engine.