摘要
对最大匹配法的缺陷、设计的中文分词算法的特点作了简单介绍,详细说明了一种快速高效的中文分词算法的词库建立方法和算法的实现过程,对分词中遇到的问题提出了相应的解决办法,实验证明,该算法具有较高的分词效率。
Shortcomings of the Maximum Matching Method and characteristics of the Chinese Segmentation Algorithm are briefly introduced. The paper explains in detail the method of establishing a high - speed and efficient Chinese Segmentation Algorithm and its implementation, and puts forward the corresponding answer for the problem existed in Chinese word segmentation. It is verified through experiment that this method can improve efficiency of the Chinese word segmentation.
关键词
自然语言处理
中文分词
快速高效的分词算法
natural language processing
Chinese word segmentation
a high- speed and efficient Chinese segmentation algorithm