基于Lucene的中文字典分词模块的设计与实现

Design and Implementation of Chinese Words Dictionary Segmentation Module Based on Lucene

在分析Lucene语言分析器结构的基础上,采用基于中文字典的正向最大匹配分词算法,设计实现能够在基于Lucene的搜索引擎中处理中文信息的中文分词模块。

This paper introduces the construction of language analyzer in Lucene, designs and implements Chinese words segmentation module which uses forwards maximum match algorithm （FMM）. This module can disposes Chinese information well and efficiently in the search engine based on Lucene.