基于Lucene的中文分词方法设计与实现

Design and implementation of Chinese words segementation based on Lucene

本文设计实现了一个中文分词模块,其主要研究目的在于寻找更为有效的中文词汇处理方法,提高全文检索系统的中文处理能力.整个模块基于当前最流行的搜索引擎架构Lucene,实现了带有歧义消除功能的正向最大匹配算法.在系统评测方面,比较了该方法与现有方法的区别,对于如何构建一个高效的中文检索系统,提出了一种实现.

This paper design and implement a Chinese words segmentation module, which mainly for dealing with Chinese words to improve the ability of full text search system. The whole module based on the most popular architecture Lucene, and implement the Maximum Matching Algorithm with the ability of eliminate different meanings. The authors also compare our method with methods in existence, and bring forward a implementation about how to construct a high efficiency Chinese searching system.