汉语分词技术综述

The Review of Chinese Automatic Word Segmentation Technology

首先介绍汉语自动分词技术及基于词索引的中文全文检索技术,接着分别从文献自动标引、文摘自动生成、文本自动分类、文本信息过滤、自然语言检索接口和智能检索等方面详细地阐述汉语自动分词技术在中文全文检索中的应用,并对目前汉语自动分词技术存在的局限性进行分析,提出发展思路,最后对汉语自动分词技术在中文全文检索中的应用前景进行预测。

Fristly,this paper introduces Chinese automatic technology and Chinese full-text retrieval technology based on word index. Secondly, it detailedly expounds the applications of Chinese automatic word segmentation technology in Chinese full-text retrieval from several aspects, such as document auto-index, summarization auto-generation, text auto-classification,text information filtration, natural language retrieval interface and intelligent retrieval etc., and also analyzes the limitation of Chinese automatic word segmentation technology at present, comes up with developing method. Finally, it forecasts application prospect of Chinese automatic word segmentation technology in Chinese full-text retrieval.