基于统计分词的中文文本分类系统

Chinese Text Classification System Based On Statistical Word Segmentation

本文阐述了一个中文文本分类系统的设计和实现,对文本分类系统的系统结构、特征提取、训练算法、分类算法等进行了详细介绍,将基于统计的二元分词方法应用于中文文本分类,并提出了一种基于汉语中单字词及二字词统计特性的中文文本分类方法,实现了在事先没有词表的情况下,通过统计构造单字及二字词词表,从而对文本进行分词,然后再进行文本的分类。

In the article I described the designation and accomplishment of a Chinese text classifycation system,and introduced system construction? feature selection? training arithmetic and classification arithmetic,achieved the goal that comminute word on condition that having no vocabulary.