几种典型特征选取方法在中文网页分类上的效果比较

A Comparative Study on Several Typical Feature Selection Methods for Chinese Web Page Categorization

针对中文网页,比较研究了CHI、IG、DF以及MI特征选取方法。主要的实验结果有:(1)CHI、IG和DF的性能明显优于MI;(2)CHI、IG和DF的性能大体相当,都能够过滤掉85%以上的特征项;(3)DF具有算法简单、质量高的优点,可以用来代替CHI和IG;(4)使用普通英文文本和中文网页评测特征选取方法的结果是一致的。

This paper reports a comparative study with CHI ,IG,DF and MI feature selection methods for Chinese Web pages.The main experimental results are:(1)CHI ,IG and DF significantly outperforms MI ;(2)CHI ,IG and DF perform similarly and all can filter out more than85%features;(3)DF is the simplest method with the lowest cost in computa-tion and can be used instead of CHI or IG;(4)The experimental results are similar using plain English text and Chi-nese Web pages to evaluate feature selection methods.