最小冗余最大分离准则特征选择方法

Method based on minimum redundancy and maximum separability for feature selection

特征选择是处理高维数据的一项有效技术。针对传统方法的不足,结合F-score与互信息,提出了一种最小冗余最大分离的特征选择评价准则,该准则使所选择的特征具有更好的分类和预测能力;采用二进制布谷鸟搜索算法和二次规划两种搜索策略来搜索最优特征子集,并对两种搜索策略的准确性和计算量进行分析比较;最后,利用UCI数据集进行实验测试,实验结果说明了所提理论的有效性。

Feature selection is an effective technique for analyzing high-dimensional data.To improve the performance oftraditional feature selection methods,a novel criterion function named minimum redundancy and maximum separabilityfor feature selection is proposed by combining the F-score and mutual information.Based on the new criterion function,the features select own a better ability for classification and prediction.Binary cuckoo search algorithm and quadratic programmingalgorithm are adopted to search the optimal subset of features,the accuracy and the amount of computations forfeature selection of these two search strategies are analyzed.Finally,the effectiveness of the proposed principle is verifiedby the experimental results though conducting tests on UCI datasets.