基于自步学习的无监督属性选择算法

Unsupervised feature selection algorithm based on self-paced learning

针对现有属性选择算法平等地对待每个样本而忽略样本之间的差异性,从而使学习模型无法避免噪声样本影响问题,提出一种融合自步学习理论的无监督属性选择(UFS-SPL)算法。首先自动选取一个重要的样本子集训练得到属性选择的鲁棒性初始模型,然后逐步自动引入次要样本提升模型的泛化能力,最终获得一个能避免噪声干扰而同时具有鲁棒性和泛化性的属性选择模型。在真实数据集上与凸半监督多标签属性选择(CSFS)、正则化自表达(RSR)和无监督属性选择的耦合字典学习方法(CDLFS)相比,UFS-SPL的聚类准确率、互信息和纯度平均提升12. 06%、10. 54%和10. 5%。实验结果表明,UFS-SPL能够有效降低数据集中无关信息的影响。

Concerning that the samples are treated equally and the difference of samples is ignored in the conventional feature selection algorithms,as well as the learning model cannot effectively avoid the influence from the noise samples,an Unsupervised Feature Selection algorithm based on Self-Paced Learning(UFS-SPL)was proposed.Firstly,a sample subset containing important samples for training was selected automatically to construct the initial feature selection model,then more important samples were added gradually into the former model to improve its generalization ability,until a robust and generalized feature selection model was constructed or all samples were selected.Compared with Convex Semi-supervised multi-label Feature Selection(CSFS),Regularized Self-Representation(RSR)and Coupled Dictionary Learning method for unsupervised Feature Selection(CDLFS),the clustering accuracy,normalized mutual information and purity of UFS-SPL were increased by 12.06%,10.54%and 10.5%,respectively.The experimental results show that UFS-SPL can effectively remove the effect of irrelevant information from original data sets.