一种基于模糊C均值聚类的稀疏数据缺失值填充方法

A missing data imputation mettiod of sparse data based on fuzzy C-ceans clustering

缺失数据处理通常基于统计学的方法,在数据预处理阶段对缺失值进行填补,其效率和准确性并不高。因此,提出了一种基于模糊C均值(FCM)聚类的嵌入式填充方法(FCMSI)。此算法通过平均比率法(ARM)对稀疏数据进行初始化填充;采用局部距离策略对FCM进行改进,并对数据进行聚类;将缺失数据作为变量,在每次聚类迭代后的簇内采用协同过滤(CF)的思想对变量值进行替换,直到结果收敛。利用UCI标准数据集进行对比实验,并采用三种不同评价指标衡量,验证了FCMSI方法比传统填充方法性能显著提高。

The missing data are usually filled by statistical method in the data preprocessing stage.The efficiency and accuracy are not high enough for practical application.Therefore,an Fuzzy C-Means based space data imputation(FCMSI)is proposed based on Fuzzy C-means(FCM)clustering.The sparse data are initialized by the average ratio method(ARM).The FCM is improved by using the local distance strategy to cluster the data.The missing data are taken as variables and will be replaced based on the idea of collaborative filtering(CF)in each cluster after clustering iteration until the results converge.The UCI standard data set isused to carry out comparative experiments.Three different evaluation indexes are used to measure the performance of FCMSI method.The results prove that the performance of FCMSI method is significantly improved compared with the traditional filling method.