基于粗糙集理论的数据清洗模型

Data Cleaning Model Based on Rough Set Theory

本文在基于粗糙集理论的基础上提出一个大数据系统的数据清洗模型 ,以利于信息不完备决策问题的实施。模型从给定的初始数据出发 ,在假定属性的重要性量度σ0 的前提下 ,经过一系列的计算 ,比较属性实际重要性量度σCD(x)与σ0 的大小 ,由此确定属性x的清洗 ,然后根据清洗后的数据的出相应的决策规则。

This paper presented a data cleaning model of massive data based on the rough set theory for executing decision system when information in hand is not perfectly. Form the given initial data with provided essentiality measure σ 0,a series of count is executed.Based on the camparing σ CD(x) and σ 0,a decision to accept or give up the x is made. A simple example is given.