知识发现过程中的数据预处理技术研究

Research on Data Preprocessing Technology in Knowledge Discovery

数据预处理技术在知识发现过程中扮演着至关重要的角色,它既能提升源数据的准确性和规范性,又能对源数据进行优化改良,为后续的数据挖掘内核算法节省处理时间、提高工作效率。本文从常见的问题数据类型入手,结合实例阐述了包括数据清洗、数据集成、数据变换、数据规约等步骤在内的数据预处理基本工作内容和重要意义,重点对当前常用的数据预处理方法原理和适用范围进行了归纳和总结,为数据预处理技术的进一步改进研究提供参考。

Data preprocessing technology plays an important role in the process of knowledge discovery,which can not only improve the accuracy and standardization of the source data,but also optimize the source data and save processing time for the subsequent data mining kernel algorithm.Based on the common types of problematic data and examples,this paper expounded the basic work contents and significance of the data preprocessing,including data cleaning,data integration,data transformation and data reduction.Furthermore,this paper mainly summarized the principles and applicable scope of the commonly used data preprocessing methods,which could provide a reference for the further improvement of data preprocessing technology.