一种可用于分类型属性数据的多变量决策树算法

An Applicable Multivariate Decision Tree Algorithm for Categorical Attribute Data

针对绝大部分多变量决策树只能联合数值型属性,而不能直接为带有分类型属性数据集进行分类的问题,提出一种可联合多种类型属性的多变量决策树算法(CMDT).该算法通过统计各个分类型属性的属性值在各个类别或各个簇中的频率分布,来定义样本集合在分类型属性上的中心,以及样本到中心的距离.然后,使用加权k-means算法划分决策树中的非终端结点.使用这种结点划分方法构建的决策树可用于数值型数据、分类型数据以及混合型数据.实验结果表明,该算法建立的分类模型在各种类型的数据集上均获得比经典决策树算法更好的泛化正确率和更简洁的树结构.

Most multivariate decision trees are applicable for only the numerical data.To solve the classification problem on categorical attribute data,an applicable multivariate decision tree(CMDT)algorithm is proposed.The center of the sample set on the categorical attributes,and the distance between the samples and the centers are defined with statistics for frequency distribution of categorical attribute values in each category or each cluster.Weighted k-means algorithm is utilized to split the nodes in the decision tree.The proposed multivariate decision tree is applicable for numerical data,categorical data,and mixed data.Experiment results show that the classification model based on the proposed algorithm can get more concise tree construction and higher generalization accuracy than that based on the classic decision tree algorithms with different kinds of data.