摘要
集成学习是非线性系统的主流建模方法之一。但当常规的集成TSK模糊模型直接用于不平衡数据集时,其学习性能容易受到数据不平衡性的影响,因而常常会导致泛化能力差。为解决这一问题,基于TSK模糊模型提出了一种对不平衡数据处理的分类集成模型。基本思想是:首先利用SMOTE过采样方法对不平衡样本集做预处理,使得类别分布相对平衡,再引入AdaBoost方法对集成TSK模糊模型进行学习,集成时根据权值大小对样本进行随机采样,并通过多次训练对权值进行迭代更新,最后将生成的各个模型结果根据特定的加权方法结合,产生最终输出,使各模型得到充分的训练,进而提升整个集成TSK模糊模型的泛化能力。由此,提出了对应的不平衡数据的集成TSK模糊模型,并使用模型在多个数据集上进行实验,采用均方误差和精度对模型进行评估均有较好的效果,然后改变模型数量和规则数量等参数探究它们对模型性能的影响,并使用图像表示它们的变化情况,实验结果证明了所提出的集成学习算法的有效性。
Ensemble learning is one of the most popular methods for nonlinear systems.However,when the traditional ensemble models of TSK fuzzy classifiers are directly applied to imbalanced data,their learning performances will be deteriorated with poor generalization ability.In order to tackle with this issue,a TSK-fuzzy-classifier-based ensemble method for imbalanced data is proposed in this paper.The basic idea is to first pre-process the imbalanced dataset by the SMOTE method to achieve the corresponding balanced dataset,and then take the AdaBoost strategy to ensemble several TSK fuzzy classifiers so that satisfactory performance is got.During the training of the proposed ensemble model,randomly sampled data will be dynamically and iteratively weighted to feed as the inputs into each TSK fuzzy model,and then each trained TSK fuzzy classifier is weighted to form the final outputs of the ensemble model,so that each model can be fully trained,and then the generalization ability of the whole ensemble TSK fuzzy model is improved.Therefore,an ensemble TSK fuzzy model corresponding to imbalanced data is proposed,and the model is used to experiment on multiple datasets.The mean square error(MSE)and accuracy are used to evaluate the model,then the number of models and rules are changed to explore their effect on model performance,and images are used to show their changes.The experimental results demonstrate the effectiveness of the proposed ensemble model.
作者
张壮
王士同
ZHANG Zhuang;WANG Shitong(School of Artificial Intelligence and Computer Science,Jiangnan University,Wuxi,Jiangsu 214122,China)
出处
《计算机科学与探索》
CSCD
北大核心
2022年第6期1374-1382,共9页
Journal of Frontiers of Computer Science and Technology
基金
江苏省自然科学基金(BK20191331)。