摘要
在很多真实应用中,数据以流的形式不断被收集得到.由于数据收集环境往往发生动态变化,流数据的分布也会随时间不断变化.传统的机器学习技术依赖于数据独立同分布假设,因而在这类分布变化的流数据学习问题上难以奏效.本文提出一种基于决策树模型重用的算法进行分布变化的流数据学习.该算法是一种在线集成学习方法:算法将维护一个模型库,并通过决策树模型重用机制更新模型库.其核心思想是希望从历史数据中挖掘与当前学习相关的知识,从而抵御分布变化造成的影响.通过在合成数据集和真实数据集上进行实验,我们验证了本文提出方法的有效性.
In many real-world applications,data are collected in the form of streams.As a result of the evolving nature of dynamic environments,the distribution of data streams generally changes over time.Such distribution changes hinder the application of conventional machine learning approaches because the fundamental assumption of independent and identical distribution does not hold in these scenarios.This paper proposes an algorithm based on the decision tree model reuse mechanism for learning from distribution-changing data streams.The proposed algorithm is essentially an online ensemble method that maintains a model pool and updates it by performing decision tree model reuse.The main idea is to exploit the useful knowledge in historical data to help resist the negative effects of distribution changes.We validate the effectiveness of the proposed approach through experiments on synthetic and real-world datasets.
作者
赵鹏
周志华
Peng ZHAO;Zhi-Hua ZHOU(National Key Laboratory for Novel Software Technology,Nanjing University,Nanjing 210023,China)
出处
《中国科学:信息科学》
CSCD
北大核心
2021年第1期1-12,共12页
Scientia Sinica(Informationis)
基金
国家自然科学基金(批准号:61921006)资助项目。
关键词
机器学习
分布变化
流数据
模型重用
集成学习
动态环境
machine learning
distribution change
data stream
model reuse
ensemble methods
dynamic environments