摘要
集成学习已成为一种广泛使用的软测量建模框架,但是建立高性能的集成学习软测量模型依然面临特征选择不当、基模型多样性不足、基模型估计性能不佳等诸多挑战.为此,提出一种基于堆栈自编码器多样性生成机制的选择性集成学习高斯过程回归(selective ensemble of stacked autoencoder based Gaussian process regression, SESAEGPR)软测量建模方法.该方法充分发挥深度学习在特征提取方面的优势,通过构建多样性的堆栈自编码器(stacked autoencoder, SAE)网络,建立基于隐特征的高斯过程回归(Gaussian process regression, GPR)基模型.基于模型性能提升率和进化多目标优化对SAEGPR基模型实施两次集成修剪,以降低集成模型复杂度、保持甚至进一步提升模型估计性能,最后,引入PLS Stacking集成策略实现基模型融合.所提出方法显著优于传统全局和全集成软测量建模方法,其有效性和优越性通过青霉素发酵过程和Tennessee Eastman化工过程得到验证.
Ensemble learning has become a widely used soft sensor modeling framework. However, the establishment of high-performance ensemble learning soft sensor models still encounters many challenges such as improper feature selection, insufficient diversity of base models, and poor base model estimation performance. Therefore, a selective ensemble of stacked autoencoder based Gaussian process regression(SESAEGPR) is proposed for soft sensor modeling.By fully utilizing the advantages of deep learning in feature extraction, the SESAEGPR method first builds a set of diverse stacked autoencoder(SAE) networks and then establishes a set of Gaussian process regression(GPR) models based on the already extracted latent features. Then, a two-stage ensemble pruning is performed. The first is achieved based on the model performance improvement, and the evolutionary multi-objective optimization approach is used for the second. Ensemble pruning enables the reduction of ensemble model complexity while maintaining or even further improving the ensemble estimation performance. Finally, a PLS Stacking ensemble mechanism is employed to achieve the combination of the selected base models. The proposed method performs significantly better than the traditional global and fully integrated soft sensing methods, and its effectiveness and superiority have been verified through the penicillin fermentation process and the Tennessee Eastman chemical process.
作者
金怀平
王建军
董守龙
钱斌
杨彪
陈祥光
JIN Huai-ping;WANG Jian-jun;DONG Shou-long;QIAN Bin;YANG Biao;CHEN Xiang-guang(Faculty of Information Engineering and Automation,Kunming University of Science and Technology,Kunming 650500,China;School of Chemistry and Chemical Engineering,Beijing Institute of Technology,Beijing 100081,China)
出处
《控制与决策》
EI
CSCD
北大核心
2023年第3期738-750,共13页
Control and Decision
基金
国家自然科学基金项目(62163019,61763020,61863020)
云南省应用基础研究计划项目(202101AT070096)。
关键词
软测量
深度学习
集成学习
堆栈自编码器
隐特征
多目标优化
高斯过程回归
soft sensor
deep learning
ensemble learning
stacked autoencoder
latent variables
multi-objective optimization
Gaussian process regression