Stacking算法对凝给水系统故障诊断的适用性研究

针对船用凝给水系统设备之间耦合关系较强,对该系统的研究只是选取部分参数而并非像设备一样基本涵盖全部特征参数,且该系统在实际运行过程中可以通过自调节来掩盖某些已发生的故障从而无法准确形成运行参数和故障间的映射关系这一现状,以传统单一机器学习算法为基础,通过拓展建立针对Stacking算法的多分类器性能评价指标,准确寻找运行参数和故障之间的映射关系,解决了多分类器性能评价难题。并利用样本数据设计出比较Stacking算法和单一算法综合性能的试验方法,验证了Stacking模型在凝给水系统故障诊断任务中的适用性和优越性。

Fault Diagnosis of Motor in Frequency Domain Signal by Stacked De-noising Auto-encoder

With the rapid development of mechanical equipment,mechanical health monitoring field has entered the era of big data.Deep learning has made a great achievement in the processing of large data of image and speech due to the powerful modeling capabilities,this also brings influence to the mechanical fault diagnosis field.Therefore,according to the characteristics of motor vibration signals(nonstationary and difficult to deal with)and mechanical‘big data’,combined with deep learning,a motor fault diagnosis method based on stacked de-noising auto-encoder is proposed.The frequency domain signals obtained by the Fourier transform are used as input to the network.This method can extract features adaptively and unsupervised,and get rid of the dependence of traditional machine learning methods on human extraction features.A supervised fine tuning of the model is then carried out by backpropagation.The Asynchronous motor in Drivetrain Dynamics Simulator system was taken as the research object,the effectiveness of the proposed method was verified by a large number of data,and research on visualization of network output,the results shown that the SDAE method is more efficient and more intelligent.

Research on Total Electric Field Prediction Method of Ultra-High Voltage Direct Current Transmission Line Based on Stacking Algorithm

Ultra-high voltage(UHV)transmission lines are an important part of China’s power grid and are often surrounded by a complex electromagnetic environment.The ground total electric field is considered a main electromagnetic environment indicator of UHV transmission lines and is currently employed for reliable long-term operation of the power grid.Yet,the accurate prediction of the ground total electric field remains a technical challenge.In this work,we collected the total electric field data from the Ningdong-Zhejiang±800 kV UHVDC transmission project,as of the Ling Shao line,and perform an outlier analysis of the total electric field data.We show that the Local Outlier Factor(LOF)elimination algorithm has a small average difference and overcomes the performance of Density-Based Spatial Clustering of Applications with Noise(DBSCAN)and Isolated Forest elimination algorithms.Moreover,the Stacking algorithm has been found to have superior prediction accuracy than a variety of similar prediction algorithms,including the traditional finite element.The low prediction error of the Stacking algorithm highlights the superior ability to accurately forecast the ground total electric field of UHVDC transmission lines.

Fault Diagnosis for Rolling Bearings with Stacked Denoising Auto-encoder of Information Aggregation

Rolling bearings are important central components in rotating machines, whose fault diagnosis is crucial in condition-based maintenance to reduce the complexity of different kinds of faults. To classify various rolling bearing faults, a prognostic algorithm consisting of four phases was proposed. Since stacked denoising auto-encoder can be filtered, noise of large numbers of mechanical vibration signals was used for deep learning structure to extract the characteristics of the noise. Unsupervised pre-training method, which can greatly simplify the traditional manual extraction approach, was utilized to process the depth of the data automatically. Furthermore, the aggregation layer of stacked denoising auto-encoder(SDA) was proposed to get rid of gradient disappearance in deeper layers of network, mix superficial nodes’ expression with deeper layers, and avoid the insufficient express ability in deeper layers. Principal component analysis(PCA) was adopted to extract different features for classification. According to the experimental data of this method and from the comparison results, the proposed method of rolling bearing fault classification reached 97.02% of correct rate, suggesting a better performance than other algorithms.

Deep Learning-Based Stacked Auto-Encoder with Dynamic Differential Annealed Optimization for Skin Lesion Diagnosis

Intelligent diagnosis approaches with shallow architectural models play an essential role in healthcare.Deep Learning(DL)models with unsupervised learning concepts have been proposed because high-quality feature extraction and adequate labelled details significantly influence shallow models.On the other hand,skin lesionbased segregation and disintegration procedures play an essential role in earlier skin cancer detection.However,artefacts,an unclear boundary,poor contrast,and different lesion sizes make detection difficult.To address the issues in skin lesion diagnosis,this study creates the UDLS-DDOA model,an intelligent Unsupervised Deep Learning-based Stacked Auto-encoder(UDLS)optimized by Dynamic Differential Annealed Optimization(DDOA).Pre-processing,segregation,feature removal or separation,and disintegration are part of the proposed skin lesion diagnosis model.Pre-processing of skin lesion images occurs at the initial level for noise removal in the image using the Top hat filter and painting methodology.Following that,a Fuzzy C-Means(FCM)segregation procedure is performed using a Quasi-Oppositional Elephant Herd Optimization(QOEHO)algorithm.Besides,a novel feature extraction technique using the UDLS technique is applied where the parameter tuning takes place using DDOA.In the end,the disintegration procedure would be accomplished using a SoftMax(SM)classifier.The UDLS-DDOA model is tested against the International Skin Imaging Collaboration(ISIC)dataset,and the experimental results are examined using various computational attributes.The simulation results demonstrated that the UDLS-DDOA model outperformed the compared methods significantly.

Subsurface Temperature and Salinity Structures Inversion Using a Stacking-Based Fusion Model from Satellite Observations in the South China Sea

Three-dimensional ocean subsurface temperature and salinity structures(OST/OSS)in the South China Sea(SCS)play crucial roles in oceanic climate research and disaster mitigation.Traditionally,real-time OST and OSS are mainly obtained through in-situ ocean observations and simulation by ocean circulation models,which are usually challenging and costly.Recently,dynamical,statistical,or machine learning models have been proposed to invert the OST/OSS from sea surface information;however,these models mainly focused on the inversion of monthly OST and OSS.To address this issue,we apply clustering algorithms and employ a stacking strategy to ensemble three models(XGBoost,Random Forest,and LightGBM)to invert the real-time OST/OSS based on satellite-derived data and the Argo dataset.Subsequently,a fusion of temperature and salinity is employed to reconstruct OST and OSS.In the validation dataset,the depth-averaged Correlation(Corr)of the estimated OST(OSS)is 0.919(0.83),and the average Root-Mean-Square Error(RMSE)is0.639°C(0.087 psu),with a depth-averaged coefficient of determination(R~2)of 0.84(0.68).Notably,at the thermocline where the base models exhibit their maximum error,the stacking-based fusion model exhibited significant performance enhancement,with a maximum enhancement in OST and OSS inversion exceeding 10%.We further found that the estimated OST and OSS exhibit good agreement with the HYbrid Coordinate Ocean Model(HYCOM)data and BOA_Argo dataset during the passage of a mesoscale eddy.This study shows that the proposed model can effectively invert the real-time OST and OSS,potentially enhancing the understanding of multi-scale oceanic processes in the SCS.

基于Stacking集成算法的抛石护岸水毁破坏预测研究

抛石护岸在顶冲等极端情况下易发生水毁破坏,给人民的生命财产带来威胁。通过水槽试验获取496组样本数据,利用互信息(MI)筛选出6个关键特征属性,并采用支持向量机(SVR)、广义回归神经网络(GRNN)和随机森林(RF)等机器学习算法构建多个预测模型。然后,将这些模型作为基学习器,结合BP神经网络(BPNN)作为元学习器,采用Stacking集成学习方法构建抛石护岸破坏程度预测模型。最后,通过决定系数(R^(2))、均方根误差(R_(RMSE))及平均绝对误差(M_(MAE))等评价指标对模型性能进行评估。结果表明,Stacking模型在抛石护岸破坏高度、长度、范围上的平均R^(2)为0.98、RRMSE为0.02、M_(MAE)为0.03,相较于单一模型(SVR、GRNN、RF),Stacking模型的R_(RMSE)、M_(MAE)皆为最小,R2最高。在抛石护岸水毁破坏程度的预测中,融合的Stacking模型展现出更高的准确性与稳定性。

基于Stacking算法集成学习的页岩油储层总有机碳含量评价方法

总有机碳含量(TOC)是页岩油储层评价的重要参数,而传统总有机碳含量测井评价方法精度较低且普适性较差,机器学习模型在一定程度上提高了总有机碳含量预测精度,但结果存在不稳定性。为了进一步提高页岩油储层总有机碳含量预测精度,基于有机质岩石物理特征和不同总有机碳含量测井响应特征的深入分析,优选出深侧向电阻率、声波时差、补偿中子和密度测井曲线作为总有机碳含量的敏感测井响应,并将其作为输入特征,以岩心分析总有机碳含量作为期望输出值,分别建立了决策树模型、支持向量回归机模型、BP(Back Propagation)神经网络模型,并建立了以决策树模型为基模型、支持向量回归机模型为元模型的Stacking算法集成学习模型。利用B油田A区块的岩心样本数据和实际井数据对不同模型预测总有机碳含量结果进行了验证,结果表明,基于Stacking算法的集成学习模型的总有机碳含量预测精度最高,相较于决策树模型、支持向量回归机模型、BP神经网络模型和改进的ΔlgR法,预测精度有较大提高。因此,基于Stacking算法的集成学习模型为该研究区最有效的总有机碳含量计算方法,这为准确地评估页岩油储层的生烃潜力、确保页岩油储层的高效开采及资源利用奠定了基础。

Prediction of geological characteristics from shield operational parameters by integrating grid search and K-fold cross validation into stacking classification algorithm

This study presents a framework for predicting geological characteristics based on integrating a stacking classification algorithm(SCA) with a grid search(GS) and K-fold cross validation(K-CV). The SCA includes two learner layers: a primary learner’s layer and meta-classifier layer. The accuracy of the SCA can be improved by using the GS and K-CV. The GS was developed to match the hyper-parameters and optimise complicated problems. The K-CV is commonly applied to changing the validation set in a training set. In general, a GS is usually combined with K-CV to produce a corresponding evaluation index and select the best hyper-parameters. The torque penetration index(TPI) and field penetration index(FPI) are proposed based on shield parameters to express the geological characteristics. The elbow method(EM) and silhouette coefficient(Si) are employed to determine the types of geological characteristics(K) in a Kmeans++ algorithm. A case study on mixed ground in Guangzhou is adopted to validate the applicability of the developed model. The results show that with the developed framework, the four selected parameters, i.e. thrust, advance rate, cutterhead rotation speed and cutterhead torque, can be used to effectively predict the corresponding geological characteristics.

基于Stacking融合的LSTM-SA-RBF短期负荷预测

为了解决单个神经网络预测的局限性和时间序列的波动性,提出了一种奇异谱分析(singular spectrum analysis,SSA)和Stacking框架相结合的短期负荷预测方法。利用随机森林筛选出与历史负荷相关性强烈的特征因素,采用SSA为负荷数据降噪,简化模型计算过程;基于Stacking框架,结合长短期记忆(long and short-term memory,LSTM)-自注意力机制(self-attention mechanism,SA)、径向基(radial base functions,RBF)神经网络和线性回归方法集成新的组合模型,同时利用交叉验证方法避免模型过拟合;选取PJM和澳大利亚电力负荷数据集进行验证。仿真结果表明,与其他模型比较,所提模型预测精度高。

Stacking多模型融合优化高校图书采购预测的研究

提出了一种基于Stacking多模型融合的图书采购预测模型,旨在提升高校图书采购预测的准确性和可靠性。传统的单一预测模型难以较好地应对高校图书采购中的诸多复杂因素。采用Stacking方法,构建了一个次级模型,能够有效整合不同基础模型的预测结果,并通过交叉验证来选择最佳的Stacking模型,以确保模型的稳定性和泛化能力。实验结果表明,Stacking多模型融合方法显著提升了高校图书采购预测的准确性和鲁棒性。这为高校图书采购管理提供了一种有效的决策工具,有望改善资源分配,降低不必要的成本,并提高管理决策的科学性。

坝基灌浆量预测ISSA-Stacking集成学习代理模型研究

灌浆量预测对坝基灌浆施工具有重要意义.由于灌浆工程隐蔽且复杂,传统方法难以实现准确高效的灌浆量预测.代理模型是一种能够建立影响因素与响应值之间近似关系的快速求解方法,然而单一代理模型的预测稳定性和准确性较低,组合代理模型仅将单一模型结果进行加权平均,预测精度仍有待提高.为解决上述问题,本文提出一种ISSA-Stacking集成学习代理模型新方法用于灌浆量预测研究.首先,针对灌浆量预测具有数据量小、影响因素与灌浆量之间非线性关系复杂且预测不确定性较大等特性,基于Stacking集成学习策略,选取在小样本预测中表现优越的支持向量回归(SVR)、具有良好非线性拟合能力的BP神经网络(BPNN)和预测泛化性能及稳定性高的随机森林(RF)等算法作为基学习器,采用自适应学习和不确定性处理能力强的自适应神经模糊推理系统(ANFIS)作为元学习器以集成上述机器学习算法的优势,构建具有更优预测性能和泛化能力的Stacking集成学习方法作为代理模型;其次,为进一步提高模型预测精度,采用混沌理论和Lévy飞行策略改进的麻雀搜索算法(ISSA)对集成学习代理模型进行参数同步优化;最后,将所提ISSA-Stacking集成学习代理模型应用于某实际灌浆工程的灌浆量预测并与其他方法进行对比分析.结果表明,所提方法具有较高的预测精度,绝对平均误差仅为0.21 m^(3);与组合代理模型及单一代理模型(SVR、BPNN和RF)相比,平均精度分别提高24.34%、30.84%、32.68%和26.56%,为灌浆量预测提供了一种新思路.

Design Optimization of CFRP Stacking Sequence Using a Multi-Island Genetic Algorithms Under Low-velocity Impact Loads

A method to improve the low-velocity impact performance of composite laminate is proposed, and a multi-island genetic algorithm is used for the optimization of composite laminate stacking sequence under low-velocity impact loads based on a 2D dynamic impact finite element analysis. Low-velocity impact tests and compression-after impact（CAI） tests have been conducted to verify the effectiveness of optimization method. Experimental results show that the impact damage areas of the optimized laminate have been reduced by 42.1% compared to the baseline specimen, and the residual compression strength has been increased by 10.79%, from baseline specimen 156.97 MPa to optimized 173.91 MPa. The tests result shows that optimization method can effectively enhance the impact performances of the laminate.

Rock mass quality classification based on deep learning:A feasibility study for stacked autoencoders

Objective and accurate evaluation of rock mass quality classification is the prerequisite for reliable sta-bility assessment.To develop a tool that can deliver quick and accurate evaluation of rock mass quality,a deep learning approach is developed,which uses stacked autoencoders(SAEs)with several autoencoders and a softmax net layer.Ten rock parameters of rock mass rating(RMR)system are calibrated in this model.The model is trained using 75%of the total database for training sample data.The SAEs trained model achieves a nearly 100%prediction accuracy.For comparison,other different models are also trained with the same dataset,using artificial neural network(ANN)and radial basis function(RBF).The results show that the SAEs classify all test samples correctly while the rating accuracies of ANN and RBF are 97.5%and 98.7%,repectively,which are calculated from the confusion matrix.Moreover,this model is further employed to predict the slope risk level of an abandoned quarry.The proposed approach using SAEs,or deep learning in general,is more objective and more accurate and requires less human inter-vention.The findings presented here shall shed light for engineers/researchers interested in analyzing rock mass classification criteria or performing field investigation.

Optimizing slope safety factor prediction via stacking using sparrow search algorithm for multi-layer machine learning regression models

The safety factor is a crucial quantitative index for evaluating slope stability.However,the traditional calculation methods suffer from unreasonable assumptions,complex soil composition,and inadequate consideration of the influencing factors,leading to large errors in their calculations.Therefore,a stacking ensemble learning model(stacking-SSAOP)based on multi-layer regression algorithm fusion and optimized by the sparrow search algorithm is proposed for predicting the slope safety factor.In this method,the density,cohesion,friction angle,slope angle,slope height,and pore pressure ratio are selected as characteristic parameters from the 210 sets of established slope sample data.Random Forest,Extra Trees,AdaBoost,Bagging,and Support Vector regression are used as the base model(inner loop)to construct the first-level regression algorithm layer,and XGBoost is used as the meta-model(outer loop)to construct the second-level regression algorithm layer and complete the construction of the stacked learning model for improving the model prediction accuracy.The sparrow search algorithm is used to optimize the hyperparameters of the above six regression models and correct the over-and underfitting problems of the single regression model to further improve the prediction accuracy.The mean square error(MSE)of the predicted and true values and the fitting of the data are compared and analyzed.The MSE of the stacking-SSAOP model was found to be smaller than that of the single regression model(MSE=0.03917).Therefore,the former has a higher prediction accuracy and better data fitting.This study innovatively applies the sparrow search algorithm to predict the slope safety factor,showcasing its advantages over traditional methods.Additionally,our proposed stacking-SSAOP model integrates multiple regression algorithms to enhance prediction accuracy.This model not only refines the prediction accuracy of the slope safety factor but also offers a fresh approach to handling the intricate soil composition and other influencing factors,making it a precise and reliable method for slope stability evaluation.This research holds importance for the modernization and digitalization of slope safety assessments.

Hybrid Image Compression-Encryption Scheme Based on Multilayer Stacked Autoencoder and Logistic Map

Secure transmission of images over a communication channel, with limited data transfer capacity, possesses compression and encryption schemes. A deep learning based hybrid image compression-encryption scheme is proposed by combining stacked auto-encoder with the logistic map. The proposed structure of stacked autoencoder has seven multiple layers, and back propagation algorithm is intended to extend vector portrayal of information into lower vector space. The randomly generated key is used to set initial conditions and control parameters of logistic map. Subsequently, compressed image is encrypted by substituting and scrambling of pixel sequences using key stream sequences generated from logistic map.The proposed algorithms are experimentally tested over five standard grayscale images. Compression and encryption efficiency of proposed algorithms are evaluated and analyzed based on peak signal to noise ratio(PSNR), mean square error(MSE), structural similarity index metrics(SSIM) and statistical,differential, entropy analysis respectively. Simulation results show that proposed algorithms provide high quality reconstructed images with excellent levels of security during transmission..

Soft-output stack algorithm with lattice-reduction for MIMO detection

A computationally efficient soft-output detector with lattice-reduction （LR） for the multiple-input multiple-output （MIMO） systems is proposed. In the proposed scheme, the sorted QR de- composition is applied on the lattice-reduced equivalent channel to obtain the tree structure. With the aid of the boundary control, the stack algorithm searches a small part of the whole search tree to generate a handful of candidate lists in the reduced lattice. The proposed soft-output algorithm achieves near-optimal perfor- mance in a coded MIMO system and the associated computational complexity is substantially lower than that of previously proposed methods.

Employee Attrition Classification Model Based on Stacking Algorithm

This paper aims to build an employee attrition classification model based on the Stacking algorithm.Oversampling algorithm is applied to address the issue of data imbalance and the Randomforest feature importance ranking method is used to resolve the overfitting problem after data cleaning and preprocessing.Then,different algorithms are used to establish classification models as control experiments,and R-squared indicators are used to compare.Finally,the Stacking algorithm is used to establish the final classification model.This model has practical and significant implications for both human resource management and employee attrition analysis.

基于WOA-Stacking集成学习的注塑产品尺寸预测

在现有的基于机器学习的注塑产品尺寸预测模型中,存在单一模型预测精度不高的问题,为了提高实时监测注塑产品尺寸变化的精度,提出了一种基于鲸鱼优化算法(WOA)优化Stacking集成学习的注塑产品尺寸预测方法。首先,整合注塑过程收集到的数据,使用3σ准则进行异常值筛选,再通过随机森林法和互信息法选取关键的特征,作为后续模型的输入特征;其次,在Stacking集成学习框架中,选择K近邻、随机森林和轻量级梯度提升机作为基学习器,选择弹性网络回归作为元学习器,使用WOA优化各个基学习器中的超参数,构建WOA-Stacking集成学习预测模型;最后,将所提的模型应用到注塑产品尺寸预测并与其他模型进行对比分析,以验证本方法的有效性。以第四届工业大数据创新竞赛数据为例,在包含3种集成模型和3种单一模型的对比实验中,选择产品的三维尺寸作为预测目标,实验结果表明WOA-Stacking集成学习模型具有更高的预测精度和拟合能力。

基于Stacking集成算法的混凝土28d抗压强度预测

为实现混凝土28d抗压强度的精准预测并解决不同机器学习模型间相互独立不能优势互补的问题。本研究通过357组混凝土配合比数据构建数据库,并采用Stacking集成方法对3个单一机器学习模型(KNN、XGBoost和RF)进行集成预测研究。首先通过随机抽样方法将数据库划分为训练集和测试集,然后分别进行了单一机器学习模型和集成模型的训练和测试集预测,最后采用平均绝对误差指标(MAE)、均方根误差指标(RMSE)和确定系数(R2)对模型的预测结果进行评价。结果表明,RF模型在三个单一机器学习模型(KNN、XGBoost和RF)中表现最好(MAE=3.0705,RMSE=4.1847,R^(2)=0.8817);此外,Stacking集成模型的预测性能优于任意单一模型,相较于单一模型中表现较好的RF模型,其预测性能实现了显著提升(MAE下降2.6%,RMSE下降9.8%,R2提升2.5%)。