Bridge damage identification based on convolutional autoencoders and extreme gradient boosting trees

To enhance the accuracy and efficiency of bridge damage identification,a novel data-driven damage identification method was proposed.First,convolutional autoencoder(CAE)was used to extract key features from the acceleration signal of the bridge structure through data reconstruction.The extreme gradient boosting tree(XGBoost)was then used to perform analysis on the feature data to achieve damage detection with high accuracy and high performance.The proposed method was applied in a numerical simulation study on a three-span continuous girder and further validated experimentally on a scaled model of a cable-stayed bridge.The numerical simulation results show that the identification errors remain within 2.9%for six single-damage cases and within 3.1%for four double-damage cases.The experimental validation results demonstrate that when the tension in a single cable of the cable-stayed bridge decreases by 20%,the method accurately identifies damage at different cable locations using only sensors installed on the main girder,achieving identification accuracies above 95.8%in all cases.The proposed method shows high identification accuracy and generalization ability across various damage scenarios.

Modeling of Total Dissolved Solids (TDS) and Sodium Absorption Ratio (SAR) in the Edwards-Trinity Plateau and Ogallala Aquifers in the Midland-Odessa Region Using Random Forest Regression and eXtreme Gradient Boosting

Efficient water quality monitoring and ensuring the safety of drinking water by government agencies in areas where the resource is constantly depleted due to anthropogenic or natural factors cannot be overemphasized. The above statement holds for West Texas, Midland, and Odessa Precisely. Two machine learning regression algorithms (Random Forest and XGBoost) were employed to develop models for the prediction of total dissolved solids (TDS) and sodium absorption ratio (SAR) for efficient water quality monitoring of two vital aquifers: Edward-Trinity (plateau), and Ogallala aquifers. These two aquifers have contributed immensely to providing water for different uses ranging from domestic, agricultural, industrial, etc. The data was obtained from the Texas Water Development Board (TWDB). The XGBoost and Random Forest models used in this study gave an accurate prediction of observed data (TDS and SAR) for both the Edward-Trinity (plateau) and Ogallala aquifers with the R2 values consistently greater than 0.83. The Random Forest model gave a better prediction of TDS and SAR concentration with an average R, MAE, RMSE and MSE of 0.977, 0.015, 0.029 and 0.00, respectively. For the XGBoost, an average R, MAE, RMSE, and MSE of 0.953, 0.016, 0.037 and 0.00, respectively, were achieved. The overall performance of the models produced was impressive. From this study, we can clearly understand that Random Forest and XGBoost are appropriate for water quality prediction and monitoring in an area of high hydrocarbon activities like Midland and Odessa and West Texas at large.

Prediction of undrained shear strength using extreme gradient boosting and random forest based on Bayesian optimization

Accurate assessment of undrained shear strength(USS)for soft sensitive clays is a great concern in geotechnical engineering practice.This study applies novel data-driven extreme gradient boosting(XGBoost)and random forest(RF)ensemble learning methods for capturing the relationships between the USS and various basic soil parameters.Based on the soil data sets from TC304 database,a general approach is developed to predict the USS of soft clays using the two machine learning methods above,where five feature variables including the preconsolidation stress(PS),vertical effective stress(VES),liquid limit(LL),plastic limit(PL)and natural water content(W)are adopted.To reduce the dependence on the rule of thumb and inefficient brute-force search,the Bayesian optimization method is applied to determine the appropriate model hyper-parameters of both XGBoost and RF.The developed models are comprehensively compared with three comparison machine learning methods and two transformation models with respect to predictive accuracy and robustness under 5-fold cross-validation(CV).It is shown that XGBoost-based and RF-based methods outperform these approaches.Besides,the XGBoostbased model provides feature importance ranks,which makes it a promising tool in the prediction of geotechnical parameters and enhances the interpretability of model.

Forecasting Multi-Step Ahead Monthly Reference Evapotranspiration Using Hybrid Extreme Gradient Boosting with Grey Wolf Optimization Algorithm

It is important for regional water resources management to know the agricultural water consumption information several months in advance.Forecasting reference evapotranspiration(ET_(0))in the next few months is important for irrigation and reservoir management.Studies on forecasting of multiple-month ahead ET_(0) using machine learning models have not been reported yet.Besides,machine learning models such as the XGBoost model has multiple parameters that need to be tuned,and traditional methods can get stuck in a regional optimal solution and fail to obtain a global optimal solution.This study investigated the performance of the hybrid extreme gradient boosting(XGBoost)model coupled with the Grey Wolf Optimizer(GWO)algorithm for forecasting multi-step ahead ET_(0)(1-3 months ahead),compared with three conventional machine learning models,i.e.,standalone XGBoost,multi-layer perceptron(MLP)and M5 model tree(M5)models in the subtropical zone of China.The results showed that theGWO-XGB model generally performed better than the other three machine learning models in forecasting 1-3 months ahead ET_(0),followed by the XGB,M5 and MLP models with very small differences among the three models.The GWO-XGB model performed best in autumn,while the MLP model performed slightly better than the other three models in summer.It is thus suggested to apply the MLP model for ET_(0) forecasting in summer but use the GWO-XGB model in other seasons.

Object-Based Burned Area Mapping with Extreme Gradient Boosting Using Sentinel-2 Imagery

The Sentinel-2 satellites are providing an unparalleled wealth of high-resolution remotely sensed information with a short revisit cycle, which is ideal for mapping burned areas both accurately and timely. This paper proposes an automated methodology for mapping burn scars using pairs of Sentinel-2 imagery, exploiting the state-of-the-art eXtreme Gradient Boosting (XGB) machine learning framework. A large database of 64 reference wildfire perimeters in Greece from 2016 to 2019 is used to train the classifier. An empirical methodology for appropriately sampling the training patterns from this database is formulated, which guarantees the effectiveness of the approach and its computational efficiency. A difference (pre-fire minus post-fire) spectral index is used for this purpose, upon which we appropriately identify the clear and fuzzy value ranges. To reduce the data volume, a super-pixel segmentation of the images is also employed, implemented via the QuickShift algorithm. The cross-validation results showcase the effectiveness of the proposed algorithm, with the average commission and omission errors being 9% and 2%, respectively, and the average Matthews correlation coefficient (MCC) equal to 0.93.

Application of extreme gradient boosting in predicting the viscoelastic characteristics of graphene oxide modified asphalt at medium and high temperatures

Complex modulus(G^(*))is one of the important criteria for asphalt classification according to AASHTO M320-10,and is often used to predict the linear viscoelastic behavior of asphalt binders.In addition,phase angle(φ)characterizes the deformation resilience of asphalt and is used to assess the ratio between the viscous and elastic components.It is thus important to quickly and accurately estimate these two indicators.The purpose of this investigation is to construct an extreme gradient boosting(XGB)model to predict G^(*)andφof graphene oxide(GO)modified asphaltat medium and high temperatures.Two data sets are gathered from previously published experiments,consisting of 357 samples for G^(*)and 339 samples forφ,and the se are used to develop the XGB model using nine inputs representing theasphalt binder components.The findings show that XGB is an excellent predictor of G^(*)andφof GO-modified asphalt,evaluated by the coefficient of determination R^(2)(R^(2)=0.990 and 0.9903 for G^(*)andφ,respectively)and root mean square error(RMSE=31.499 and 1.08 for G^(*)andφ,respectively).In addition,the model’s performance is compared with experimental results and five other machine learning(ML)models to highlight its accuracy.In the final step,the Shapley additive explanations(SHAP)value analysis is conducted to assess the impact of each input and the correlation between pairs of important features on asphalt’s two physical properties.

Compressive strength prediction and optimization design of sustainable concrete based on squirrel search algorithm-extreme gradient boosting technique

Concrete is the most commonly used construction material.However,its production leads to high carbon dioxide(CO_(2))emissions and energy consumption.Therefore,developing waste-substitutable concrete components is necessary.Improving the sustainability and greenness of concrete is the focus of this research.In this regard,899 data points were collected from existing studies where cement,slag,fly ash,superplasticizer,coarse aggregate,and fine aggregate were considered potential influential factors.The complex relationship between influential factors and concrete compressive strength makes the prediction and estimation of compressive strength difficult.Instead of the traditional compressive strength test,this study combines five novel metaheuristic algorithms with extreme gradient boosting(XGB)to predict the compressive strength of green concrete based on fly ash and blast furnace slag.The intelligent prediction models were assessed using the root mean square error(RMSE),coefficient of determination(R^(2)),mean absolute error(MAE),and variance accounted for(VAF).The results indicated that the squirrel search algorithm-extreme gradient boosting(SSA-XGB)yielded the best overall prediction performance with R^(2) values of 0.9930 and 0.9576,VAF values of 99.30 and 95.79,MAE values of 0.52 and 2.50,RMSE of 1.34 and 3.31 for the training and testing sets,respectively.The remaining five prediction methods yield promising results.Therefore,the developed hybrid XGB model can be introduced as an accurate and fast technique for the performance prediction of green concrete.Finally,the developed SSA-XGB considered the effects of all the input factors on the compressive strength.The ability of the model to predict the performance of concrete with unknown proportions can play a significant role in accelerating the development and application of sustainable concrete and furthering a sustainable economy.

Machine learning using the extreme gradient boosting (XGBoost) algorithm predicts 5-day delta of SOFA score at ICU admission in COVID-19 patients

Background:Accurate risk stratification of critically ill patients with coronavirus disease 2019(COVID-19)is essential for optimizing resource allocation,delivering targeted interventions,and maximizing patient survival probability.Machine learning(ML)techniques are attracting increased interest for the development of prediction models as they excel in the analysis of complex signals in data-rich environments such as critical care.Methods:We retrieved data on patients with COVID-19 admitted to an intensive care unit(ICU)between March and October 2020 from the RIsk Stratification in COVID-19 patients in the Intensive Care Unit(RISC-19-ICU)registry.We applied the Extreme Gradient Boosting(XGBoost)algorithm to the data to predict as a binary out-come the increase or decrease in patients’Sequential Organ Failure Assessment(SOFA)score on day 5 after ICU admission.The model was iteratively cross-validated in different subsets of the study cohort.Results:The final study population consisted of 675 patients.The XGBoost model correctly predicted a decrease in SOFA score in 320/385(83%)critically ill COVID-19 patients,and an increase in the score in 210/290(72%)patients.The area under the mean receiver operating characteristic curve for XGBoost was significantly higher than that for the logistic regression model(0.86 vs.0.69,P<0.01[paired t-test with 95%confidence interval]).Conclusions:The XGBoost model predicted the change in SOFA score in critically ill COVID-19 patients admitted to the ICU and can guide clinical decision support systems(CDSSs)aimed at optimizing available resources.

基于优化XGBoost的风电机组发电机前轴承故障预警

为了及时有效地识别发电机的异常运行状态,提出了基于贝叶斯优化极限梯度提升算法的风电机组发电机前轴承故障预警方法:利用有效的数据预处理方法处理数据采集与监视控制系统历史数据;基于贝叶斯优化的XGBoost (eXtreme Gradient Boosting)算法构建风电机组发电机前轴承温度预测模型;基于3σ准则,确定风电机组发电机前轴承故障预警阈值。实验结果表明所提方法能提前监测到风电机组发电机前轴承异常信号。通过与采用随机搜索和网格搜索所建立的模型进行对比分析,验证了贝叶斯优化模型在泛化性能和预测精度上具有优势。

基于LSTM与XGBOOST混合模型的孕妇产后出血预测

孕妇产后大出血是造成全球孕妇死亡的重要因素之一,在我国位居孕妇死亡原因首位,然而对产后出血的提前判定一直以来都是医学上一个难题.电子病历的普及,以及机器学习和深度学习技术的发展,为预知孕妇产后大出血提供了基于大数据的解决办法.本文提出利用孕妇的电子病历数据,构建基于LSTM和XGBoost的混合模型来预测孕妇产后大出血.实验结果表明,利用基于LSTM和XGBoost的混合模型对孕妇产后大出血进行预测是可行的,能够为医生判断孕妇产后出血情况提供参考,为孕妇分娩时是否需要备血方案提供决策支持,对降低产后大出血致死率具有积极意义.

Tactical intention recognition of aerial target based on XGBoost decision tree

In order to improve the accuracy of target intent recognition,a recognition method based on XGBoost(eXtreme Gradient Boosting)decision tree is proposed.This paper adopts relevant data and program of python to calculate the probability of tactical intention.Then the sequence intention probability is obtained by applying Dempster-Shafer rule of combination.To verify the accuracy of recognition results,we compare the experimental results of this paper with the results in the literatures.The experiment shows that the probability of tactical intention recognition through this method is improved,so this method is feasible.

Abnormal user identification based on XGBoost algorithm

The eXtreme gradient boosting(XGBoost)algorithm is used to identify abnormal users.Firstly,the raw data were cleaned.Then user power characteristics were extracted from different aspects.Finally,the XGBoost classifier was used to identify the abnormal users respectively in the balanced sample set and the unbalanced sample set.In contrast,under the same characteristics,the k-nearest neighbor(KNN)classifier,back-propagation(BP)neural network classifier and random forest classifier were used to identify the abnormal users in the two samples.The experimental results show that the XGBoost classifier has higher recognition rate and faster running speed.Especially in the imbalanced data sets,the performance improvement is obvious.

A Novel Method of Heart Failure Prediction Based on DPCNN-XGBOOST Model

The occurrence of perioperative heart failure will affect the quality of medical services and threaten the safety of patients.Existing methods depend on the judgment of doctors,the results are affected by many factors such as doctors’knowledge and experience.The accuracy is difficult to guarantee and has a serious lag.In this paper,a mixture prediction model is proposed for perioperative adverse events of heart failure,which combined with the advantages of the Deep Pyramid Convolutional Neural Networks(DPCNN)and Extreme Gradient Boosting(XGBOOST).The DPCNN was used to automatically extract features from patient’s diagnostic texts,and the text features were integrated with the preoperative examination and intraoperative monitoring values of patients,then the XGBOOST algorithm was used to construct the prediction model of heart failure.An experimental comparison was conducted on the model based on the data of patients with heart failure in southwest hospital from 2014 to 2018.The results showed that the DPCNN-XGBOOST model improved the predictive sensitivity of the model by 3%and 31%compared with the text-based DPCNN Model and the numeric-based XGBOOST Model.

结合机器学习的SA湍流模型闭合系数修正

将修正Morris分类筛选法与极端梯度提升(extreme gradient boosting,XGBoost)相结合,在计算流体动力学(computational fluid dynamics,CFD)数据驱动下,用于SA(Spalart-Allmaras)湍流模型闭合系数的修正.利用分类筛选法有效缩小闭合系数研究范围,同时依据XGBoost方法在小规模数据集下取得精度较高的拟合模型,有效提升系数修正效率.在三维DLR-F6-WB构型下进行了数值实验,实验结果显示利用本方法能够在三维复杂模型上基于小样本数据进行系数修正,修正后的升阻力系数计算精度得到了显著提升.

考虑环境因素的电动汽车充电站实时负荷预测模型

为了减少电动汽车大规模集成到电网造成的不利影响,提出了一种能够实现充电站充电负荷精准预测的方法。该方法利用LightGBM(light gradient boosting machine)与XGBoost(eXtreme gradient boosting)模型构建线下-线上组合模型。考虑充电负荷、时间、温度、天气等历史数据,利用LightGBM模型初步建立充电负荷线下预测模型;基于XGBoost模型,以线下预测模型输出负荷和实际负荷的误差为优化目标,实时变化的交通流量为协变量,建立线上预测模型,并对初步预测结果进行误差修正。某市实际充电站预测结果表明,相比于随机森林(RF)、LightGBM模型、XGBoost模型、多层感知机(MLP)以及LightGBM-RF组合模型,该组合模型具有更高的预测精度,同时可以准确预测不同充电站的实时充电负荷。

Explainable machine learning model for predicting molten steel temperature in the LF refining process

Accurate prediction of molten steel temperature in the ladle furnace(LF)refining process has an important influence on the quality of molten steel and the control of steelmaking cost.Extensive research on establishing models to predict molten steel temperature has been conducted.However,most researchers focus solely on improving the accuracy of the model,neglecting its explainability.The present study aims to develop a high-precision and explainable model with improved reliability and transparency.The eXtreme gradient boosting(XGBoost)and light gradient boosting machine(LGBM)were utilized,along with bayesian optimization and grey wolf optimiz-ation(GWO),to establish the prediction model.Different performance evaluation metrics and graphical representations were applied to compare the optimal XGBoost and LGBM models obtained through varying hyperparameter optimization methods with the other models.The findings indicated that the GWO-LGBM model outperformed other methods in predicting molten steel temperature,with a high pre-diction accuracy of 89.35%within the error range of±5°C.The model’s learning/decision process was revealed,and the influence degree of different variables on the molten steel temperature was clarified using the tree structure visualization and SHapley Additive exPlana-tions(SHAP)analysis.Consequently,the explainability of the optimal GWO-LGBM model was enhanced,providing reliable support for prediction results.

An empirical method for joint inversion of wave and wind parameters based on SAR and wave spectrometer data

Synthetic aperture radar(SAR)and wave spectrometers,crucial in microwave remote sensing,play an essential role in monitoring sea surface wind and wave conditions.However,they face inherent limitations in observing sea surface phenomena.SAR systems,for instance,are hindered by an azimuth cut-off phenomenon in sea surface wind field observation.Wave spectrometers,while unaffected by the azimuth cutoff phenomenon,struggle with low azimuth resolution,impacting the capture of detailed wave and wind field data.This study utilizes SAR and surface wave investigation and monitoring(SWIM)data to initially extract key feature parameters,which are then prioritized using the extreme gradient boosting(XGBoost)algorithm.The research further addresses feature collinearity through a combined analysis of feature importance and correlation,leading to the development of an inversion model for wave and wind parameters based on XGBoost.A comparative analysis of this model with ERA5 reanalysis and buoy data for of significant wave height,mean wave period,wind direction,and wind speed reveals root mean square errors of 0.212 m,0.525 s,27.446°,and 1.092 m/s,compared to 0.314 m,0.888 s,27.698°,and 1.315 m/s from buoy data,respectively.These results demonstrate the model’s effective retrieval of wave and wind parameters.Finally,the model,incorporating altimeter and scatterometer data,is evaluated against SAR/SWIM single and dual payload inversion methods across different wind speeds.This comparison highlights the model’s superior inversion accuracy over other methods.

基于传感器监测数据的预测泌乳牛乳房炎机器学习算法研究

为了预测集约化牧场奶牛患有临床乳房炎的风险,试验选择黑龙江省黑河市两个集约化奶牛场的288头泌乳牛及其数据为研究对象,分为患病组(确诊患有乳房炎的奶牛189头)和健康组(109头),选择这些奶牛的日平均产奶量、日平均活动量、日平均反刍时间、日白天平均反刍时间、日夜间平均反刍时间、昼夜反刍时间比、日每2 h的反刍时间偏差绝对值、日加权反刍时间变化绝对值的和、日平均电导率变化百分比、日电导率峰值14个指标数据,比较分析上述变量在患病组和健康组组间和组内差异;然后采用3种机器学习算法(决策树、随机森林、eXtreme Gradient boosting)和二元逻辑分类算法预测奶牛乳房炎的发病情况。结果表明:在d-0时,患病组奶牛的日平均产奶量[(34.89±11.81)kg]极显著低于健康组[(41.96±8.69)kg,P<0.01];而在d-7~d-2时,患病组奶牛的日平均产奶量均高于健康组,但差异不显著(P>0.05)。患病组奶牛的日平均反刍时间、日白天平均反刍时间、日夜间平均反刍时间在d-1时均达到最低[(515.37±66.88)min、(206.63±67.05)min、(309.56±64.52)min],分别比健康组奶牛[(560.68±51.30)min、(225.81±34.04)min、(334.38±39.89)min]平均少45.31 min(P<0.05)、19.18 min(P>0.05)、24.82 min(P<0.05)。患病组奶牛的昼夜反刍时间比、日每2 h反刍时间偏差绝对值、日加权反刍时间变化绝对值的和均在d-0时达到最大值,而健康组奶牛的上述3个指标从d-7~d-0均无明显变化。患病组奶牛的日加权反刍时间变化绝对值的和在d-1和d-0时分别比健康组极显著高48.83和94.27(P<0.01)。患病组奶牛的日电导率变化百分比、日电导率峰值从d-3~d-0逐渐增大,d-0时达到最大值,而健康组奶牛上述指标均无明显变化。随机森林模型的Se值最高,二元逻辑分类模型最低;eXtreme Gradient boosting模型Sp值高于随机森林模型,但随机森林模型的Acc、F1和AUC值优于其他3种模型。说明随机森林算法对奶牛乳房炎的预测效果最优,日平均产奶量、昼夜反刍比、日加权反刍时间变化绝对值的和、日电导率变化百分比、日电导率峰值可作为奶牛乳房炎预测因子。

Estimation of diaphragm wall deflections for deep braced excavation in anisotropic clays using ensemble learning

This paper adopts the NGI-ADP soil model to carry out finite element analysis,based on which the effects of soft clay anisotropy on the diaphragm wall deflections in the braced excavation were evaluated.More than one thousand finite element cases were numerically analyzed,followed by extensive parametric studies.Surrogate models were developed via ensemble learning methods(ELMs),including the e Xtreme Gradient Boosting(XGBoost),and Random Forest Regression(RFR)to predict the maximum lateral wall deformation(δhmax).Then the results of ELMs were compared with conventional soft computing methods such as Decision Tree Regression(DTR),Multilayer Perceptron Regression(MLPR),and Multivariate Adaptive Regression Splines(MARS).This study presents a cutting-edge application of ensemble learning in geotechnical engineering and a reasonable methodology that allows engineers to determine the wall deflection in a fast,alternative way.

Slope stability prediction using ensemble learning techniques: A case study in Yunyang County, Chongqing, China

Slope stability prediction plays a significant role in landslide disaster prevention and mitigation.This study develops an ensemble learning-based method to predict the slope stability by introducing the random forest(RF)and extreme gradient boosting(XGBoost).As an illustration,the proposed approach is applied to the stability prediction of 786 landslide cases in Yunyang County,Chongqing,China.For comparison,the predictive performance of RF,XGBoost,support vector machine(SVM),and logistic regression(LR)is systematically investigated based on the well-established confusion matrix,which contains the known indices of recall rate,precision,and accuracy.Furthermore,the feature importance of the 12 influencing variables is also explored.Results show that the accuracy of the XGBoost and RF for both the training and testing data is superior to that of SVM and LR,revealing the superiority of the ensemble learning models(i.e.XGBoost and RF)in the slope stability prediction of Yunyang County.Among the 12 influencing factors,the profile shape is the most important one.The proposed ensemble learning-based method offers a promising way to rationally capture the slope status.It can be extended to the prediction of slope stability of other landslide-prone areas of interest.