Accelerated design of high-performance Mg-Mn-based magnesium alloys based on novel bayesian optimization

Magnesium(Mg),being the lightest structural metal,holds immense potential for widespread applications in various fields.The development of high-performance and cost-effective Mg alloys is crucial to further advancing their commercial utilization.With the rapid advancement of machine learning(ML)technology in recent years,the“data-driven''approach for alloy design has provided new perspectives and opportunities for enhancing the performance of Mg alloys.This paper introduces a novel regression-based Bayesian optimization active learning model(RBOALM)for the development of high-performance Mg-Mn-based wrought alloys.RBOALM employs active learning to automatically explore optimal alloy compositions and process parameters within predefined ranges,facilitating the discovery of superior alloy combinations.This model further integrates pre-established regression models as surrogate functions in Bayesian optimization,significantly enhancing the precision of the design process.Leveraging RBOALM,several new high-performance alloys have been successfully designed and prepared.Notably,after mechanical property testing of the designed alloys,the Mg-2.1Zn-2.0Mn-0.5Sn-0.1Ca alloy demonstrates exceptional mechanical properties,including an ultimate tensile strength of 406 MPa,a yield strength of 287 MPa,and a 23%fracture elongation.Furthermore,the Mg-2.7Mn-0.5Al-0.1Ca alloy exhibits an ultimate tensile strength of 211 MPa,coupled with a remarkable 41%fracture elongation.

Bottom hole pressure prediction based on hybrid neural networks and Bayesian optimization

Many scholars have focused on applying machine learning models in bottom hole pressure (BHP) prediction. However, the complex and uncertain conditions in deep wells make it difficult to capture spatial and temporal correlations of measurement while drilling (MWD) data with traditional intelligent models. In this work, we develop a novel hybrid neural network, which integrates the Convolution Neural Network (CNN) and the Gate Recurrent Unit (GRU) for predicting BHP fluctuations more accurately. The CNN structure is used to analyze spatial local dependency patterns and the GRU structure is used to discover depth variation trends of MWD data. To further improve the prediction accuracy, we explore two types of GRU-based structure: skip-GRU and attention-GRU, which can capture more long-term potential periodic correlation in drilling data. Then, the different model structures tuned by the Bayesian optimization (BO) algorithm are compared and analyzed. Results indicate that the hybrid models can extract spatial-temporal information of data effectively and predict more accurately than random forests, extreme gradient boosting, back propagation neural network, CNN and GRU. The CNN-attention-GRU model with BO algorithm shows great superiority in prediction accuracy and robustness due to the hybrid network structure and attention mechanism, having the lowest mean absolute percentage error of 0.025%. This study provides a reference for solving the problem of extracting spatial and temporal characteristics and guidance for managed pressure drilling in complex formations.

Dendritic Cell Algorithm with Bayesian Optimization Hyperband for Signal Fusion

The dendritic cell algorithm(DCA)is an excellent prototype for developing Machine Learning inspired by the function of the powerful natural immune system.Too many parameters increase complexity and lead to plenty of criticism in the signal fusion procedure of DCA.The loss function of DCA is ambiguous due to its complexity.To reduce the uncertainty,several researchers simplified the algorithm program;some introduced gradient descent to optimize parameters;some utilized searching methods to find the optimal parameter combination.However,these studies are either time-consuming or need to be revised in the case of non-convex functions.To overcome the problems,this study models the parameter optimization into a black-box optimization problem without knowing the information about its loss function.This study hybridizes bayesian optimization hyperband(BOHB)with DCA to propose a novel DCA version,BHDCA,for accomplishing parameter optimization in the signal fusion process.The BHDCA utilizes the bayesian optimization(BO)of BOHB to find promising parameter configurations and applies the hyperband of BOHB to allocate the suitable budget for each potential configuration.The experimental results show that the proposed algorithm has significant advantages over the otherDCAexpansion algorithms in terms of signal fusion.

Type 2 Diabetes Risk Prediction Using Deep Convolutional Neural Network Based-Bayesian Optimization

Diabetes mellitus is a long-term condition characterized by hyperglycemia.It could lead to plenty of difficulties.According to rising morbidity in recent years,the world’s diabetic patients will exceed 642 million by 2040,implying that one out of every ten persons will be diabetic.There is no doubt that this startling figure requires immediate attention from industry and academia to promote innovation and growth in diabetes risk prediction to save individuals’lives.Due to its rapid development,deep learning(DL)was used to predict numerous diseases.However,DLmethods still suffer from their limited prediction performance due to the hyperparameters selection and parameters optimization.Therefore,the selection of hyper-parameters is critical in improving classification performance.This study presents Convolutional Neural Network(CNN)that has achieved remarkable results in many medical domains where the Bayesian optimization algorithm(BOA)has been employed for hyperparameters selection and parameters optimization.Two issues have been investigated and solved during the experiment to enhance the results.The first is the dataset class imbalance,which is solved using Synthetic Minority Oversampling Technique(SMOTE)technique.The second issue is the model’s poor performance,which has been solved using the Bayesian optimization algorithm.The findings indicate that the Bayesian based-CNN model superbases all the state-of-the-art models in the literature with an accuracy of 89.36%,F1-score of 0.88.6,andMatthews Correlation Coefficient(MCC)of 0.88.6.

Breast Cancer Diagnosis Using Feature Selection Approaches and Bayesian Optimization

Breast cancer seriously affects many women.If breast cancer is detected at an early stage,it may be cured.This paper proposes a novel classification model based improved machine learning algorithms for diagnosis of breast cancer at its initial stage.It has been used by combining feature selection and Bayesian optimization approaches to build improved machine learning models.Support Vector Machine,K-Nearest Neighbor,Naive Bayes,Ensemble Learning and Decision Tree approaches were used as machine learning algorithms.All experiments were tested on two different datasets,which are Wisconsin Breast Cancer Dataset(WBCD)and Mammographic Breast Cancer Dataset(MBCD).Experiments were implemented to obtain the best classification process.Relief,Least Absolute Shrinkage and Selection Operator(LASSO)and Sequential Forward Selection were used to determine the most relevant features,respectively.The machine learning models were optimized with the help of Bayesian optimization approach to obtain optimal hyperparameter values.Experimental results showed the unified feature selection-hyperparameter optimization method improved the classification performance in all machine learning algorithms.Among the various experiments,LASSO-BO-SVM showed the highest accuracy,precision,recall and F1-score for two datasets(97.95%,98.28%,98.28%,98.28%for MBCD and 98.95%,97.17%,100%,98.56%for MBCD),yielding outperforming results compared to recent studies.

Hand Gesture Recognition for Disabled People Using Bayesian Optimization with Transfer Learning

Sign language recognition can be treated as one of the efficient solu-tions for disabled people to communicate with others.It helps them to convey the required data by the use of sign language with no issues.The latest develop-ments in computer vision and image processing techniques can be accurately uti-lized for the sign recognition process by disabled people.American Sign Language(ASL)detection was challenging because of the enhancing intraclass similarity and higher complexity.This article develops a new Bayesian Optimiza-tion with Deep Learning-Driven Hand Gesture Recognition Based Sign Language Communication(BODL-HGRSLC)for Disabled People.The BODL-HGRSLC technique aims to recognize the hand gestures for disabled people’s communica-tion.The presented BODL-HGRSLC technique integrates the concepts of compu-ter vision(CV)and DL models.In the presented BODL-HGRSLC technique,a deep convolutional neural network-based residual network(ResNet)model is applied for feature extraction.Besides,the presented BODL-HGRSLC model uses Bayesian optimization for the hyperparameter tuning process.At last,a bidir-ectional gated recurrent unit(BiGRU)model is exploited for the HGR procedure.A wide range of experiments was conducted to demonstrate the enhanced perfor-mance of the presented BODL-HGRSLC model.The comprehensive comparison study reported the improvements of the BODL-HGRSLC model over other DL models with maximum accuracy of 99.75%.

Prediction of undrained shear strength using extreme gradient boosting and random forest based on Bayesian optimization

Accurate assessment of undrained shear strength(USS)for soft sensitive clays is a great concern in geotechnical engineering practice.This study applies novel data-driven extreme gradient boosting(XGBoost)and random forest(RF)ensemble learning methods for capturing the relationships between the USS and various basic soil parameters.Based on the soil data sets from TC304 database,a general approach is developed to predict the USS of soft clays using the two machine learning methods above,where five feature variables including the preconsolidation stress(PS),vertical effective stress(VES),liquid limit(LL),plastic limit(PL)and natural water content(W)are adopted.To reduce the dependence on the rule of thumb and inefficient brute-force search,the Bayesian optimization method is applied to determine the appropriate model hyper-parameters of both XGBoost and RF.The developed models are comprehensively compared with three comparison machine learning methods and two transformation models with respect to predictive accuracy and robustness under 5-fold cross-validation(CV).It is shown that XGBoost-based and RF-based methods outperform these approaches.Besides,the XGBoostbased model provides feature importance ranks,which makes it a promising tool in the prediction of geotechnical parameters and enhances the interpretability of model.

Rapid design of secondary deformation-aging parameters for ultra-low Co content Cu-Ni-Co-Si-X alloy via Bayesian optimization machine learning

It is difficult to rapidly design the process parameters of copper alloys by using the traditional trial-and-error method and simultaneously improve the conflicting mechanical and electrical properties.The purpose of this work is to develop a new type of Cu-Ni-Co-Si alloy saving scarce and expensive Co element,in which the Co content is less than half of the lower limit in ASTM standard C70350 alloy,while the properties are as the same level as C70350 alloy.Here we adopted a strategy combining Bayesian optimization machine learning and experimental iteration and quickly designed the secondary deformation-aging parameters(cold rolling deformation 90%,aging temperature 450℃,and aging time 1.25 h)of the new copper alloy with only 32 experiments(27 basic sample data acquisition experiments and 5 iteration experiments),which broke through the barrier of low efficiency and high cost of trial-and-error design of deformation-aging parameters in precipitation strengthened copper alloy.The experimental hardness,tensile strength,and electrical conductivity of the new copper alloy are HV(285±4),(872±3)MPa,and(44.2±0.7)%IACS(international annealed copper standard),reaching the property level of the commercial lead frame C70350 alloy.This work provides a new idea for the rapid design of material process parameters and the simultaneous improvement of mechanical and electrical properties.

Target distribution in cooperative combat based on Bayesian optimization algorithm

Target distribution in cooperative combat is a difficult and emphases. We build up the optimization model according to the rule of fire distribution. We have researched on the optimization model with BOA. The BOA can estimate the joint probability distribution of the variables with Bayesian network, and the new candidate solutions also can be generated by the joint distribution. The simulation example verified that the method could be used to solve the complex question, the operation was quickly and the solution was best.

Accelerated solution of the transmission maintenance schedule problem:a Bayesian optimization approach

To maximize the maintenance willingness of the owner of transmission lines,this study presents a transmission maintenance scheduling model that considers the energy constraints of the power system and the security constraints of on-site maintenance operations.Considering the computational complexity of the mixed integer programming(MIP)problem,a machine learning(ML)approach is presented to solve the transmission maintenance scheduling model efficiently.The value of the branching score factor value is optimized by Bayesian optimization(BO)in the proposed algorithm,which plays an important role in the size of the branch-and-bound search tree in the solution process.The test case in a modified version of the IEEE 30-bus system shows that the proposed algorithm can not only reach the optimal solution but also improve the computational efficiency.

Bayesian Optimization for Field-Scale Geological Carbon Storage

We present a framework that couples a high-fidelity compositional reservoir simulator with Bayesian optimization(BO)for injection well scheduling optimization in geological carbon sequestration.This work represents one of the first at tempts to apply BO and high-fidelity physics models to geological carbon storage.The implicit parallel accurate reservoir simulator(IPARS)is utilized to accurately capture the underlying physical processes during CO_(2)sequestration.IPARS provides a framework for several flow and mechanics models and thus supports both stand-alone and coupled simulations.In this work,we use the compositional flow module to simulate the geological carbon storage process.The compositional flow model,which includes a hysteretic three-phase relative permeability model,accounts for three major CO_(2)trapping mechanisms:structural trapping,residual gas trapping,and solubility trapping.Furthermore,IPARS is coupled to the International Business Machines(IBM)Corporation Bayesian Optimization Accelerator(BOA)for parallel optimizations of CO_(2)injection strategies during field-scale CO_(2)sequestration.BO builds a probabilistic surrogate for the objective function using a Bayesian machine learning algorithm-the Gaussian process regression,and then uses an acquisition function that leverages the uncertainty in the surrogate to decide where to sample.The IBM BOA addresses the three weaknesses of standard BO that limits its scalability in that IBM BOA supports parallel(batch)executions,scales better for high-dimensional problems,and is more robust to initializations.We demonstrate these merits by applying the algorithm in the optimization of the CO_(2)injection schedule in the Cranfield site in Mississippi,USA,using field data.The optimized injection schedule achieves 16%more gas storage volume and 56%less water/surfactant usage compared with the baseline.The performance of BO is compared with that of a genetic algorithm(GA)and a covariance matrix adaptation(CMA)-evolution strategy(ES).The results demonstrate the superior performance of BO,in that it achieves a competitive objective function value with over 60%fewer forward model evaluations.

Determination of the Pile Drivability Using Random Forest Optimized by Particle Swarm Optimization and Bayesian Optimizer

Driven piles are used in many geological environments as a practical and convenient structural component.Hence,the determination of the drivability of piles is actually of great importance in complex geotechnical applications.Conventional methods of predicting pile drivability often rely on simplified physicalmodels or empirical formulas,whichmay lack accuracy or applicability in complex geological conditions.Therefore,this study presents a practical machine learning approach,namely a Random Forest(RF)optimized by Bayesian Optimization(BO)and Particle Swarm Optimization(PSO),which not only enhances prediction accuracy but also better adapts to varying geological environments to predict the drivability parameters of piles(i.e.,maximumcompressive stress,maximum tensile stress,and blow per foot).In addition,support vector regression,extreme gradient boosting,k nearest neighbor,and decision tree are also used and applied for comparison purposes.In order to train and test these models,among the 4072 datasets collected with 17model inputs,3258 datasets were randomly selected for training,and the remaining 814 datasets were used for model testing.Lastly,the results of these models were compared and evaluated using two performance indices,i.e.,the root mean square error(RMSE)and the coefficient of determination(R2).The results indicate that the optimized RF model achieved lower RMSE than other prediction models in predicting the three parameters,specifically 0.044,0.438,and 0.146;and higher R2 values than other implemented techniques,specifically 0.966,0.884,and 0.977.In addition,the sensitivity and uncertainty of the optimized RF model were analyzed using Sobol sensitivity analysis and Monte Carlo(MC)simulation.It can be concluded that the optimized RF model could be used to predict the performance of the pile,and it may provide a useful reference for solving some problems under similar engineering conditions.

Bayesian optimization+XGBoost based life cycle carbon emission prediction for residential buildings—An example from Chengdu,China

The large amount of carbon emissions generated by buildings during their life cycle greatly impacts the environment and poses a considerable challenge to China’s carbon reduction efforts.The building design phase has the most significant potential to reduce building life-cycle carbon emissions(LCCO_(2)).However,the lack of detailed inventory data at the design stage makes calculating a building’s LCCO_(2) very difficult and complex.Therefore,accurate prediction of building LCCO_(2) at the design stage using relevant design factors is essential to reduce carbon emissions.This paper proposes an ensemble learning algorithm combining Bayesian optimization and extreme gradient boosting(BO-XGBoost)to predict LCCO_(2) accurately in residential buildings.First,this study collected and calculated the LCCO_(2) of 121 residential buildings in Chengdu,China.Second,a carbon emission prediction model was developed using XGBoost based on 15 design factors,and hyperparameter optimization was performed using the BO algorithm.Finally,the model performance was evaluated using two evaluation metrics,coefficient of determination(R2)and root mean square error(RMSE),and the prediction performance of other models was compared with that of the BO-XGBoost model.The results show that the RMSE of the proposed BO-XGBoost for predicting LCCO_(2) in residential buildings is at least 40%lower compared to other models.The method adopted in this study can help designers accurately predict building LCCO_(2) at the early design stage and provide methodological support for similar studies in the future.

Preparing quantum states by measurement-feedback control with Bayesian optimization

The preparation of quantum states is crucial for enabling quantum computations and simulations.In this work,we present a general framework for preparing ground states of many-body systems by combining the measurement-feedback control process(MFCP)with machine learning techniques.Specifically,we employ Bayesian optimization(BO)to enhance the efficiency of determining the measurement and feedback operators within the MFCP.As an illustration,we study the ground state preparation of the one-dimensional Bose−Hubbard model.Through BO,we are able to identify optimal parameters that can effectively drive the system towards low-energy states with a high probability across various quantum trajectories.Our results open up new directions for further exploration and development of advanced control strategies for quantum computations and simulations.

Estimation of the TBM advance rate under hard rock conditions using XGBoost and Bayesian optimization

The advance rate(AR)of a tunnel boring machine(TBM)under hard rock conditions is a key parameter in the successful implementation of tunneling engineering.In this study,we improved the accuracy of prediction models by employing a hybrid model of extreme gradient boosting(XGBoost)with Bayesian optimization(BO)to model the TBM AR.To develop the proposed models,1286 sets of data were collected from the Peng Selangor Raw Water Transfer tunnel project in Malaysia.The database consists of rock mass and intact rock features,including rock mass rating,rock quality designation,weathered zone,uniaxial compressive strength,and Brazilian tensile strength.Machine specifications,including revolution per minute and thrust force,were considered to predict the TBM AR.The accuracies of the predictive models were examined using the root mean squares error(RMSE)and the coefficient of determination(R^(2))between the observed and predicted yield by employing a five-fold cross-validation procedure.Results showed that the BO algorithm can capture better hyper-parameters for the XGBoost prediction model than can the default XGBoost model.The robustness and generalization of the BO-XGBoost model yielded prominent results with RMSE and R^(2) values of 0.0967 and 0.9806(for the testing phase),respectively.The results demonstrated the merits of the proposed BO-XGBoost model.In addition,variable importance through mutual information tests was applied to interpret the XGBoost model and demonstrated that machine parameters have the greatest impact as compared to rock mass and material properties.

Intelligent rockburst prediction model with sample category balance using feedforward neural network and Bayesian optimization

The rockburst prediction becomes more and more challenging due to the development of deep underground projects and constructions.Increasing numbers of intelligent algorithms are used to predict and prevent rockburst.This paper investigated the drawbacks of neural networks in rockburst prediction,and aimed at these shortcomings,Bayesian optimization and the synthetic minority oversampling technique+Tomek Link(SMOTETomek)were applied to efficiently develop the feedforward neural network(FNN)model for rockburst prediction.In this regard,314 real rockburst cases were collected to establish a database for modeling.The database was divided into a training set(80%)and a test set(20%).The maximum tangential stress,uniaxial compressive strength,tensile strength,stress ratio,brittleness ratio,and elastic strain energy were selected as input parameters.Bayesian optimization was implemented to find the optimal hyperparameters in FNN.To eliminate the effects of imbalanced category,SMOTETomek was adopted to process the training set to obtain a balanced training set.The FNN developed by the balanced training set received 90.48% accuracy in the test set,and the accuracy improved 12.7% compared to the imbalanced training set.For interpreting the FNN model,the permutation importance algorithm was introduced to analyze the relative importance of input variables.The elastic strain energy was the most essential variable,and some measures were proposed to prevent rockburst.To validate the practicability,the FNN developed by the balanced training set was utilized to predict rockburst in Sanshandao Gold Mine,China,and it had outstanding performance(accuracy 100%).

High-quality quasi-monochromatic near-field radiative heat transfer designed by adaptive hybrid Bayesian optimization

The increasing demand for versatile and high-quality near-field radiative heat transfer(NFRHT) has created a critical need for a design approach that can handle numerous candidate structures. In this work, we employ and develop an adaptive hybrid Bayesian optimization(AHBO) algorithm to design the high-quality quasi-monochromatic NFRHT. The candidate materials include hexagonal boron nitride, silicon carbide, and doped silicon. The high-quality quasi-monochromatic NFRHT is optimized over 1.0 × 10^(8) candidate structures to maximize the evaluation factor. It is worth noting that only 2.6% of the candidate structures needed to be calculated to identify the optimal structure. The optimal structure of quasi-monochromatic NFRHT is an aperiodic multilayer metamaterial that differs from conventional periodic multilayer structures. Moreover, we investigate the robustness and mechanisms of the optimal quasi-monochromatic NFRHT with respect to the vacuum gap distance and the temperature difference between the emitter and receiver. In addition, the high-quality multi-peak NFRHT is designed using the AHBO algorithm by improving the definition of the evaluation factor. The results demonstrate that the AHBO algorithm is efficient in designing high-quality quasi-monochromatic and multi-peak NFRHT, and it can be further expanded to other structural designs in the field of energy conversion.

Air Combat Assignment Problem Based on Bayesian Optimization Algorithm

In order to adapt to the changing battlefield situation and improve the combat effectiveness of air combat,the problem of air battle allocation based on Bayesian optimization algorithm(BOA)is studied.First,we discuss the number of fighters on both sides,and apply cluster analysis to divide our fighter into the same number of groups as the enemy.On this basis,we sort each of our fighters'different advantages to the enemy fighters,and obtain a series of target allocation schemes for enemy attacks by first in first serviced criteria.Finally,the maximum advantage function is used as the target,and the BOA is used to optimize the model.The simulation results show that the established model has certain decision-making ability,and the BOA can converge to the global optimal solution at a faster speed,which can effectively solve the air combat task assignment problem.

Exploiting Bivariate Dependencies to Speedup Structure Learning in Bayesian Optimization Algorithm

Bayesian optimization algorithm （BOA） is one of the successful and widely used estimation of distribution algorithms （EDAs） which have been employed to solve different optimization problems. In EDAs, a model is learned from the selected population that encodes interactions among problem variables. New individuals are generated by sampling the model and incorporated into the population. Different probabilistic models have been used in EDAs to learn interactions. Bayesian network （BN） is a well-known graphical model which is used in BOA. Learning a propel model in EDAs and particularly in BOA is distinguished as a computationally expensive task. Different methods have been proposed in the literature to improve the complexity of model building in EDAs. This paper employs bivariate dependencies to learn accurate BNs in BOA efficiently. The proposed approach extracts the bivariate dependencies using an appropriate pairwise interaction-detection metric. Due to the static structure of the underlying problems, these dependencies are used in each generation of BOA to learn an accurate network. By using this approach, the computational cost of model building is reduced dramatically. Various optimization problems are selected to be solved by the algorithm. The experimental results show that the proposed approach successfully finds the optimum in problems with different types of interactions efficiently. Significant speedups are observed in the model building procedure as well.

Bayesian optimization for active flow control

A key question in flow control is that of the design of optimal controllers when the control space is high-dimensional and the experimental or computational budget is limited.We address this formidable challenge using a particular flavor of machine learning and present the first application of Bayesian optimization to the design of open-loop controllers for fluid flows.We consider a range of acquisition functions,including the recently introduced output-informed criteria of Blanchard and Sapsis(2021),and evaluate performance of the Bayesian algorithm in two iconic configurations for active flow control:computationally,with drag reduction in the fluidic pinball;and experimentally,with mixing enhancement in a turbulent jet.For these flows,we find that Bayesian optimization identifies optimal controllers at a fraction of the cost of other optimization strategies considered in previous studies.Bayesian optimization also provides,as a by-product of the optimization,a surrogate model for the latent cost function,which can be leveraged to paint a complete picture of the control landscape.The proposed methodology can be used to design open-loop controllers for virtually any complex flow and,therefore,has significant implications for active flow control at an industrial scale.