Optimization of Artificial Viscosity in Production Codes Based on Gaussian Regression Surrogate Models

To accurately model flows with shock waves using staggered-grid Lagrangian hydrodynamics, the artificial viscosity has to be introduced to convert kinetic energy into internal energy, thereby increasing the entropy across shocks. Determining the appropriate strength of the artificial viscosity is an art and strongly depends on the particular problem and experience of the researcher. The objective of this study is to pose the problem of finding the appropriate strength of the artificial viscosity as an optimization problem and solve this problem using machine learning (ML) tools, specifically using surrogate models based on Gaussian Process regression (GPR) and Bayesian analysis. We describe the optimization method and discuss various practical details of its implementation. The shock-containing problems for which we apply this method all have been implemented in the LANL code FLAG (Burton in Connectivity structures and differencing techniques for staggered-grid free-Lagrange hydrodynamics, Tech. Rep. UCRL-JC-110555, Lawrence Livermore National Laboratory, Livermore, CA, 1992, 1992, in Consistent finite-volume discretization of hydrodynamic conservation laws for unstructured grids, Tech. Rep. CRL-JC-118788, Lawrence Livermore National Laboratory, Livermore, CA, 1992, 1994, Multidimensional discretization of conservation laws for unstructured polyhedral grids, Tech. Rep. UCRL-JC-118306, Lawrence Livermore National Laboratory, Livermore, CA, 1992, 1994, in FLAG, a multi-dimensional, multiple mesh, adaptive free-Lagrange, hydrodynamics code. In: NECDC, 1992). First, we apply ML to find optimal values to isolated shock problems of different strengths. Second, we apply ML to optimize the viscosity for a one-dimensional (1D) propagating detonation problem based on Zel’dovich-von Neumann-Doring (ZND) (Fickett and Davis in Detonation: theory and experiment. Dover books on physics. Dover Publications, Mineola, 2000) detonation theory using a reactive burn model. We compare results for default (currently used values in FLAG) and optimized values of the artificial viscosity for these problems demonstrating the potential for significant improvement in the accuracy of computations.

Operational optimization of copper flotation process based on the weighted Gaussian process regression and index-oriented adaptive differential evolution algorithm

Concentrate copper grade(CCG)is one of the important production indicators of copper flotation processes,and keeping the CCG at the set value is of great significance to the economic benefit of copper flotation industrial processes.This paper addresses the fluctuation problem of CCG through an operational optimization method.Firstly,a density-based affinity propagationalgorithm is proposed so that more ideal working condition categories can be obtained for the complex raw ore properties.Next,a Bayesian network(BN)is applied to explore the relationship between the operational variables and the CCG.Based on the analysis results of BN,a weighted Gaussian process regression model is constructed to predict the CCG that a higher prediction accuracy can be obtained.To ensure the predicted CCG is close to the set value with a smaller magnitude of the operation adjustments and a smaller uncertainty of the prediction results,an index-oriented adaptive differential evolution(IOADE)algorithm is proposed,and the convergence performance of IOADE is superior to the traditional differential evolution and adaptive differential evolution methods.Finally,the effectiveness and feasibility of the proposed methods are verified by the experiments on a copper flotation industrial process.

Optimization of Generator Based on Gaussian Process Regression Model with Conditional Likelihood Lower Bound Search

The noise that comes from finite element simulation often causes the model to fall into the local optimal solution and over fitting during optimization of generator.Thus,this paper proposes a Gaussian Process Regression(GPR)model based on Conditional Likelihood Lower Bound Search(CLLBS)to optimize the design of the generator,which can filter the noise in the data and search for global optimization by combining the Conditional Likelihood Lower Bound Search method.Taking the efficiency optimization of 15 kW Permanent Magnet Synchronous Motor as an example.Firstly,this method uses the elementary effect analysis to choose the sensitive variables,combining the evolutionary algorithm to design the super Latin cube sampling plan;Then the generator-converter system is simulated by establishing a co-simulation platform to obtain data.A Gaussian process regression model combing the method of the conditional likelihood lower bound search is established,which combined the chi-square test to optimize the accuracy of the model globally.Secondly,after the model reaches the accuracy,the Pareto frontier is obtained through the NSGA-II algorithm by considering the maximum output torque as a constraint.Last,the constrained optimization is transformed into an unconstrained optimizing problem by introducing maximum constrained improvement expectation(CEI)optimization method based on the re-interpolation model,which cross-validated the optimization results of the Gaussian process regression model.The above method increase the efficiency of generator by 0.76%and 0.5%respectively;And this method can be used for rapid modeling and multi-objective optimization of generator systems.

Optimization of causative factors using logistic regression and artificial neural network models for landslide susceptibility assessment in Ujung Loe Watershed, South Sulawesi Indonesia

Landslide susceptibility maps(LSMs) play a vital role in assisting land use planning and risk mitigation. This study aims to optimize causative factors using logistic regression(LR) and an artificial neural network(ANN) to produce a LSM. The LSM is produced with 11 causative factors and then optimized using forward-stepwise LR(FSLR), ANN, and their combination(FSLR-ANN) until eight causative factors were found for each method. The ANN method produced superior validation results compared with LR. The ROC values for the training data set ranges between 0.8 and 0.9. On the other hand, validation with the percentage of landslide fall into LSM class high and very high, ANN method was higher(92.59%) than LR(82.12%). FSLR-ANN with nine causative factors gave the best validation results with respect to area under curve(AUC) values, and validation with the percentage of landslide fall into LSM class high and very high. In conclusion, ANN was found to be better than LR when producing LSMs. The best Optimization was combination of FSLR-ANN with nine causative factors and AUC success rate 0.847, predictive rate 0.844 and validation with landslide fall into high and very high class with 91.30%. It is an encouraging preliminary model towards a systematic introduction of FSLR-ANN model for optimization causative factors in landslide susceptibility assessment in the mountainous area of Ujung Loe Watershed.

Parameter selection of support vector regression based on hybrid optimization algorithm and its application

Choosing optimal parameters for support vector regression （SVR） is an important step in SVR. design, which strongly affects the pefformance of SVR. In this paper, based on the analysis of influence of SVR parameters on generalization error, a new approach with two steps is proposed for selecting SVR parameters, First the kernel function and SVM parameters are optimized roughly through genetic algorithm, then the kernel parameter is finely adjusted by local linear search, This approach has been successfully applied to the prediction model of the sulfur content in hot metal. The experiment results show that the proposed approach can yield better generalization performance of SVR than other methods,

A Metamodeling Method Based on Support Vector Regression for Robust Optimization

Metamodeling techniques have been used in robust optimization to reduce the high computational cost of the uncertainty analysis and improve the performance of robust optimization problems with computationally expensive simulation models. Existing metamodels main focus on polynomial regression（PR）, neural networks（NN） and Kriging models, these metamodels are not well suited for large-scale robust optimization problems with small size training sets and high nonlinearity. To address the problem, a reduced approximation model technique based on support vector regression（SVR） is introduced in order to improve the accuracy of metamodels. A robust optimization method based on SVR is presented for problems that involve high dimension and nonlinear. First appropriate design parameter samples are selected by experimental design theories, then the response samples are obtained from the simulations such as finite element analysis, the SVR metamodel is constructed and treated as the mean and the variance of the objective performance functions. Combining other constraints, the robust optimization model is formed which can be solved by genetic algorithm （GA）. The applicability of the method developed is demonstrated using a case of two-bar structure system study. The performances of SVR were compared with those of PR, Kriging and back-propagation neural networks（BPNN）, the comparison results show that the prediction accuracy of the SVR metamodel was higher than those of other metamodels under uncertainty. The robust optimization solutions are near to the real result, and the proposed method is found to be accurate and efficient for robust optimization. This reaserch provides an efficient method for robust optimization problems with complex structure.

Labyrinth Seal Design Optimization Based on Quadratic Regression Orthogonal Experiment

The influence of labyrinth seal structure parameters and their interaction on the characteristics of leakage amount are numerically investigated by conducting a quadratic regression orthogonal experiment. To determine the optimal structure parameters of the steam seal for minimizing the leakage amount, a reliable regression equation that does not lack of fit is established. The flow characteristics of the fluid in the labyrinth seal are analyzed in detail. Results show that the leakage amount is greatly influenced by seal cavity depth, convex platform height, seal tooth thickness, and tooth tip clearance, with the tip clearance having the most significant effect. The interaction among the four items exerts a certain impact on the leakage amount. The proposed regression equation exhibits a good significance and does not lack of fit. After optimization, the labyrinth seal demonstrates increased entropy and energy dissipation at the tip of the seal tooth, as well as decreased speed and inertia effect in the cavity, suggesting that the resistance leakage performance of the optimized labyrinth seal is improved.

Regression-Tensor Modeling of Multivariate Optimization of Process for Applying Metal Coatings

A universal regression-tensor approach is developed in the mathematical modeling of optimal parameters of chemical-technological process of complex mechanical products. The testing of developed algorithms was performed on the example of multi-factorial process of low-temperature sulfur-chromium plating of precision mechanical parts.

Optimization of Blasting Parameters Using Regression Models in Ratcon and NSCE Granite Quarries, Ibadan, Oyo State, Nigeria

This research examines optimization of blasting parameters for economic production of granite aggregates in Ratcon and NSCE quarries located atIbadan,OyoState. Samples were collected from the study areas for the determination of rock density and porosity. Schmidt hammer was used for in situ determination of rock hardness. Uniaxial compressive strength of in situ rock was estimated from the values obtained from Schmidt hammer rebound hardness test and density determined from laboratory test. Blasting data were collected from the study areas for optimization. Multiple regression analysis using computer aided solution SPSS (Statistical Package for the Social Sciences) was used to analyse data obtained from the laboratory test, field test and the study areas. The estimated mean uniaxial compressive strength value of NSCE is 240 MPa and that of Ratcon is 200 MPa and their average densities and average porosities are2.63g/cm3,2.55g/cm3, 1.88% and 2.25% respectively. Eleven parameters were input into the multiple regression analysis to generate the models. Two parameters out of eleven input parameters such as geometric volume of blast (Y1) and number of boulders generated after blasting (Y2) were dependent variables and the remaining nine such as X1 (Drill hole diameter), X2 (Drill hole depth), X3 (Spacing), X4 (Burden), X5 (Average charge per hole), X6 (Rock density), X7 (Porosity), X8 (Uniaxial compressive strength) and X9 (Specific charge) were input as independent variables. The results of the models show that out of the nine independent variables seven of them that is X1 (Borehole diameter), X2 (Borehole depth), X3 (Spacing), X4 (Burden), X5 (Average charge per hole), X8 (Uniaxial compressive strength) and X9 (Specific charge) have significant contribution to the models while X6 (Rock Density) and X7 (Porosity) have insignificant contribution they are therefore automatically deleted by the SPSS. The result of the models developed for the optimization reveals that blasting number 5 gives the required product at lowest possible cost. From the result, the cost of secondary blasting has been reduced and volume of the blasted rock has been increased with low cost of explosives, the parameters that give this result have been chosen as optimum parameters.

Performance Prediction of Switched Reluctance Motor using Improved Generalized Regression Neural Networks for Design Optimization

Since practical mathematical model for the design optimization of switched reluctance motor(SRM)is difficult to derive because of the strong nonlinearity,precise prediction of electromagnetic characteristics is of great importance during the optimization procedure.In this paper,an improved generalized regression neural network(GRNN)optimized by fruit fly optimization algorithm(FOA)is proposed for the modeling of SRM that represent the relationship of torque ripple and efficiency with the optimization variables,stator pole arc,rotor pole arc and rotor yoke height.Finite element parametric analysis technology is used to obtain the sample data for GRNN training and verification.Comprehensive comparisons and analysis among back propagation neural network(BPNN),radial basis function neural network(RBFNN),extreme learning machine(ELM)and GRNN is made to test the effectiveness and superiority of FOA-GRNN.

Constrained Run-to-Run Optimization for Batch Process Based on Support Vector Regression Model

An iterative (run-to-run) optimization method was presented for batch processes under input constraints. Generally it is very difficult to acquire an accurate mechanistic model for a batch process.Because support vector machine is powerful for the problems characterized by small samples,nonlinearity, high dimension and local minima, support vector regression models were developed for the end-point optimization of batch processes. Since there is no analytical way to find the optimal trajectory, an iterative method was used to exploit the repetitive nature of batch processes to determine the optimal operating policy. The optimization algorithm is proved convergent. The numerical simulation shows that the method can improve the process performance through iterations.

Development of a particle swarm optimization based support vector regression model for titanium dioxide band gap characterization

Energy band gap of titanium dioxide(TiO_2) semiconductor plays significant roles in many practical applications of the semiconductor and determines its appropriateness in technological and industrial applications such as UV absorption, pigment,photo-catalysis, pollution control systems and solar cells among others. Substitution of impurities into crystal lattice structure is the most commonly used method of tuning the band gap of TiO_2 for specific application and eventually leads to lattice distortion. This work utilizes the distortion in the lattice structure to estimate the band gap of doped TiO_2, for the first time, through hybridization of a particle swarm optimization algorithm(PSO) with a support vector regression(SVR) algorithm for developing a PSO-SVR model. The precision and accuracy of the developed PSO-SVR model was further justified by applying the model for estimating the effect of cobalt-sulfur co-doping, nickel-iodine co-doping, tungsten and indium doping on the band gap of TiO_2 and excellent agreement with the experimentally reported values was achieved. Practical implementation of the proposed PSO-SVR model would further widen the applications of the semiconductor and reduce the experimental stress involved in band gap determination of TiO_2.

Medium Term Load Forecasting for Jordan Electric Power System Using Particle Swarm Optimization Algorithm Based on Least Square Regression Methods

This paper presents a technique for Medium Term Load Forecasting (MTLF) using Particle Swarm Optimization (PSO) algorithm based on Least Squares Regression Methods to forecast the electric loads of the Jordanian grid for year of 2015. Linear, quadratic and exponential forecast models have been examined to perform this study and compared with the Auto Regressive (AR) model. MTLF models were influenced by the weather which should be considered when predicting the future peak load demand in terms of months and weeks. The main contribution for this paper is the conduction of MTLF study for Jordan on weekly and monthly basis using real data obtained from National Electric Power Company NEPCO. This study is aimed to develop practical models and algorithm techniques for MTLF to be used by the operators of Jordan power grid. The results are compared with the actual peak load data to attain minimum percentage error. The value of the forecasted weekly and monthly peak loads obtained from these models is examined using Least Square Error (LSE). Actual reported data from NEPCO are used to analyze the performance of the proposed approach and the results are reported and compared with the results obtained from PSO algorithm and AR model.

Parameters optimization for exponentially weighted moving average control chart using generalized regression neural network

As a useful alternative of Shewhart control chart, exponentially weighted moving average （EWMA） control chat has been applied widely to quality control, process monitoring, forecast, etc. In this paper, a method was introduced for optimal design of EWMA and multivariate EWMA （MEWMA） control charts, in which the optimal parameter pair （ λ, k） or （ λ, h ） was searched by using the generalized regression neural network （GRNN）. The results indicate that the optimal parameter pair can be obtained effectively by the proposed strategy for a given in-control average running length （ARLo） and shift to detect under any conditions, removing the drawback of incompleteness existing in the tables that had been reported.

Prediction of Wind Speed Using a Hybrid Regression-Optimization Approach

Predicting wind speed is a complex task that involves analyzing various meteorological factors such as temperature, humidity, atmospheric pressure, and topography. There are different approaches that can be used to predict wind speed, and a hybrid optimization approach is one of them. In this paper, the hybrid optimization approach combines a multiple linear regression approach with an optimization technique to achieve better results. In the context of wind speed prediction, this hybrid optimization approach can be used to improve the accuracy of existing prediction models. Here, a Grey Wolf Optimizer based Wind Speed Prediction (GWO-WSP) method is proposed. This approach is tested on the 2016, 2017, 2018, and 2019 Raw Data files from the Great Lakes Environmental Research Laboratories and the National Oceanic and Atmospheric Administration’s (GLERL-NOAA) Chicago Metadata Archive. The test results show that the implementation is successful and the approach yields accurate and feasible results. The computation time for execution of the algorithm is also superior compared to the existing methods in literature.

State of health prediction for lithium-ion batteries based on ensemble Gaussian process regression

The performance of lithium-ion batteries(LIBs)gradually declines over time,making it critical to predict the battery’s state of health(SOH)in real-time.This paper presents a model that incorporates health indicators and ensemble Gaussian process regression(EGPR)to predict the SOH of LIBs.Firstly,the degradation process of an LIB is analyzed through indirect health indicators(HIs)derived from voltage and temperature during discharge.Next,the parameters in the EGPR model are optimized using the gannet optimization algorithm(GOA),and the EGPR is employed to estimate the SOH of LIBs.Finally,the proposed model is tested under various experimental scenarios and compared with other machine learning models.The effectiveness of EGPR model is demonstrated using the National Aeronautics and Space Administration(NASA)LIB.The root mean square error(RMSE)is maintained within 0.20%,and the mean absolute error(MAE)is below 0.16%,illustrating the proposed approach’s excellent predictive accuracy and wide applicability.

Method for test case selection and execution of web application regression testing

In order to improve the efficiency of regression testing in web application,the control flow graph and the greedy algorithm are adopted.This paper considers a web page as a basic unit and introduces a test case selection method for web application regression testing based on the control flow graph.This method is safe enough to the test case selection.On the base of features of request sequence in web application,the minimization technique and the priority of test cases are taken into consideration in the process of execution of test cases in regression testing for web application.The improved greedy algorithm is also raised resulting in optimization of execution of test cases.The experiments indicate that the number of test cases which need to be retested is reduced,and the efficiency of execution of test cases is also improved.

LIMITING BEHAVIOR OF RECURSIVE M-ESTIMATORS IN MULTIVARIATE LINEAR REGRESSION MODELS AND THEIR ASYMPTOTIC EFFICIENCIES

Recursive algorithms are very useful for computing M-estimators of regression coefficients and scatter parameters. In this article, it is shown that for a nondecreasing ul （t）, under some mild conditions the recursive M-estimators of regression coefficients and scatter parameters are strongly consistent and the recursive M-estimator of the regression coefficients is also asymptotically normal distributed. Furthermore, optimal recursive M-estimators, asymptotic efficiencies of recursive M-estimators and asymptotic relative efficiencies between recursive M-estimators of regression coefficients are studied.

Combined model based on optimized multi-variable grey model and multiple linear regression

The construction method of background value is improved in the original multi-variable grey model （MGM（1,m）） from its source of construction errors. The MGM（1,m） with optimized background value is used to eliminate the random fluctuations or errors of the observational data of all variables, and the combined prediction model together with the multiple linear regression is established in order to improve the simulation and prediction accuracy of the combined model. Finally, a combined model of the MGM（1,2） with optimized background value and the binary linear regression is constructed by an example. The results show that the model has good effects for simulation and prediction.

Novel algorithm for constructing support vector machine regression ensemble

A novel algorithm for constructing support vector machine regression ensemble is proposed. As to regression prediction, support vector machine regression （SVMR） ensemble is proposed by resampling from given training data sets repeatedly and aggregating several independent SVMRs, each of which is trained to use a replicated training set. After training, several independently trained SVMRs need to be aggregated in an appropriate combination manner. Generally, the linear weighting is usually used like expert weighting score in Boosting Regression and it is without optimization capacity. Three combination techniques are proposed, including simple arithmetic mean, linear least square error weighting and nonlinear hierarchical combining that uses another upper-layer SVMR to combine several lower-layer SVMRs. Finally, simulation experiments demonstrate the accuracy and validity of the presented algorithm.