Optimization of Artificial Viscosity in Production Codes Based on Gaussian Regression Surrogate Models

To accurately model flows with shock waves using staggered-grid Lagrangian hydrodynamics, the artificial viscosity has to be introduced to convert kinetic energy into internal energy, thereby increasing the entropy across shocks. Determining the appropriate strength of the artificial viscosity is an art and strongly depends on the particular problem and experience of the researcher. The objective of this study is to pose the problem of finding the appropriate strength of the artificial viscosity as an optimization problem and solve this problem using machine learning (ML) tools, specifically using surrogate models based on Gaussian Process regression (GPR) and Bayesian analysis. We describe the optimization method and discuss various practical details of its implementation. The shock-containing problems for which we apply this method all have been implemented in the LANL code FLAG (Burton in Connectivity structures and differencing techniques for staggered-grid free-Lagrange hydrodynamics, Tech. Rep. UCRL-JC-110555, Lawrence Livermore National Laboratory, Livermore, CA, 1992, 1992, in Consistent finite-volume discretization of hydrodynamic conservation laws for unstructured grids, Tech. Rep. CRL-JC-118788, Lawrence Livermore National Laboratory, Livermore, CA, 1992, 1994, Multidimensional discretization of conservation laws for unstructured polyhedral grids, Tech. Rep. UCRL-JC-118306, Lawrence Livermore National Laboratory, Livermore, CA, 1992, 1994, in FLAG, a multi-dimensional, multiple mesh, adaptive free-Lagrange, hydrodynamics code. In: NECDC, 1992). First, we apply ML to find optimal values to isolated shock problems of different strengths. Second, we apply ML to optimize the viscosity for a one-dimensional (1D) propagating detonation problem based on Zel’dovich-von Neumann-Doring (ZND) (Fickett and Davis in Detonation: theory and experiment. Dover books on physics. Dover Publications, Mineola, 2000) detonation theory using a reactive burn model. We compare results for default (currently used values in FLAG) and optimized values of the artificial viscosity for these problems demonstrating the potential for significant improvement in the accuracy of computations.

Prediction of cyanotic and acyanotic congenital heart disease using machine learning models

BACKGROUND Congenital heart disease is most commonly seen in neonates and it is a major cause of pediatric illness and childhood morbidity and mortality.AIM To identify and build the best predictive model for predicting cyanotic and acyanotic congenital heart disease in children during pregnancy and identify their potential risk factors.METHODS The data were collected from the Pediatric Cardiology Department at Chaudhry Pervaiz Elahi Institute of Cardiology Multan,Pakistan from December 2017 to October 2019.A sample of 3900 mothers whose children were diagnosed with identify the potential outliers.Different machine learning models were compared,and the best-fitted model was selected using the area under the curve,sensitivity,and specificity of the models.RESULTS Out of 3900 patients included,about 69.5%had acyanotic and 30.5%had cyanotic congenital heart disease.Males had more cases of acyanotic(53.6%)and cyanotic(54.5%)congenital heart disease as compared to females.The odds of having cyanotic was 1.28 times higher for children whose mothers used more fast food frequently during pregnancy.The artificial neural network model was selected as the best predictive model with an area under the curve of 0.9012,sensitivity of 65.76%,and specificity of 97.23%.CONCLUSION Children having a positive family history are at very high risk of having cyanotic and acyanotic congenital heart disease.Males are more at risk and their mothers need more care,good food,and physical activity during pregnancy.The best-fitted model for predicting cyanotic and acyanotic congenital heart disease is the artificial neural network.The results obtained and the best model identified will be useful for medical practitioners and public health scientists for an informed decision-making process about the earlier diagnosis and improve the health condition of children in Pakistan.

A Novel Self-Supervised Learning Network for Binocular Disparity Estimation

Two-dimensional endoscopic images are susceptible to interferences such as specular reflections and monotonous texture illumination,hindering accurate three-dimensional lesion reconstruction by surgical robots.This study proposes a novel end-to-end disparity estimation model to address these challenges.Our approach combines a Pseudo-Siamese neural network architecture with pyramid dilated convolutions,integrating multi-scale image information to enhance robustness against lighting interferences.This study introduces a Pseudo-Siamese structure-based disparity regression model that simplifies left-right image comparison,improving accuracy and efficiency.The model was evaluated using a dataset of stereo endoscopic videos captured by the Da Vinci surgical robot,comprising simulated silicone heart sequences and real heart video data.Experimental results demonstrate significant improvement in the network’s resistance to lighting interference without substantially increasing parameters.Moreover,the model exhibited faster convergence during training,contributing to overall performance enhancement.This study advances endoscopic image processing accuracy and has potential implications for surgical robot applications in complex environments.

The burden of upper motor neuron involvement is correlated with the bilateral limb involvement interval in patients with amyotrophic lateral sclerosis:a retrospective observational study

Amyotrophic lateral sclerosis is a rare neurodegenerative disease characterized by the involvement of both upper and lower motor neurons.Early bilateral limb involvement significantly affects patients'daily lives and may lead them to be confined to bed.However,the effect of upper and lower motor neuron impairment and other risk factors on bilateral limb involvement is unclear.To address this issue,we retrospectively collected data from 586 amyotrophic lateral sclerosis patients with limb onset diagnosed at Peking University Third Hospital between January 2020 and May 2022.A univariate analysis revealed no significant differences in the time intervals of spread in different directions between individuals with upper motor neuron-dominant amyotrophic lateral sclerosis and those with classic amyotrophic lateral sclerosis.We used causal directed acyclic graphs for risk factor determination and Cox proportional hazards models to investigate the association between the duration of bilateral limb involvement and clinical baseline characteristics in amyotrophic lateral sclerosis patients.Multiple factor analyses revealed that higher upper motor neuron scores(hazard ratio[HR]=1.05,95%confidence interval[CI]=1.01–1.09,P=0.018),onset in the left limb(HR=0.72,95%CI=0.58–0.89,P=0.002),and a horizontal pattern of progression(HR=0.46,95%CI=0.37–0.58,P<0.001)were risk factors for a shorter interval until bilateral limb involvement.The results demonstrated that a greater degree of upper motor neuron involvement might cause contralateral limb involvement to progress more quickly in limb-onset amyotrophic lateral sclerosis patients.These findings may improve the management of amyotrophic lateral sclerosis patients with limb onset and the prediction of patient prognosis.

Short Term Load Forecasting Using Subset Threshold Auto Regressive Model

The subset threshold auto regressive (SSTAR) model, which is capable of reproducing the limit cycle behavior of nonlinear time series, is introduced. The algorithm for fitting the sampled data with SSTAR model is proposed and applied to model and forecast power load. Numerical example verifies that desirable accuracy of short term load forecasting can be achieved by using the SSTAR model.

Diagnostics in generalized nonlinear models based on maximum L_q-likelihood estimation

In order to detect whether the data conforms to the given model, it is necessary to diagnose the data in the statistical way. The diagnostic problem in generalized nonlinear models based on the maximum Lq-likelihood estimation is considered. Three diagnostic statistics are used to detect whether the outliers exist in the data set. Simulation results show that when the sample size is small, the values of diagnostic statistics based on the maximum Lq-likelihood estimation are greater than the values based on the maximum likelihood estimation. As the sample size increases, the difference between the values of the diagnostic statistics based on two estimation methods diminishes gradually. It means that the outliers can be distinguished easier through the maximum Lq-likelihood method than those through the maximum likelihood estimation method.

Predicting the growth performance of growing-finishing pigs based on net energy and digestible lysine intake using multiple regression and artificial neural networks models

Backgrounds:Evaluating the growth performance of pigs in real-time is laborious and expensive,thus mathematical models based on easily accessible variables are developed.Multiple regression(MR)is the most widely used tool to build prediction models in swine nutrition,while the artificial neural networks(ANN)model is reported to be more accurate than MR model in prediction performance.Therefore,the potential of ANN models in predicting the growth performance of pigs was evaluated and compared with MR models in this study.Results:Body weight(BW),net energy(NE)intake,standardized ileal digestible lysine(SID Lys)intake,and their quadratic terms were selected as input variables to predict ADG and F/G among 10 candidate variables.In the training phase,MR models showed high accuracy in both ADG and F/G prediction(R^(2)_(ADG)=0.929,R^(2)_(F/G)=0.886)while ANN models with 4,6 neurons and radial basis activation function yielded the best performance in ADG and F/G prediction(R^(2)_(ADG)=0.964,R^(2)_(F/G)=0.932).In the testing phase,these ANN models showed better accuracy in ADG prediction(CCC:0.976 vs.0.861,R^(2):0.951 vs.0.584),and F/G prediction(CCC:0.952 vs.0.900,R^(2):0.905 vs.0.821)compared with the MR models.Meanwhile,the“over-fitting”occurred in MR models but not in ANN models.On validation data from the animal trial,ANN models exhibited superiority over MR models in both ADG and F/G prediction(P<0.01).Moreover,the growth stages have a significant effect on the prediction accuracy of the models.Conclusion:Body weight,NE intake and SID Lys intake can be used as input variables to predict the growth performance of growing-finishing pigs,with trained ANN models are more flexible and accurate than MR models.Therefore,it is promising to use ANN models in related swine nutrition studies in the future.

EFFICIENT ESTIMATION OF FUNCTIONAL-COEFFICIENT REGRESSION MODELS WITH DIFFERENT SMOOTHING VARIABLES

In this article,a procedure for estimating the coefficient functions on the functional-coefficient regression models with different smoothing variables in different coefficient functions is defined.First step,by the local linear technique and the averaged method,the initial estimates of the coefficient functions are given.Second step,based on the initial estimates,the efficient estimates of the coefficient functions are proposed by a one-step back-fitting procedure.The efficient estimators share the same asymptotic normalities as the local linear estimators for the functional-coefficient models with a single smoothing variable in different functions.Two simulated examples show that the procedure is effective.

Artificial neural network models predicting the leaf area index:a case study in pure even-aged Crimean pine forests from Turkey

Background: Leaf Area Index(LAI) is an important parameter used in monitoring and modeling of forest ecosystems. The aim of this study was to evaluate performance of the artificial neural network(ANN) models to predict the LAI by comparing the regression analysis models as the classical method in these pure and even-aged Crimean pine forest stands.Methods: One hundred eight temporary sample plots were collected from Crimean pine forest stands to estimate stand parameters. Each sample plot was imaged with hemispherical photographs to detect the LAI. The partial correlation analysis was used to assess the relationships between the stand LAI values and stand parameters, and the multivariate linear regression analysis was used to predict the LAI from stand parameters. Different artificial neural network models comprising different number of neuron and transfer functions were trained and used to predict the LAI of forest stands.Results: The correlation coefficients between LAI and stand parameters(stand number of trees, basal area, the quadratic mean diameter, stand density and stand age) were significant at the level of 0.01. The stand age, number of trees, site index, and basal area were independent parameters in the most successful regression model predicted LAI values using stand parameters(R_(adj)~2=0.5431). As corresponding method to predict the interactions between the stand LAI values and stand parameters, the neural network architecture based on the RBF 4-19-1 with Gaussian activation function in hidden layer and the identity activation function in output layer performed better in predicting LAI(SSE(12.1040), MSE(0.1223), RMSE(0.3497), AIC(0.1040), BIC(-77.7310) and R^2(0.6392)) compared to the other studied techniques.Conclusion: The ANN outperformed the multivariate regression techniques in predicting LAI from stand parameters. The ANN models, developed in this study, may aid in making forest management planning in study forest stands.

ON CONFIDENCE REGIONS OF SEMIPARAMETRIC NONLINEAR REGRESSION MODELS(A GEOMETRIC APPROACH)

A geometric framework is proposed for semiparametric nonlinear regression models based on the concept of least favorable curve, introduced by Severini and Wong (1992). The authors use this framework to drive three kinds of improved approximate confidence regions for the parameter and parameter subset in terms of curvatures. The results obtained by Hamilton et al. (1982), Hamilton (1986) and Wei (1994) are extended to semiparametric nonlinear regression models.

Evaluation of Inference Adequacy in Cumulative Logistic Regression Models:An Empirical Validation of ISW-Ridge Relationships

Internal solitary wave propagation over a submarine ridge results in energy dissipation, in which the hydrodynamic interaction between a wave and ridge affects marine environment. This study analyzes the effects of ridge height and potential energy during wave-ridge interaction with a binary and cumulative logistic regression model. In testing the Global Null Hypothesis, all values are p 〈0.001, with three statistical methods, such as Likelihood Ratio, Score, and Wald. While comparing with two kinds of models, tests values obtained by cumulative logistic regression models are better than those by binary logistic regression models. Although this study employed cumulative logistic regression model, three probability functions p^1, p^2 and p^3, are utilized for investigating the weighted influence of factors on wave reflection. Deviance and Pearson tests are applied to cheek the goodness-of-fit of the proposed model. The analytical results demonstrated that both ridge height （X1 ） and potential energy （X2 ） significantly impact （p 〈 0. 0001 ） the amplitude-based refleeted rate; the P-values for the deviance and Pearson are all 〉 0.05 （0.2839, 0.3438, respectively）. That is, the goodness-of-fit between ridge height （ X1 ） and potential energy （X2） can further predict parameters under the scenario of the best parsimonious model. Investigation of 6 predictive powers （ R2, Max-rescaled R^2, Sorners＇ D, Gamma, Tau-a, and c, respectively） indicate that these predictive estimates of the proposed model have better predictive ability than ridge height alone, and are very similar to the interaction of ridge height and potential energy. It can be concluded that the goodness-of-fit and prediction ability of the cumulative logistic regression model are better than that of the binary logistic regression model.

Comparative Study on Deformation Prediction Models of Wuqiangxi Concrete Gravity Dam Based on Monitoring Data

The deformation prediction models of Wuqiangxi concrete gravity dam are developed,including two statistical models and a deep learning model.In the statistical models,the reliable monitoring data are firstly determined with Lahitte criterion;then,the stepwise regression and partial least squares regression models for deformation prediction of concrete gravity dam are constructed in terms of the reliable monitoring data,and the factors of water pressure,temperature and time effect are considered in the models;finally,according to the monitoring data from 2006 to 2020 of five typical measuring points including J23(on dam section 24^(#)),J33(on dam section 4^(#)),J35(on dam section 8^(#)),J37(on dam section 12^(#)),and J39(on dam section 15^(#))located on the crest of Wuqiangxi concrete gravity dam,the settlement curves of the measuring points are obtained with the stepwise regression and partial least squares regression models.A deep learning model is developed based on long short-term memory(LSTM)recurrent neural network.In the LSTM model,two LSTMlayers are used,the rectified linear unit function is adopted as the activation function,the input sequence length is 20,and the random search is adopted.The monitoring data for the five typical measuring points from 2006 to 2017 are selected as the training set,and the monitoring data from 2018 to 2020 are taken as the test set.From the results of case study,we can find that(1)the good fitting results can be obtained with the two statistical models;(2)the partial least squares regression algorithm can solve the model with high correlation factors and reasonably explain the factors;(3)the prediction accuracy of the LSTM model increases with increasing the amount of training data.In the deformation prediction of concrete gravity dam,the LSTM model is suggested when there are sufficient training data,while the partial least squares regression method is suggested when the training data are insufficient.

Selection of regression models for predicting strength and deformability properties of rocks using GA

Recently,many regression models have been presented for prediction of mechanical parameters of rocks regarding to rock index properties.Although statistical analysis is a common method for developing regression models,but still selection of suitable transformation of the independent variables in a regression model is diffcult.In this paper,a genetic algorithm(GA)has been employed as a heuristic search method for selection of best transformation of the independent variables(some index properties of rocks)in regression models for prediction of uniaxial compressive strength(UCS)and modulus of elasticity(E).Firstly,multiple linear regression(MLR)analysis was performed on a data set to establish predictive models.Then,two GA models were developed in which root mean squared error(RMSE)was defned as ftness function.Results have shown that GA models are more precise than MLR models and are able to explain the relation between the intrinsic strength/elasticity properties and index properties of rocks by simple formulation and accepted accuracy.

A skew–normal mixture of joint location, scale and skewness models

Normal mixture regression models are one of the most important statistical data analysis tools in a heterogeneous population. When the data set under consideration involves asymmetric outcomes, in the last two decades, the skew normal distribution has been shown beneficial in dealing with asymmetric data in various theoretic and applied problems. In this paper, we propose and study a novel class of models： a skew-normal mixture of joint location, scale and skewness models to analyze the heteroscedastic skew-normal data coming from a heterogeneous population. The issues of maximum likelihood estimation are addressed. In particular, an Expectation-Maximization （EM） algorithm for estimating the model parameters is developed. Properties of the estimators of the regression coefficients are evaluated through Monte Carlo experiments. Results from the analysis of a real data set from the Body Mass Index （BMI） data are presented.

A COMPARISON OF FORECASTING MODELS OF THE VOLATILITY IN SHENZHEN STOCK MARKET

Based on the weekly closing price of Shenzhen Integrated Index, this article studies the volatility of Shenzhen Stock Market using three different models： Logistic, AR（1） and AR（2）. The time-variable parameters of Logistic regression model is estimated by using both the index smoothing method and the time-variable parameter estimation method. And both the AR（1） model and the AR（2） model of zero-mean series of the weekly dosing price and its zero-mean series of volatility rate are established based on the analysis results of zero-mean series of the weekly closing price, Six common statistical methods for error prediction are used to test the predicting results. These methods are： mean error （ME）, mean absolute error （MAE）, root mean squared error （RMSE）, mean absolute percentage error （MAPE）, Akaike＇s information criterion （AIC）, and Bayesian information criterion （BIC）. The investigation shows that AR（1） model exhibits the best predicting result, whereas AR（2） model exhibits predicting results that is intermediate between AR（1） model and the Logistic regression model.

STRONG CONVERGENCE RATES OF SEVERAL ESTIMATORS IN SEMIPARAMETRIC VARYING-COEFFICIENT PARTIALLY LINEAR MODELS

This article is concerned with the estimating problem of semiparametric varyingcoefficient partially linear regression models. By combining the local polynomial and least squares procedures Fan and Huang （2005） proposed a profile least squares estimator for the parametric component and established its asymptotic normality. We further show that the profile least squares estimator can achieve the law of iterated logarithm. Moreover, we study the estimators of the functions characterizing the non-linear part as well as the error variance. The strong convergence rate and the law of iterated logarithm are derived for them, respectively.

COVID‑19 and tourism sector stock price in Spain:medium‑term relationship through dynamic regression models

The global pandemic,coronavirus disease 2019(COVID-19),has significantly affected tourism,especially in Spain,as it was among the first countries to be affected by the pandemic and is among the world’s biggest tourist destinations.Stock market values are responding to the evolution of the pandemic,especially in the case of tourist companies.Therefore,being able to quantify this relationship allows us to predict the effect of the pandemic on shares in the tourism sector,thereby improving the response to the crisis by policymakers and investors.Accordingly,a dynamic regression model was developed to predict the behavior of shares in the Spanish tourism sector according to the evolution of the COVID-19 pandemic in the medium term.It has been confirmed that both the number of deaths and cases are good predictors of abnormal stock prices in the tourism sector.

Effects of modeling means on properties of monitoring models of spot welding quality

Analyzing and modeling the relation between monitoring information during welding and quality information of the joints is the foundation of monitoring resistance spot welding quality. According to the means of modeling, the known models can be divided into three large categories: single linear regression models, multiple linear regression models and multiple non linear models. By modeling the relations between dynamic resistance information and welding quality parameters with different means, this paper analyzes effects of modeling means on performances of monitoring models of resistance spot welding quality. From the test results, the following conclusions can be drawn: By comparison with two other kinds of models, artificial neural network (ANN) model can describe non linear and high coupling relationship between monitoring information and quality information more reasonably, improve performance of monitoring model remarkably, and make the estimated values of welding quality parameters more accurate and reliable.

Establishment and Analysis of Regression Models between Sowing Time and Plant Productivity, Biological Yield of Forage Sorghum in Autumn Idle Land

[Objective]The aim was to establish the linear regression prediction models between sowing time and plant productivity, biological yield of forage sorghum in autumn idle land.[Method]The relationships between sowing time and plant productivity, biological yield of forage sorghum were simulated and compared by using field experiment and linear regression analysis.[Result] The sowing time had an important influence on the plant productivity and biological yield of forage sorghum in autumn idle land. The plant productivity and biological yield of forage sorghum both decreased with the delay of sowing time.The regression model between plant fresh weight and sowing time was ？fresh=0.618-0.015x; the regression model between plant dry weight and sowing time was ？dry=0.184-0.005x; and the regression model between biological yield and sowing time was yield=29 126.461-711.448x. During July 23rd to August 30th, when the sowing time was delayed by 1 day, the plant fresh weight of forage sorghum was reduced by 0.015 g, the plant dry weight was reduced by 0.005 g, and the yield was reduced by 711.448 kg/hm2. [Conclusion] The three regression models established in this study will provide theoretical support for the production of forage sorghum.

Asymptotic Property for the Estimator of Nonparametric Regression Models Under Negatively Orthant Dependent Errors

In this paper, by using some inequalities of negatively orthant dependent(NOD,in short) random variables and the truncated method of random variables, we investigate the nonparametric regression model. The complete consistency result for the estimator of g(x) is presented.