A predictive model of the relationship between hematology,urine,clinical examination and the occurrence of depression risk are established based on machine learning

Background:Depression is a kind of emotional disorders caused by a variety of factors,with the accelerating pace of life,people in life and work facing competition pressure is increasing,the incidence of depression is increasing year by year,so the in-depth study of the pathogenesis of depression,and the development of depression risk prediction model is becoming increasingly important.Method:This study data is derived from the 2017–2018 follow-up data from the National Health and Nutrition Examination Survey database,a publicly available database using a multi-stage,hierarchical,clustered,probability sampling design to determine a nationally representative sample of non-institutionalized US civilians.Participants completed home interviews,laboratory measurements,and a physical examination.Details of the survey design have been published previously.This study evaluated the risk factors for the occurrence of depression from this study from multiple variables such as age,sex,and combined complications.Four machine learning algorithms(logistic regression,Lasso regression,support vector machine,random forest)were used to establish predictive classification models and compare the area under the subject operating feature curve and accuracy.The dataset was validated using a 10-fold cross-validation.Result:We excluded the invalid samples for 815 included samples,of which 570 cases were divided into the validation set and 245 cases were divided into the training set.The area under the curve(AUC)of Nomogram establishing risk of depression based on logistic regression was 0.73.Among the three machine learning models,the Lasso regression-based model AUC was 0.548,a mean AUC for support vector machines was 0.695,and a random forest AUC of 0.613.The support vector machines-based model predicted the best performance compared to other machine models.Conclusion:Random forest-based prediction models are able to assist clinicians in providing decision support when it is difficult to give an exact diagnosis.The model has good clinical utility and facilitates clinicians to identify high-risk patients and perform individualized treatment.The established four models of logistic regression,Lasso regression,support vector machine,and random forest all have good predictive power.

Endpoint Prediction of EAF Based on Multiple Support Vector Machines

The endpoint parameters are very important to the process of EAF steel-making, but their on-line measurement is difficult. The soft sensor technology is widely used for the prediction of endpoint parameters. Based on the analysis of the smelting process of EAF and the advantages of support vector machines, a soft sensor model for predicting the endpoint parameters was built using multiple support vector machines （MSVM）. In this model, the input space was divided by subtractive clustering and a sub-model based on LS-SVM was built in each sub-space. To decrease the correlation among the sub-models and to improve the accuracy and robustness of the model, the sub- models were combined by Principal Components Regression. The accuracy of the soft sensor model is perfectly improved. The simulation result demonstrates the practicability and efficiency of the MSVM model for the endpoint prediction of EAF.

Nonlinear Model Predictive Control Based on Support Vector Machine with Multi-kernel

Multi-kernel-based support vector machine （SVM） model structure of nonlinear systems and its specific identification method is proposed, which is composed of a SVM with linear kernel function followed in series by a SVM with spline kernel function. With the help of this model, nonlinear model predictive control can be transformed to linear model predictive control, and consequently a unified analytical solution of optimal input of multi-step-ahead predictive control is possible to derive. This algorithm does not require online iterative optimization in order to be suitable for real-time control with less calculation. The simulation results of pH neutralization process and CSTR reactor show the effectiveness and advantages of the presented algorithm.

Casing life prediction using Borda and support vector machine methods

Eight casing failure modes and 32 risk factors in oil and gas wells are given in this paper. According to the quantitative analysis of the influence degree and occurrence probability of risk factors, the Borda counts for failure modes are obtained with the Borda method. The risk indexes of failure modes are derived from the Borda matrix. Based on the support vector machine （SVM）, a casing life prediction model is established. In the prediction model, eight risk indexes are defined as input vectors and casing life is defined as the output vector. The ideal model parameters are determined with the training set from 19 wells with casing failure. The casing life prediction software is developed with the SVM model as a predictor. The residual life of 60 wells with casing failure is predicted with the software, and then compared with the actual casing life. The comparison results show that the casing life prediction software with the SVM model has high accuracy.

Support vector machine based nonlinear model multi-step-ahead optimizing predictive control

A support vector machine with guadratic polynomial kernel function based nonlinear model multi-step-ahead optimizing predictive controller was presented. A support vector machine based predictive model was established by black-box identification. And a quadratic objective function with receding horizon was selected to obtain the controller output. By solving a nonlinear optimization problem with equality constraint of model output and boundary constraint of controller output using Nelder-Mead simplex direct search method, a sub-optimal control law was achieved in feature space. The effect of the controller was demonstrated on a recognized benchmark problem and a continuous-stirred tank reactor. The simulation results show that the multi-step-ahead predictive controller can be well applied to nonlinear system, with better performance in following reference trajectory and disturbance-rejection.

Robustly stable model predictive control based on parallel support vector machines with linear kernel

Robustly stable multi-step-ahead model predictive control (MPC) based on parallel support vector machines (SVMs) with linear kernel was proposed. First, an analytical solution of optimal control laws of parallel SVMs based MPC was derived, and then the necessary and sufficient stability condition for MPC closed loop was given according to SVM model, and finally a method of judging the discrepancy between SVM model and the actual plant was presented, and consequently the constraint sets, which can guarantee that the stability condition is still robust for model/plant mismatch within some given bounds, were obtained by applying small-gain theorem. Simulation experiments show the proposed stability condition and robust constraint sets can provide a convenient way of adjusting controller parameters to ensure a closed-loop with larger stable margin.

Nonlinear model predictive control based on support vector machine and genetic algorithm

This paper presents a nonlinear model predictive control(NMPC) approach based on support vector machine(SVM) and genetic algorithm(GA) for multiple-input multiple-output(MIMO) nonlinear systems.Individual SVM is used to approximate each output of the controlled plant Then the model is used in MPC control scheme to predict the outputs of the controlled plant.The optimal control sequence is calculated using GA with elite preserve strategy.Simulation results of a typical MIMO nonlinear system show that this method has a good ability of set points tracking and disturbance rejection.

Support vector machine-based multi-model predictive control

In this paper, a support vector machine-based multi-model predictive control is proposed, in which SVM classification combines well with SVM regression. At first, each working environment is modeled by SVM regression and the support vector machine network-based model predictive control （SVMN-MPC） algorithm corresponding to each environment is developed, and then a multi-class SVM model is established to recognize multiple operating conditions. As for control, the current environment is identified by the multi-class SVM model and then the corresponding SVMN-MPC controller is activated at each sampling instant. The proposed modeling, switching and controller design is demonstrated in simulation results.

Application of Support Vector Machine to Predict 5-year Survival Status of Patients with Nasopharyngeal Carcinoma after Treatment

Objective： Support Vector Machine （SVM） is a machine-learning method, based on the principle of structural risk minimization, which performs well when applied to data outside the training set. In this paper, SVM was applied to predict 5-year survival status of patients with nasopharyngeal carcinoma （NPC） after treatment, we expect to find a new way for prognosis studies in cancer so as to assist right clinical decision for individual patient. Methods： Two modelling methods were used in the study; SVM network and a standard parametric logistic regression were used to model 5-year survival status. And the two methods were compared on a prospective set of patients not used in model construction via receiver operating characteristic （ROC） curve analysis. Results： The SVM1, trained with the 25 original input variables without screening, yielded a ROC area of 0.868, at sensitivity to mortality of 79.2% and the specificity of 94.5%. Similarly, the SVM2, trained with 9 input variables which were obtained by optimal input variable selection from the 25 original variables by logistic regression screening, yielded a ROC area of 0.874, at a sensitivity to mortality of 79.2% and the specificity of 95.6%, while the logistic regression yielded a ROC area of 0.751 at a sensitivity to mortality of 66.7% and gave a specificity of 83.5%. Conclusion： SVM found a strong pattern in the database predictive of 5-year survival status. The logistic regression produces somewhat similar, but better, results. These results show that the SVM models have the potential to predict individual patient＇s 5-year survival status after treatment, and to assist the clinicians for making a good clinical decision.

Generalized Predictive Control with Online Least Squares Support Vector Machines

这份报纸基于能有效地处理非线性的系统的联机最少的广场支持向量机器(LS-SVM ) 建议一个实际概括预兆的控制(GPC ) 算法。在每个采样时期，算法递归地由增加新数据对并且在实时性质上从考虑删除最不重要的修改模型。删除的数据对被 lagrange 的绝对值从最后一个采样时期更多样地决定。当增加新数据对并且删除存在的时，纸给模型参数的递归的算法分别地，一个大矩阵的倒置被避免，存储器能被算法完全控制。非线性的 LS-SVM 模型在每个采样时期在 GPC 算法被使用。抵销过程的 pH 上的概括预兆的控制的实验显示出建议算法的有效性和实物。

The Design of Predictive Model for the Academic Performance of Students at University Based on Machine Learning

Students in South African Universities come from different socio-cultural backgrounds, countries and high schools. This suggests that these students have different experiences which impact on their levels of grasping information in class as they potentially use different lenses on tuition. The current practice in Universities in contributing to the academic performance of students includes the use of tutors, the use of mobile devices for first year students, use of student assistants and the use of different feedback measures. What is problematic about the current practice is that students are quitting university in high numbers. In this study, knowledge has been drawn from data through the use of machine learning algorithms. Bayesian networks, support vector machines （SVMs） and decision trees algorithms were used individually in this work to construct predictive models for the academic performance of students. The best model was constructed using SVM and it gave a prediction of 72.87% and a prediction cost of 139. The model does predict the performance of students in advance of the year-end examinations outcome. The results suggest that South African Universities must recognize the diversity in student population and thus provide students with better support and equip them with the necessary knowledge that will enable them to tap into their full potential and thus enhance their skills.

Tribological properties and wear prediction model of TiC particles reinforced Ni-base alloy composite coatings

TiC particles reinforced Ni-based alloy composite coatings were prepared on 7005 aluminum alloy by plasma spray. The effects of load, speed and temperature on the tribological behavior and mechanisms of the composite coatings under dry friction were researched. The wear prediction model of the composite coatings was established based on the least square support vector machine (LS-SVM). The results show that the composite coatings exhibit smaller friction coefficients and wear losses than the Ni-based alloy coatings under different friction conditions. The predicting time of the LS-SVM model is only 12.93%of that of the BP-ANN model, and the predicting accuracies on friction coefficients and wear losses of the former are increased by 58.74%and 41.87%compared with the latter. The LS-SVM model can effectively predict the tribological behavior of the TiCP/Ni-base alloy composite coatings under dry friction.

A stacked multiple kernel support vector machine for blast induced flyrock prediction

As a widely used rock excavation method in civil and mining construction works, the blasting operations and theinduced side effects are always investigated by the existing studies. The occurrence of flyrock is regarded as one ofthe most important issues induced by blasting operations, since the accurate prediction of which is crucial fordelineating safety zone. For this purpose, this study developed a flyrock prediction model based on 234 sets ofblasting data collected from Sugun Copper Mine site. A stacked multiple kernel support vector machine (stackedMK-SVM) model was proposed for flyrock prediction. The proposed stacked structure can effectively improve themodel performance by addressing the importance level of different features. For comparison purpose, 6 othermachine learning models were developed, including SVM, MK-SVM, Lagragian Twin SVM (LTSVM), ArtificialNeural Network (ANN), Random Forest (RF) and M5 Tree. This study implemented a 5-fold cross validationprocess for hyperparameters tuning purpose. According to the evaluation results, the proposed stacked MK-SVMmodel achieved the best overall performance, with RMSE of 1.73 and 1.74, MAE of 0.58 and 1.08, VAF of 98.95and 99.25 in training and testing phase, respectively.

Forecast Urban Air Pollution in Mexico City by Using Support Vector Machines: A Kernel Performance Approach

The development of forecasting models for pollution particles shows a nonlinear dynamic behavior;hence, implementation is a non-trivial process. In the literature, there have been multiple models of particulate pollutants, which use softcomputing techniques and machine learning such as: multilayer perceptrons, neural networks, support vector machines, kernel algorithms, and so on. This paper presents a prediction pollution model using support vector machines and kernel functions, which are: Gaussian, Polynomial and Spline. Finally, the prediction results of ozone (O3), particulate matter (PM10) and nitrogen dioxide (NO2) at Mexico City are presented as a case study using these techniques.

Machine learning based models for predicting compressive strength of geopolymer concrete

Recently,great attention has been paid to geopolymer concrete due to its advantageous mechanical and environmentally friendly properties.Much effort has been made in experimental studies to advance the understanding of geopolymer concrete,in which compressive strength is one of the most important properties.To facilitate engineering work on the material,an efficient predicting model is needed.In this study,three machine learning(ML)-based models,namely deep neural network(DNN),K-nearest neighbors(KNN),and support vector machines(SVM),are developed for forecasting the compressive strength of the geopolymer concrete.A total of 375 experimental samples are collected from the literature to build a database for the development of the predicting models.A careful procedure for data preprocessing is implemented,by which outliers are examined and removed from the database and input variables are standardized before feeding to the fitting process.The standard K-fold cross-validation approach is applied for evaluating the performance of the models so that overfitting status is well managed,thus the generalizability of the models is ensured.The effectiveness of the models is assessed via statistical metrics including root mean squared error(RMSE),mean absolute error(MAE),correlation coefficient(R),and the recently proposed performance index(PI).The basic mean square error(MSE)is used as the loss function to be minimized during the model fitting process.The three ML-based models are successfully developed for estimating the compressive strength,for which good correlations between the predicted and the true values are obtained for DNN,KNN,and SVM.The numerical results suggest that the DNN model generally outperforms the other two models.

Blended coal’s property prediction model based on PCA and SVM

In order to predict blended coal's property accurately, a new kind of hybrid prediction model based on principal component analysis (PCA) and support vector machine (SVM) was established. PCA was used to transform the high-dimensional and correlative influencing factors data to low-dimensional principal component subspace. Well-trained SVM was used to extract influencing factors as input to predict blended coal's property. Then experiments were made by using the real data, and the results were compared with weighted averaging method (WAM) and BP neural network. The results show that PCA-SVM has higher prediction accuracy in the condition of few data, thus the hybrid model is of great use in the domain of power coal blending.

Prediction and analysis of chaotic time series on the basis of support vector

Based on discussion on the theories of support vector machines （SVM）, an one-step prediction model for time series prediction is presented, wherein the chaos theory is incorporated. Chaotic character of the time series is taken into account in the prediction procedure; parameters of reconstruction-detay and embedding-dimension for phase-space reconstruction are calculated in light of mutual-information and false-nearest-neighbor method, respectively. Precision and functionality have been demonstrated by the experimental results on the basis of the prediction of Lorenz chaotic time series.

LS-SVM model based nonlinear predictive control for MCFC system

This paper describes a nonlinear model predictive controller for regulating a molten carbonate fuel cell (MCFC). In order to improve MCFC’s generating performance, prolong its life and guarantee safety, it must be controlled efficiently. First, the output voltage of an MCFC stack is identified by a least squares support vector machine (LS-SVM) method with radial basis function (RBF) kernel so as to implement nonlinear predictive control. And then, the optimal control sequences are obtained by applying genetic algorithm (GA). The model and controller have been realized in the MATLAB environment. Simulation results indicated that the proposed controller exhibits satisfying control effect.

Machine learning methods for predicting the uniaxial compressive strength of the rocks:a comparative study

The uniaxial compressive strength(UCS)of rocks is a critical index for evaluating the mechanical properties and construction of an engineering rock mass classification system.The most commonly used method for determining the UCS in laboratory settings is expensive and time-consuming.For this reason,UCS can be estimated using an indirect determination method based on several simple laboratory tests,including point-load strength,rock density,longitudinal wave velocity,Brazilian tensile strength,Schmidt hardness,and shore hardness.In this study,six data sets of indices for different rock types were utilized to predict the UCS using three nonlinear combination models,namely back propagation(BP),particle swarm optimization(PSO),and least squares support vector machine(LSSVM).Moreover,the best prediction model was examined and selected based on four performance prediction indices.The results reveal that the PSO–LSSVM model was more successful than the other two models due to its higher performance capacity.The ratios of the predicted UCS to the measured UCS for the six data sets were 0.954,0.982,0.9911,0.9956,0.9995,and 0.993,respectively.The results were more reasonable when the predicted ratio was close to a value of approximately 1.

Analyses and predictions of rock cuttabilities under different confining stresses and rock properties based on rock indentation tests by conical pick

The rock indentation tests by a conical pick were conducted to investigate the rock cuttability correlated to confining stress conditions and rock strength.Based on the test results,the regression analyses,support vector machine(SVM)and generalized regression neural network(GRNN)were used to find the relationship among rock cuttability,uniaxial confining stress applied to rock,uniaxial compressive strength(UCS)and tensile strength of rock material.It was found that the regression and SVM-based models can accurately reflect the variation law of rock cuttability,which presented decreases followed by increases with the increase in uniaxial confining stress and the negative correlation to UCS and tensile strength of rock material.Based on prediction models for revealing the optimal stress condition and determining the cutting parameters,the axial boom roadheader with many conical picks mounted was satisfactorily utilized to perform rock cutting in hard phosphate rock around pillar.