Prediction of Ground Vibration Induced by Rock Blasting Based on Optimized Support Vector Regression Models

Accurately estimating blasting vibration during rock blasting is the foundation of blasting vibration management.In this study,Tuna Swarm Optimization(TSO),Whale Optimization Algorithm(WOA),and Cuckoo Search(CS)were used to optimize two hyperparameters in support vector regression(SVR).Based on these methods,three hybrid models to predict peak particle velocity(PPV)for bench blasting were developed.Eighty-eight samples were collected to establish the PPV database,eight initial blasting parameters were chosen as input parameters for the predictionmodel,and the PPV was the output parameter.As predictive performance evaluation indicators,the coefficient of determination(R2),rootmean square error(RMSE),mean absolute error(MAE),and a10-index were selected.The normalizedmutual information value is then used to evaluate the impact of various input parameters on the PPV prediction outcomes.According to the research findings,TSO,WOA,and CS can all enhance the predictive performance of the SVR model.The TSO-SVR model provides the most accurate predictions.The performances of the optimized hybrid SVR models are superior to the unoptimized traditional prediction model.The maximum charge per delay impacts the PPV prediction value the most.

Support vector regression-based operational effectiveness evaluation approach to reconnaissance satellite system

As one of the most important part of weapon system of systems(WSoS),quantitative evaluation of reconnaissance satellite system(RSS)is indispensable during its construction and application.Aiming at the problem of nonlinear effectiveness evaluation under small sample conditions,we propose an evaluation method based on support vector regression(SVR)to effectively address the defects of traditional methods.Considering the performance of SVR is influenced by the penalty factor,kernel type,and other parameters deeply,the improved grey wolf optimizer(IGWO)is employed for parameter optimization.In the proposed IGWO algorithm,the opposition-based learning strategy is adopted to increase the probability of avoiding the local optima,the mutation operator is used to escape from premature convergence and differential convergence factors are applied to increase the rate of convergence.Numerical experiments of 14 test functions validate the applicability of IGWO algorithm dealing with global optimization.The index system and evaluation method are constructed based on the characteristics of RSS.To validate the proposed IGWO-SVR evaluation method,eight benchmark data sets and combat simulation are employed to estimate the evaluation accuracy,convergence performance and computational complexity.According to the experimental results,the proposed method outperforms several prediction based evaluation methods,verifies the superiority and effectiveness in RSS operational effectiveness evaluation.

Spatial prediction of landslide susceptibility in western Serbia using hybrid support vector regression(SVR)with GWO,BAT and COA algorithms

In this study,we developed multiple hybrid machine-learning models to address parameter optimization limitations and enhance the spatial prediction of landslide susceptibility models.We created a geographic information system database,and our analysis results were used to prepare a landslide inventory map containing 359 landslide events identified from Google Earth,aerial photographs,and other validated sources.A support vector regression(SVR)machine-learning model was used to divide the landslide inventory into training(70%)and testing(30%)datasets.The landslide susceptibility map was produced using 14 causative factors.We applied the established gray wolf optimization(GWO)algorithm,bat algorithm(BA),and cuckoo optimization algorithm(COA)to fine-tune the parameters of the SVR model to improve its predictive accuracy.The resultant hybrid models,SVR-GWO,SVR-BA,and SVR-COA,were validated in terms of the area under curve(AUC)and root mean square error(RMSE).The AUC values for the SVR-GWO(0.733),SVR-BA(0.724),and SVR-COA(0.738)models indicate their good prediction rates for landslide susceptibility modeling.SVR-COA had the greatest accuracy,with an RMSE of 0.21687,and SVR-BA had the least accuracy,with an RMSE of 0.23046.The three optimized hybrid models outperformed the SVR model(AUC=0.704,RMSE=0.26689),confirming the ability of metaheuristic algorithms to improve model performance.

Improved Twin Support Vector Machine Algorithm and Applications in Classification Problems

The distribution of data has a significant impact on the results of classification.When the distribution of one class is insignificant compared to the distribution of another class,data imbalance occurs.This will result in rising outlier values and noise.Therefore,the speed and performance of classification could be greatly affected.Given the above problems,this paper starts with the motivation and mathematical representing of classification,puts forward a new classification method based on the relationship between different classification formulations.Combined with the vector characteristics of the actual problem and the choice of matrix characteristics,we firstly analyze the orderly regression to introduce slack variables to solve the constraint problem of the lone point.Then we introduce the fuzzy factors to solve the problem of the gap between the isolated points on the basis of the support vector machine.We introduce the cost control to solve the problem of sample skew.Finally,based on the bi-boundary support vector machine,a twostep weight setting twin classifier is constructed.This can help to identify multitasks with feature-selected patterns without the need for additional optimizers,which solves the problem of large-scale classification that can’t deal effectively with the very low category distribution gap.

Smart Healthcare Activity Recognition Using Statistical Regression and Intelligent Learning

In this present time,Human Activity Recognition(HAR)has been of considerable aid in the case of health monitoring and recovery.The exploitation of machine learning with an intelligent agent in the area of health informatics gathered using HAR augments the decision-making quality and significance.Although many research works conducted on Smart Healthcare Monitoring,there remain a certain number of pitfalls such as time,overhead,and falsification involved during analysis.Therefore,this paper proposes a Statistical Partial Regression and Support Vector Intelligent Agent Learning(SPR-SVIAL)for Smart Healthcare Monitoring.At first,the Statistical Partial Regression Feature Extraction model is used for data preprocessing along with the dimensionality-reduced features extraction process.Here,the input dataset the continuous beat-to-beat heart data,triaxial accelerometer data,and psychological characteristics were acquired from IoT wearable devices.To attain highly accurate Smart Healthcare Monitoring with less time,Partial Least Square helps extract the dimensionality-reduced features.After that,with these resulting features,SVIAL is proposed for Smart Healthcare Monitoring with the help of Machine Learning and Intelligent Agents to minimize both analysis falsification and overhead.Experimental evaluation is carried out for factors such as time,overhead,and false positive rate accuracy concerning several instances.The quantitatively analyzed results indicate the better performance of our proposed SPR-SVIAL method when compared with two state-of-the-art methods.

Small-time scale network traffic prediction based on a local support vector machine regression model

In this paper we apply the nonlinear time series analysis method to small-time scale traffic measurement data. The prediction-based method is used to determine the embedding dimension of the traffic data. Based on the reconstructed phase space, the local support vector machine prediction method is used to predict the traffic measurement data, and the BIC-based neighbouring point selection method is used to choose the number of the nearest neighbouring points for the local support vector machine regression model. The experimental results show that the local support vector machine prediction method whose neighbouring points are optimized can effectively predict the small-time scale traffic measurement data and can reproduce the statistical features of real traffic measurements.

Parameter selection of support vector regression based on hybrid optimization algorithm and its application

Choosing optimal parameters for support vector regression （SVR） is an important step in SVR. design, which strongly affects the pefformance of SVR. In this paper, based on the analysis of influence of SVR parameters on generalization error, a new approach with two steps is proposed for selecting SVR parameters, First the kernel function and SVM parameters are optimized roughly through genetic algorithm, then the kernel parameter is finely adjusted by local linear search, This approach has been successfully applied to the prediction model of the sulfur content in hot metal. The experiment results show that the proposed approach can yield better generalization performance of SVR than other methods,

A Metamodeling Method Based on Support Vector Regression for Robust Optimization

Metamodeling techniques have been used in robust optimization to reduce the high computational cost of the uncertainty analysis and improve the performance of robust optimization problems with computationally expensive simulation models. Existing metamodels main focus on polynomial regression（PR）, neural networks（NN） and Kriging models, these metamodels are not well suited for large-scale robust optimization problems with small size training sets and high nonlinearity. To address the problem, a reduced approximation model technique based on support vector regression（SVR） is introduced in order to improve the accuracy of metamodels. A robust optimization method based on SVR is presented for problems that involve high dimension and nonlinear. First appropriate design parameter samples are selected by experimental design theories, then the response samples are obtained from the simulations such as finite element analysis, the SVR metamodel is constructed and treated as the mean and the variance of the objective performance functions. Combining other constraints, the robust optimization model is formed which can be solved by genetic algorithm （GA）. The applicability of the method developed is demonstrated using a case of two-bar structure system study. The performances of SVR were compared with those of PR, Kriging and back-propagation neural networks（BPNN）, the comparison results show that the prediction accuracy of the SVR metamodel was higher than those of other metamodels under uncertainty. The robust optimization solutions are near to the real result, and the proposed method is found to be accurate and efficient for robust optimization. This reaserch provides an efficient method for robust optimization problems with complex structure.

Improved adaptive pruning algorithm for least squares support vector regression

As the solutions of the least squares support vector regression machine （LS-SVRM） are not sparse, it leads to slow prediction speed and limits its applications. The defects of the ex- isting adaptive pruning algorithm for LS-SVRM are that the training speed is slow, and the generalization performance is not satis- factory, especially for large scale problems. Hence an improved algorithm is proposed. In order to accelerate the training speed, the pruned data point and fast leave-one-out error are employed to validate the temporary model obtained after decremental learning. The novel objective function in the termination condition which in- volves the whole constraints generated by all training data points and three pruning strategies are employed to improve the generali- zation performance. The effectiveness of the proposed algorithm is tested on six benchmark datasets. The sparse LS-SVRM model has a faster training speed and better generalization performance.

Improvement of the prediction performance of a soft sensor model based on support vector regression for production of ultra-low sulfur diesel

A novel data-driven, soft sensor based on support vector regression （SVR） integrated with a data compression technique was developed to predict the product quality for the hydrodesulfurization （HDS） process. A wide range of experimental data was taken from a HDS setup to train and test the SVR model. Hyper-parameter tuning is one of the main challenges to improve predictive accuracy of the SVR model. Therefore, a hybrid approach using a combination of genetic algorithm （GA） and sequential quadratic programming （SQP） methods （GA-SQP） was developed. Performance of different optimization algorithms including GA-SQP, GA, pattern search （PS）, and grid search （GS） indicated that the best average absolute relative error （AARE）, squared correlation coefficient （R2）, and computation time （CT） （AARE = 0.0745, R2 = 0.997 and CT = 56 s） was accomplished by the hybrid algorithm. Moreover, to reduce the CT and improve the accuracy of the SVR model, the vector quantization （VQ） technique was used. The results also showed that the VQ technique can decrease the training time and improve prediction performance of the SVR model. The proposed method can provide a robust, soft sensor in a wide range of sulfur contents with good accuracy.

Support Vector Regression for Bus Travel Time Prediction Using Wavelet Transform

In order to accurately predict bus travel time, a hybrid model based on combining wavelet transform technique with support vector regression(WT-SVR) model is employed. In this model, wavelet decomposition is used to extract important information of data at different levels and enhances the forecasting ability of the model. After wavelet transform different components are forecasted by their corresponding SVR predictors. The final prediction result is obtained by the summation of the predicted results for each component. The proposed hybrid model is examined by the data of bus route No.550 in Nanjing, China. The performance of WT-SVR model is evaluated by mean absolute error(MAE), mean absolute percent error(MAPE) and relative mean square error(RMSE), and also compared to regular SVR and ANN models. The results show that the prediction method based on wavelet transform and SVR has better tracking ability and dynamic behavior than regular SVR and ANN models. The forecasting performance is remarkably improved to obtain within 6% MAPE for testing section Ⅰ and 8% MAPE for testing section Ⅱ, which proves that the suggested approach is feasible and applicable in bus travel time prediction.

Support vector regression modeling in recursive just-in-time learning framework for adaptive soft sensing of naphtha boiling point in crude distillation unit

Prediction of primary quality variables in real time with adaptation capability for varying process conditions is a critical task in process industries.This article focuses on the development of non-linear adaptive soft sensors for prediction of naphtha initial boiling point(IBP)and end boiling point(EBP)in crude distillation unit.In this work,adaptive inferential sensors with linear and non-linear local models are reported based on recursive just in time learning(JITL)approach.The different types of local models designed are locally weighted regression(LWR),multiple linear regression(MLR),partial least squares regression(PLS)and support vector regression(SVR).In addition to model development,the effect of relevant dataset size on model prediction accuracy and model computation time is also investigated.Results show that the JITL model based on support vector regression with iterative single data algorithm optimization(ISDA)local model(JITL-SVR:ISDA)yielded best prediction accuracy in reasonable computation time.

Modeling personalized head-related impulse response using support vector regression

A new customization approach based on support vector regression （SVR） is proposed to obtain individual headrelated impulse response （HRIR） without complex measurement and special equipment. Principal component analysis （PCA） is first applied to obtain a few principal components and corresponding weight vectors correlated with individual anthropometric parameters. Then the weight vectors act as output of the nonlinear regression model. Some measured anthropometric parameters are selected as input of the model according to the correlation coefficients between the parameters and the weight vectors. After the regression model is learned from the training data, the individual HRIR can be predicted based on the measured anthropometric parameters. Compared with a back-propagation neural network （BPNN） for nonlinear regression, better generalization and prediction performance for small training samples can be obtained using the proposed PCA-SVR algorithm.

Determination of Quality Properties of Soy Sauce by Support Vector Regression Coupled with SW-NIR Spectroscopy

The modern near-infrared(NIR) spectroscopy analysis is a simple, efficient and nondestructive technique, which has been used in chemical analysis in diverse fields. Shortwave NIR spectroscopy is also a rapid, flexible, and cost-effective method to control product quality in food industry. The method of support vector regression coupled with shortwave NIR spectroscopy was explored for the nondestructive quantitative analysis of the important quality parameters of soy sauce, including amino nitrogen content, total acid content, salt content and color ratio. In this study, the support vector regression(SVR) models based on subtractive spectra and positive spectra were found and compared, the results show that the subtractive spectrum was more excellent than the positive spectrum. Meanwhile, R and RSE were determined, respectively, by means of original spectra and pretreated spectra[standard normal variate (SNV), first-derivative and second-derivative], and the corresponding models were successfully established. The best prediction was achieved by a support vector regression model of the first derivative transformed dataset. In addition, the result obtained by the proposed method was compared with that of Partial Least Squares(PLS), which showed that the generalization performance of the classifier based on SVR was much better than that of PLS. The results demonstrate that shortwave NIR spectroscopy combined with SVR is promising for the quality control of soy sauce.

Application of wavelet support vector regression on SAR data de-noising

A new filtering method for SAR data de-noising using wavelet support vector regression （WSVR） is developed. On the basis of the grey scale distribution character of SAR imagery, the logarithmic SAR image as a noise polluted signal is taken and the noise model assumption in logarithmic domain with Gaussian noise and impact noise is proposed. Based on the better per- formance of support vector regression （SVR） for complex signal approximation and the wavelet for signal detail expression, the wavelet kernel function is chosen as support vector kernel func- tion. Then the logarithmic SAR image is regressed with WSVR. Furthermore the regression distance is used as a judgment index of the noise type. According to the judgment of noise type every pixel can be adaptively de-noised with different filters. Through an approximation experiment for a one-dimensional complex signal, the feasibility of SAR data regression based on WSVR is con- firmed. Afterward the SAR image is treated as a two-dimensional continuous signal and filtered by an SVR with wavelet kernel function. The results show that the method proposed here reduces the radar speckle noise effectively while maintaining edge features and details well.

Support Vector Machines for Regression: A Succinct Review of Large-Scale and Linear Programming Formulations

Support Vector-based learning methods are an important part of Computational Intelligence techniques. Recent efforts have been dealing with the problem of learning from very large datasets. This paper reviews the most commonly used formulations of support vector machines for regression (SVRs) aiming to emphasize its usability on large-scale applications. We review the general concept of support vector machines (SVMs), address the state-of-the-art on training methods SVMs, and explain the fundamental principle of SVRs. The most common learning methods for SVRs are introduced and linear programming-based SVR formulations are explained emphasizing its suitability for large-scale learning. Finally, this paper also discusses some open problems and current trends.

Prediction of Pressure Drop of Slurry Flow in Pipeline by Hybrid Support Vector Regression and Genetic Algorithm Model

这份报纸描述柔韧的支持向量回归(SVR ) 方法论，它能为重要过程工程问题提供优异性能。方法为 SVR 元参数的有效调节合并混合支持向量回归和基因算法技术(SVR-GA ) 。算法被申请了稳固的液体的压力落下的预言泥浆流动。有在文学的选择关联的比较证明发达 SVR 关联显著地在大量操作条件，物理性质，和管子直径上改进了压力落下的预言。

Fault diagnosis of power-shift steering transmission based on multiple outputs least squares support vector regression

A method of multiple outputs least squares support vector regression （LS-SVR） was developed and described in detail, with the radial basis function （RBF） as the kernel function. The method was applied to predict the future state of the power-shift steering transmission （PSST）. A prediction model of PSST was gotten with multiple outputs LS-SVR. The model performance was greatly influenced by the penalty parameter γ and kernel parameter σ2 which were optimized using cross validation method. The training and prediction of the model were done with spectrometric oil analysis data. The predictive and actual values were compared and a fault in the second PSST was found. The research proved that this method had good accuracy in PSST fault prediction, and any possible problem in PSST could be found through a comparative analysis.

Use of Support Vector Regression Based on Mean Impact Value Model to Identify Active Compounds in a Combination of Curcuma longa L.and Glycyrrhiza extracts

A support vector regression based on the mean impact value (MIV) model was constructed to identify the bioactive compounds inhibiting proliferation of He La cells in a combination of turmeric (Curcuma longa L.)and liquorice (Glycyrrhiza) extracts.The quantitative chemical fingerprint from 50 batches of turmeric and liquorice extracts was established using high performance liquid chromatography hyphenated to an ultraviolet visible detector.Qualitative results were obtained using ultra performance liquid chromatography coupled with electrospray ionization quadrupole time-of-flight tandem mass spectrometry.A total of 46 peaks (peaks 1–15 from turmeric and 16–46 from liquorice) were selected as "common peaks" for analysis.The inhibitory effect of the combined extracts on He La cells was measured by MTT (3- (4,5-dimethylthiazol-2-yl)-2,5-diphenyltetrazolium bromide) assay.It was found that 15 compounds (peaks:8,12,30,24,46,11,14,9,3,1,44,18,7,45 and 43)possessing high absolute MIV exhibited a significant correlation with the cytotoxicity against He La cells; most of these have already been confirmed with potential cytotoxicity in previous research.The important potential application of the present model can be extended to help discover active compounds from complex herbal medicine prior to traditional bioassay-guided separation.It is considered that this could be a useful tool for redeveloping herbal medicine based on the use of these active compounds.

Improved IMM algorithm based on support vector regression for UAV tracking

With the development of technology, the relevant performance of unmanned aerial vehicles(UAVs) has been greatly improved, and various highly maneuverable UAVs have been developed, which puts forward higher requirements on target tracking technology. Strong maneuvering refers to relatively instantaneous and dramatic changes in target acceleration or movement patterns, as well as continuous changes in speed,angle, and acceleration. However, the traditional UAV tracking algorithm model has poor adaptability and large amount of calculation. This paper applies support vector regression(SVR)to the interacting multiple model(IMM) algorithm. The simulation results show that the improved algorithm has higher tracking accuracy for highly maneuverable targets than the original algorithm, and can adjust parameters adaptively, making it more adaptable.