Accurately estimating blasting vibration during rock blasting is the foundation of blasting vibration management.In this study,Tuna Swarm Optimization(TSO),Whale Optimization Algorithm(WOA),and Cuckoo Search(CS)were u...Accurately estimating blasting vibration during rock blasting is the foundation of blasting vibration management.In this study,Tuna Swarm Optimization(TSO),Whale Optimization Algorithm(WOA),and Cuckoo Search(CS)were used to optimize two hyperparameters in support vector regression(SVR).Based on these methods,three hybrid models to predict peak particle velocity(PPV)for bench blasting were developed.Eighty-eight samples were collected to establish the PPV database,eight initial blasting parameters were chosen as input parameters for the predictionmodel,and the PPV was the output parameter.As predictive performance evaluation indicators,the coefficient of determination(R2),rootmean square error(RMSE),mean absolute error(MAE),and a10-index were selected.The normalizedmutual information value is then used to evaluate the impact of various input parameters on the PPV prediction outcomes.According to the research findings,TSO,WOA,and CS can all enhance the predictive performance of the SVR model.The TSO-SVR model provides the most accurate predictions.The performances of the optimized hybrid SVR models are superior to the unoptimized traditional prediction model.The maximum charge per delay impacts the PPV prediction value the most.展开更多
In this present time,Human Activity Recognition(HAR)has been of considerable aid in the case of health monitoring and recovery.The exploitation of machine learning with an intelligent agent in the area of health infor...In this present time,Human Activity Recognition(HAR)has been of considerable aid in the case of health monitoring and recovery.The exploitation of machine learning with an intelligent agent in the area of health informatics gathered using HAR augments the decision-making quality and significance.Although many research works conducted on Smart Healthcare Monitoring,there remain a certain number of pitfalls such as time,overhead,and falsification involved during analysis.Therefore,this paper proposes a Statistical Partial Regression and Support Vector Intelligent Agent Learning(SPR-SVIAL)for Smart Healthcare Monitoring.At first,the Statistical Partial Regression Feature Extraction model is used for data preprocessing along with the dimensionality-reduced features extraction process.Here,the input dataset the continuous beat-to-beat heart data,triaxial accelerometer data,and psychological characteristics were acquired from IoT wearable devices.To attain highly accurate Smart Healthcare Monitoring with less time,Partial Least Square helps extract the dimensionality-reduced features.After that,with these resulting features,SVIAL is proposed for Smart Healthcare Monitoring with the help of Machine Learning and Intelligent Agents to minimize both analysis falsification and overhead.Experimental evaluation is carried out for factors such as time,overhead,and false positive rate accuracy concerning several instances.The quantitatively analyzed results indicate the better performance of our proposed SPR-SVIAL method when compared with two state-of-the-art methods.展开更多
As one of the most important part of weapon system of systems(WSoS),quantitative evaluation of reconnaissance satellite system(RSS)is indispensable during its construction and application.Aiming at the problem of nonl...As one of the most important part of weapon system of systems(WSoS),quantitative evaluation of reconnaissance satellite system(RSS)is indispensable during its construction and application.Aiming at the problem of nonlinear effectiveness evaluation under small sample conditions,we propose an evaluation method based on support vector regression(SVR)to effectively address the defects of traditional methods.Considering the performance of SVR is influenced by the penalty factor,kernel type,and other parameters deeply,the improved grey wolf optimizer(IGWO)is employed for parameter optimization.In the proposed IGWO algorithm,the opposition-based learning strategy is adopted to increase the probability of avoiding the local optima,the mutation operator is used to escape from premature convergence and differential convergence factors are applied to increase the rate of convergence.Numerical experiments of 14 test functions validate the applicability of IGWO algorithm dealing with global optimization.The index system and evaluation method are constructed based on the characteristics of RSS.To validate the proposed IGWO-SVR evaluation method,eight benchmark data sets and combat simulation are employed to estimate the evaluation accuracy,convergence performance and computational complexity.According to the experimental results,the proposed method outperforms several prediction based evaluation methods,verifies the superiority and effectiveness in RSS operational effectiveness evaluation.展开更多
Regression analysis is often formulated as an optimization problem with squared loss functions.Facing the challenge of the selection of the proper function class with polynomial smooth techniques applied to support ve...Regression analysis is often formulated as an optimization problem with squared loss functions.Facing the challenge of the selection of the proper function class with polynomial smooth techniques applied to support vector regression models,this study takes cubic spline interpolation to generate a new polynomial smooth function |x|_ε~2 in ε-insensitive support vector regression.Theoretical analysis shows that S_ε~2-function is better than p_ε~2-function in properties,and the approximation accuracy of the proposed smoothing function is two order higher than that of classical p_ε~2-function.The experimental data shows the efficiency of the new approach.展开更多
The theory of nu-support vector regression (Nu-SVR) is employed in modeling time series variationfor prediction. In order to avoid prediction performance degradation caused by improper parameters, themethod of paralle...The theory of nu-support vector regression (Nu-SVR) is employed in modeling time series variationfor prediction. In order to avoid prediction performance degradation caused by improper parameters, themethod of parallel multidimensional step search (PMSS) is proposed for users to select best parameters intraining support vector machine to get a prediction model. A series of tests are performed to evaluate themodeling mechanism and prediction results indicate that Nu-SVR models can reflect the variation tendencyof time series with low prediction error on both familiar and unfamiliar data. Statistical analysis is alsoemployed to verify the optimization performance of PMSS algorithm and comparative results indicate thattraining error can take the minimum over the interval around planar data point corresponding to selectedparameters. Moreover, the introduction of parallelization can remarkably speed up the optimizing procedure.展开更多
In this paper we apply the nonlinear time series analysis method to small-time scale traffic measurement data. The prediction-based method is used to determine the embedding dimension of the traffic data. Based on the...In this paper we apply the nonlinear time series analysis method to small-time scale traffic measurement data. The prediction-based method is used to determine the embedding dimension of the traffic data. Based on the reconstructed phase space, the local support vector machine prediction method is used to predict the traffic measurement data, and the BIC-based neighbouring point selection method is used to choose the number of the nearest neighbouring points for the local support vector machine regression model. The experimental results show that the local support vector machine prediction method whose neighbouring points are optimized can effectively predict the small-time scale traffic measurement data and can reproduce the statistical features of real traffic measurements.展开更多
Choosing optimal parameters for support vector regression (SVR) is an important step in SVR. design, which strongly affects the pefformance of SVR. In this paper, based on the analysis of influence of SVR parameters...Choosing optimal parameters for support vector regression (SVR) is an important step in SVR. design, which strongly affects the pefformance of SVR. In this paper, based on the analysis of influence of SVR parameters on generalization error, a new approach with two steps is proposed for selecting SVR parameters, First the kernel function and SVM parameters are optimized roughly through genetic algorithm, then the kernel parameter is finely adjusted by local linear search, This approach has been successfully applied to the prediction model of the sulfur content in hot metal. The experiment results show that the proposed approach can yield better generalization performance of SVR than other methods,展开更多
Metamodeling techniques have been used in robust optimization to reduce the high computational cost of the uncertainty analysis and improve the performance of robust optimization problems with computationally expensiv...Metamodeling techniques have been used in robust optimization to reduce the high computational cost of the uncertainty analysis and improve the performance of robust optimization problems with computationally expensive simulation models. Existing metamodels main focus on polynomial regression(PR), neural networks(NN) and Kriging models, these metamodels are not well suited for large-scale robust optimization problems with small size training sets and high nonlinearity. To address the problem, a reduced approximation model technique based on support vector regression(SVR) is introduced in order to improve the accuracy of metamodels. A robust optimization method based on SVR is presented for problems that involve high dimension and nonlinear. First appropriate design parameter samples are selected by experimental design theories, then the response samples are obtained from the simulations such as finite element analysis, the SVR metamodel is constructed and treated as the mean and the variance of the objective performance functions. Combining other constraints, the robust optimization model is formed which can be solved by genetic algorithm (GA). The applicability of the method developed is demonstrated using a case of two-bar structure system study. The performances of SVR were compared with those of PR, Kriging and back-propagation neural networks(BPNN), the comparison results show that the prediction accuracy of the SVR metamodel was higher than those of other metamodels under uncertainty. The robust optimization solutions are near to the real result, and the proposed method is found to be accurate and efficient for robust optimization. This reaserch provides an efficient method for robust optimization problems with complex structure.展开更多
In this study,we developed multiple hybrid machine-learning models to address parameter optimization limitations and enhance the spatial prediction of landslide susceptibility models.We created a geographic informatio...In this study,we developed multiple hybrid machine-learning models to address parameter optimization limitations and enhance the spatial prediction of landslide susceptibility models.We created a geographic information system database,and our analysis results were used to prepare a landslide inventory map containing 359 landslide events identified from Google Earth,aerial photographs,and other validated sources.A support vector regression(SVR)machine-learning model was used to divide the landslide inventory into training(70%)and testing(30%)datasets.The landslide susceptibility map was produced using 14 causative factors.We applied the established gray wolf optimization(GWO)algorithm,bat algorithm(BA),and cuckoo optimization algorithm(COA)to fine-tune the parameters of the SVR model to improve its predictive accuracy.The resultant hybrid models,SVR-GWO,SVR-BA,and SVR-COA,were validated in terms of the area under curve(AUC)and root mean square error(RMSE).The AUC values for the SVR-GWO(0.733),SVR-BA(0.724),and SVR-COA(0.738)models indicate their good prediction rates for landslide susceptibility modeling.SVR-COA had the greatest accuracy,with an RMSE of 0.21687,and SVR-BA had the least accuracy,with an RMSE of 0.23046.The three optimized hybrid models outperformed the SVR model(AUC=0.704,RMSE=0.26689),confirming the ability of metaheuristic algorithms to improve model performance.展开更多
The main purpose of blasting operation is to produce desired and optimum mean size rock fragments.Smaller or fine fragments cause the loss of ore during loading and transportation,whereas large or coarser fragments ne...The main purpose of blasting operation is to produce desired and optimum mean size rock fragments.Smaller or fine fragments cause the loss of ore during loading and transportation,whereas large or coarser fragments need to be further processed,which enhances production cost.Therefore,accurate prediction of rock fragmentation is crucial in blasting operations.Mean fragment size(MFS) is a crucial index that measures the goodness of blasting designs.Over the past decades,various models have been proposed to evaluate and predict blasting fragmentation.Among these models,artificial intelligence(AI)-based models are becoming more popular due to their outstanding prediction results for multiinfluential factors.In this study,support vector regression(SVR) techniques are adopted as the basic prediction tools,and five types of optimization algorithms,i.e.grid search(GS),grey wolf optimization(GWO),particle swarm optimization(PSO),genetic algorithm(GA) and salp swarm algorithm(SSA),are implemented to improve the prediction performance and optimize the hyper-parameters.The prediction model involves 19 influential factors that constitute a comprehensive blasting MFS evaluation system based on AI techniques.Among all the models,the GWO-v-SVR-based model shows the best comprehensive performance in predicting MFS in blasting operation.Three types of mathematical indices,i.e.mean square error(MSE),coefficient of determination(R^(2)) and variance accounted for(VAF),are utilized for evaluating the performance of different prediction models.The R^(2),MSE and VAF values for the training set are 0.8355,0.00138 and 80.98,respectively,whereas 0.8353,0.00348 and 82.41,respectively for the testing set.Finally,sensitivity analysis is performed to understand the influence of input parameters on MFS.It shows that the most sensitive factor in blasting MFS is the uniaxial compressive strength.展开更多
Removal of cloud cover on the satellite remote sensing image can effectively improve the availability of remote sensing images. For thin cloud cover, support vector value contourlet transform is used to achieve multi-...Removal of cloud cover on the satellite remote sensing image can effectively improve the availability of remote sensing images. For thin cloud cover, support vector value contourlet transform is used to achieve multi-scale decomposition of the area of thin cloud cover on remote sensing images. Through enhancing coefficients of high frequency and suppressing coefficients of low frequency, the thin cloud is removed. For thick cloud cover, if the areas of thick cloud cover on multi-source or multi-temporal remote sensing images do not overlap, the multi-output support vector regression learning method is used to remove this kind of thick clouds. If the thick cloud cover areas overlap, by using the multi-output learning of the surrounding areas to predict the surface features of the overlapped thick cloud cover areas, this kind of thick cloud is removed. Experimental results show that the proposed cloud removal method can effectively solve the problems of the cloud overlapping and radiation difference among multi-source images. The cloud removal image is clear and smooth.展开更多
A novel data-driven, soft sensor based on support vector regression (SVR) integrated with a data compression technique was developed to predict the product quality for the hydrodesulfurization (HDS) process. A wid...A novel data-driven, soft sensor based on support vector regression (SVR) integrated with a data compression technique was developed to predict the product quality for the hydrodesulfurization (HDS) process. A wide range of experimental data was taken from a HDS setup to train and test the SVR model. Hyper-parameter tuning is one of the main challenges to improve predictive accuracy of the SVR model. Therefore, a hybrid approach using a combination of genetic algorithm (GA) and sequential quadratic programming (SQP) methods (GA-SQP) was developed. Performance of different optimization algorithms including GA-SQP, GA, pattern search (PS), and grid search (GS) indicated that the best average absolute relative error (AARE), squared correlation coefficient (R2), and computation time (CT) (AARE = 0.0745, R2 = 0.997 and CT = 56 s) was accomplished by the hybrid algorithm. Moreover, to reduce the CT and improve the accuracy of the SVR model, the vector quantization (VQ) technique was used. The results also showed that the VQ technique can decrease the training time and improve prediction performance of the SVR model. The proposed method can provide a robust, soft sensor in a wide range of sulfur contents with good accuracy.展开更多
As the solutions of the least squares support vector regression machine (LS-SVRM) are not sparse, it leads to slow prediction speed and limits its applications. The defects of the ex- isting adaptive pruning algorit...As the solutions of the least squares support vector regression machine (LS-SVRM) are not sparse, it leads to slow prediction speed and limits its applications. The defects of the ex- isting adaptive pruning algorithm for LS-SVRM are that the training speed is slow, and the generalization performance is not satis- factory, especially for large scale problems. Hence an improved algorithm is proposed. In order to accelerate the training speed, the pruned data point and fast leave-one-out error are employed to validate the temporary model obtained after decremental learning. The novel objective function in the termination condition which in- volves the whole constraints generated by all training data points and three pruning strategies are employed to improve the generali- zation performance. The effectiveness of the proposed algorithm is tested on six benchmark datasets. The sparse LS-SVRM model has a faster training speed and better generalization performance.展开更多
Prediction of primary quality variables in real time with adaptation capability for varying process conditions is a critical task in process industries.This article focuses on the development of non-linear adaptive so...Prediction of primary quality variables in real time with adaptation capability for varying process conditions is a critical task in process industries.This article focuses on the development of non-linear adaptive soft sensors for prediction of naphtha initial boiling point(IBP)and end boiling point(EBP)in crude distillation unit.In this work,adaptive inferential sensors with linear and non-linear local models are reported based on recursive just in time learning(JITL)approach.The different types of local models designed are locally weighted regression(LWR),multiple linear regression(MLR),partial least squares regression(PLS)and support vector regression(SVR).In addition to model development,the effect of relevant dataset size on model prediction accuracy and model computation time is also investigated.Results show that the JITL model based on support vector regression with iterative single data algorithm optimization(ISDA)local model(JITL-SVR:ISDA)yielded best prediction accuracy in reasonable computation time.展开更多
In order to accurately predict bus travel time, a hybrid model based on combining wavelet transform technique with support vector regression(WT-SVR) model is employed. In this model, wavelet decomposition is used to e...In order to accurately predict bus travel time, a hybrid model based on combining wavelet transform technique with support vector regression(WT-SVR) model is employed. In this model, wavelet decomposition is used to extract important information of data at different levels and enhances the forecasting ability of the model. After wavelet transform different components are forecasted by their corresponding SVR predictors. The final prediction result is obtained by the summation of the predicted results for each component. The proposed hybrid model is examined by the data of bus route No.550 in Nanjing, China. The performance of WT-SVR model is evaluated by mean absolute error(MAE), mean absolute percent error(MAPE) and relative mean square error(RMSE), and also compared to regular SVR and ANN models. The results show that the prediction method based on wavelet transform and SVR has better tracking ability and dynamic behavior than regular SVR and ANN models. The forecasting performance is remarkably improved to obtain within 6% MAPE for testing section Ⅰ and 8% MAPE for testing section Ⅱ, which proves that the suggested approach is feasible and applicable in bus travel time prediction.展开更多
The modern near-infrared(NIR) spectroscopy analysis is a simple, efficient and nondestructive technique, which has been used in chemical analysis in diverse fields. Shortwave NIR spectroscopy is also a rapid, flexible...The modern near-infrared(NIR) spectroscopy analysis is a simple, efficient and nondestructive technique, which has been used in chemical analysis in diverse fields. Shortwave NIR spectroscopy is also a rapid, flexible, and cost-effective method to control product quality in food industry. The method of support vector regression coupled with shortwave NIR spectroscopy was explored for the nondestructive quantitative analysis of the important quality parameters of soy sauce, including amino nitrogen content, total acid content, salt content and color ratio. In this study, the support vector regression(SVR) models based on subtractive spectra and positive spectra were found and compared, the results show that the subtractive spectrum was more excellent than the positive spectrum. Meanwhile, R and RSE were determined, respectively, by means of original spectra and pretreated spectra[standard normal variate (SNV), first-derivative and second-derivative], and the corresponding models were successfully established. The best prediction was achieved by a support vector regression model of the first derivative transformed dataset. In addition, the result obtained by the proposed method was compared with that of Partial Least Squares(PLS), which showed that the generalization performance of the classifier based on SVR was much better than that of PLS. The results demonstrate that shortwave NIR spectroscopy combined with SVR is promising for the quality control of soy sauce.展开更多
Support Vector-based learning methods are an important part of Computational Intelligence techniques. Recent efforts have been dealing with the problem of learning from very large datasets. This paper reviews the most...Support Vector-based learning methods are an important part of Computational Intelligence techniques. Recent efforts have been dealing with the problem of learning from very large datasets. This paper reviews the most commonly used formulations of support vector machines for regression (SVRs) aiming to emphasize its usability on large-scale applications. We review the general concept of support vector machines (SVMs), address the state-of-the-art on training methods SVMs, and explain the fundamental principle of SVRs. The most common learning methods for SVRs are introduced and linear programming-based SVR formulations are explained emphasizing its suitability for large-scale learning. Finally, this paper also discusses some open problems and current trends.展开更多
A method of multiple outputs least squares support vector regression (LS-SVR) was developed and described in detail, with the radial basis function (RBF) as the kernel function. The method was applied to predict t...A method of multiple outputs least squares support vector regression (LS-SVR) was developed and described in detail, with the radial basis function (RBF) as the kernel function. The method was applied to predict the future state of the power-shift steering transmission (PSST). A prediction model of PSST was gotten with multiple outputs LS-SVR. The model performance was greatly influenced by the penalty parameter γ and kernel parameter σ2 which were optimized using cross validation method. The training and prediction of the model were done with spectrometric oil analysis data. The predictive and actual values were compared and a fault in the second PSST was found. The research proved that this method had good accuracy in PSST fault prediction, and any possible problem in PSST could be found through a comparative analysis.展开更多
To study the relationship between chlorophyll-a and environmental variables during spring algal bloom in Xiangxi Bay of Three Gorges Reservoir, the support vector regression (SVR) model was established. In surveys, 11...To study the relationship between chlorophyll-a and environmental variables during spring algal bloom in Xiangxi Bay of Three Gorges Reservoir, the support vector regression (SVR) model was established. In surveys, 11 stations have been investigated and 264 samples were collected weekly from March 4 to May 13 in 2007 and February 16 to May 10 in 2008. The parameters in SVR model were optimized by leave one out cross validation. The squared correlation coefficient R2 and the cross validated squared correlation coefficient Q2 of the optimal SVR model are 0.8202 and 0.7301, respectively. Compared with stepwise multiple linear regression and back propagation artificial neural network models using external validation, the SVR model has been shown to perform well for regression with the predictive squared correlation coefficient R2pred value of 0.7842 for the test set.展开更多
基金financially supported by the NationalNatural Science Foundation of China(Grant No.42072309)the Fundamental Research Funds for National University,China University of Geosciences(Wuhan)(Grant No.CUGDCJJ202217)+1 种基金the Knowledge Innovation Program of Wuhan-Basic Research(Grant No.2022020801010199)the Hubei Key Laboratory of Blasting Engineering Foundation(HKLBEF202002).
文摘Accurately estimating blasting vibration during rock blasting is the foundation of blasting vibration management.In this study,Tuna Swarm Optimization(TSO),Whale Optimization Algorithm(WOA),and Cuckoo Search(CS)were used to optimize two hyperparameters in support vector regression(SVR).Based on these methods,three hybrid models to predict peak particle velocity(PPV)for bench blasting were developed.Eighty-eight samples were collected to establish the PPV database,eight initial blasting parameters were chosen as input parameters for the predictionmodel,and the PPV was the output parameter.As predictive performance evaluation indicators,the coefficient of determination(R2),rootmean square error(RMSE),mean absolute error(MAE),and a10-index were selected.The normalizedmutual information value is then used to evaluate the impact of various input parameters on the PPV prediction outcomes.According to the research findings,TSO,WOA,and CS can all enhance the predictive performance of the SVR model.The TSO-SVR model provides the most accurate predictions.The performances of the optimized hybrid SVR models are superior to the unoptimized traditional prediction model.The maximum charge per delay impacts the PPV prediction value the most.
基金supported by Princess Nourah bint Abdulrahman University Researchers Supporting Project Number(PNURSP2022R194)Princess Nourah bint Abdulrahman University,Riyadh,Saudi Arabia.
文摘In this present time,Human Activity Recognition(HAR)has been of considerable aid in the case of health monitoring and recovery.The exploitation of machine learning with an intelligent agent in the area of health informatics gathered using HAR augments the decision-making quality and significance.Although many research works conducted on Smart Healthcare Monitoring,there remain a certain number of pitfalls such as time,overhead,and falsification involved during analysis.Therefore,this paper proposes a Statistical Partial Regression and Support Vector Intelligent Agent Learning(SPR-SVIAL)for Smart Healthcare Monitoring.At first,the Statistical Partial Regression Feature Extraction model is used for data preprocessing along with the dimensionality-reduced features extraction process.Here,the input dataset the continuous beat-to-beat heart data,triaxial accelerometer data,and psychological characteristics were acquired from IoT wearable devices.To attain highly accurate Smart Healthcare Monitoring with less time,Partial Least Square helps extract the dimensionality-reduced features.After that,with these resulting features,SVIAL is proposed for Smart Healthcare Monitoring with the help of Machine Learning and Intelligent Agents to minimize both analysis falsification and overhead.Experimental evaluation is carried out for factors such as time,overhead,and false positive rate accuracy concerning several instances.The quantitatively analyzed results indicate the better performance of our proposed SPR-SVIAL method when compared with two state-of-the-art methods.
基金the National Defense Science and Technology Key Laboratory Fund of China(XM2020XT1023).
文摘As one of the most important part of weapon system of systems(WSoS),quantitative evaluation of reconnaissance satellite system(RSS)is indispensable during its construction and application.Aiming at the problem of nonlinear effectiveness evaluation under small sample conditions,we propose an evaluation method based on support vector regression(SVR)to effectively address the defects of traditional methods.Considering the performance of SVR is influenced by the penalty factor,kernel type,and other parameters deeply,the improved grey wolf optimizer(IGWO)is employed for parameter optimization.In the proposed IGWO algorithm,the opposition-based learning strategy is adopted to increase the probability of avoiding the local optima,the mutation operator is used to escape from premature convergence and differential convergence factors are applied to increase the rate of convergence.Numerical experiments of 14 test functions validate the applicability of IGWO algorithm dealing with global optimization.The index system and evaluation method are constructed based on the characteristics of RSS.To validate the proposed IGWO-SVR evaluation method,eight benchmark data sets and combat simulation are employed to estimate the evaluation accuracy,convergence performance and computational complexity.According to the experimental results,the proposed method outperforms several prediction based evaluation methods,verifies the superiority and effectiveness in RSS operational effectiveness evaluation.
基金Supported by National Natural Science Foundation Of China (60873235, 60473099), Science-Technology Development Key Project of Jilin Province of China (20080318), and Program of New Century Excellent Talents in University of China (NCET-06-0300)
基金Supported by Guangdong Natural Science Foundation Project(No.S2011010002144)Province and Ministry Production and Research Projects(No.2012B091100497,2012B091100191,2012B091100383)+1 种基金Guangdong Province Enterprise Laboratory Project(No.2011A091000046)Guangdong Province Science and Technology Major Project(No.2012A080103010)
文摘Regression analysis is often formulated as an optimization problem with squared loss functions.Facing the challenge of the selection of the proper function class with polynomial smooth techniques applied to support vector regression models,this study takes cubic spline interpolation to generate a new polynomial smooth function |x|_ε~2 in ε-insensitive support vector regression.Theoretical analysis shows that S_ε~2-function is better than p_ε~2-function in properties,and the approximation accuracy of the proposed smoothing function is two order higher than that of classical p_ε~2-function.The experimental data shows the efficiency of the new approach.
基金Supported by the National Natural Science Foundation of China (No. 60873235&60473099)the Science-Technology Development Key Project of Jilin Province of China (No. 20080318)the Program of New Century Excellent Talents in University of China (No. NCET-06-0300).
文摘The theory of nu-support vector regression (Nu-SVR) is employed in modeling time series variationfor prediction. In order to avoid prediction performance degradation caused by improper parameters, themethod of parallel multidimensional step search (PMSS) is proposed for users to select best parameters intraining support vector machine to get a prediction model. A series of tests are performed to evaluate themodeling mechanism and prediction results indicate that Nu-SVR models can reflect the variation tendencyof time series with low prediction error on both familiar and unfamiliar data. Statistical analysis is alsoemployed to verify the optimization performance of PMSS algorithm and comparative results indicate thattraining error can take the minimum over the interval around planar data point corresponding to selectedparameters. Moreover, the introduction of parallelization can remarkably speed up the optimizing procedure.
基金Project supported by the National Natural Science Foundation of China (Grant No 60573065)the Natural Science Foundation of Shandong Province,China (Grant No Y2007G33)the Key Subject Research Foundation of Shandong Province,China(Grant No XTD0708)
文摘In this paper we apply the nonlinear time series analysis method to small-time scale traffic measurement data. The prediction-based method is used to determine the embedding dimension of the traffic data. Based on the reconstructed phase space, the local support vector machine prediction method is used to predict the traffic measurement data, and the BIC-based neighbouring point selection method is used to choose the number of the nearest neighbouring points for the local support vector machine regression model. The experimental results show that the local support vector machine prediction method whose neighbouring points are optimized can effectively predict the small-time scale traffic measurement data and can reproduce the statistical features of real traffic measurements.
文摘Choosing optimal parameters for support vector regression (SVR) is an important step in SVR. design, which strongly affects the pefformance of SVR. In this paper, based on the analysis of influence of SVR parameters on generalization error, a new approach with two steps is proposed for selecting SVR parameters, First the kernel function and SVM parameters are optimized roughly through genetic algorithm, then the kernel parameter is finely adjusted by local linear search, This approach has been successfully applied to the prediction model of the sulfur content in hot metal. The experiment results show that the proposed approach can yield better generalization performance of SVR than other methods,
基金supported by National Natural Science Foundation of China (Grant No.60572007)National Basic Research Program of China(973 Program,Grant No.613580202)
文摘Metamodeling techniques have been used in robust optimization to reduce the high computational cost of the uncertainty analysis and improve the performance of robust optimization problems with computationally expensive simulation models. Existing metamodels main focus on polynomial regression(PR), neural networks(NN) and Kriging models, these metamodels are not well suited for large-scale robust optimization problems with small size training sets and high nonlinearity. To address the problem, a reduced approximation model technique based on support vector regression(SVR) is introduced in order to improve the accuracy of metamodels. A robust optimization method based on SVR is presented for problems that involve high dimension and nonlinear. First appropriate design parameter samples are selected by experimental design theories, then the response samples are obtained from the simulations such as finite element analysis, the SVR metamodel is constructed and treated as the mean and the variance of the objective performance functions. Combining other constraints, the robust optimization model is formed which can be solved by genetic algorithm (GA). The applicability of the method developed is demonstrated using a case of two-bar structure system study. The performances of SVR were compared with those of PR, Kriging and back-propagation neural networks(BPNN), the comparison results show that the prediction accuracy of the SVR metamodel was higher than those of other metamodels under uncertainty. The robust optimization solutions are near to the real result, and the proposed method is found to be accurate and efficient for robust optimization. This reaserch provides an efficient method for robust optimization problems with complex structure.
基金supported by the Basic Research Project of the Korea Institute of Geoscience and Mineral Resources(KIGAM)Project of Environmental Business Big Data Platform and Center Construction funded by the Ministry of Science and ICT。
文摘In this study,we developed multiple hybrid machine-learning models to address parameter optimization limitations and enhance the spatial prediction of landslide susceptibility models.We created a geographic information system database,and our analysis results were used to prepare a landslide inventory map containing 359 landslide events identified from Google Earth,aerial photographs,and other validated sources.A support vector regression(SVR)machine-learning model was used to divide the landslide inventory into training(70%)and testing(30%)datasets.The landslide susceptibility map was produced using 14 causative factors.We applied the established gray wolf optimization(GWO)algorithm,bat algorithm(BA),and cuckoo optimization algorithm(COA)to fine-tune the parameters of the SVR model to improve its predictive accuracy.The resultant hybrid models,SVR-GWO,SVR-BA,and SVR-COA,were validated in terms of the area under curve(AUC)and root mean square error(RMSE).The AUC values for the SVR-GWO(0.733),SVR-BA(0.724),and SVR-COA(0.738)models indicate their good prediction rates for landslide susceptibility modeling.SVR-COA had the greatest accuracy,with an RMSE of 0.21687,and SVR-BA had the least accuracy,with an RMSE of 0.23046.The three optimized hybrid models outperformed the SVR model(AUC=0.704,RMSE=0.26689),confirming the ability of metaheuristic algorithms to improve model performance.
基金funded by the National Natural Science Foundation of China(Grant No.42177164)the Innovation-Driven Project of Central South University(Grant No.2020CX040)supported by China Scholarship Council(Grant No.202006370006)。
文摘The main purpose of blasting operation is to produce desired and optimum mean size rock fragments.Smaller or fine fragments cause the loss of ore during loading and transportation,whereas large or coarser fragments need to be further processed,which enhances production cost.Therefore,accurate prediction of rock fragmentation is crucial in blasting operations.Mean fragment size(MFS) is a crucial index that measures the goodness of blasting designs.Over the past decades,various models have been proposed to evaluate and predict blasting fragmentation.Among these models,artificial intelligence(AI)-based models are becoming more popular due to their outstanding prediction results for multiinfluential factors.In this study,support vector regression(SVR) techniques are adopted as the basic prediction tools,and five types of optimization algorithms,i.e.grid search(GS),grey wolf optimization(GWO),particle swarm optimization(PSO),genetic algorithm(GA) and salp swarm algorithm(SSA),are implemented to improve the prediction performance and optimize the hyper-parameters.The prediction model involves 19 influential factors that constitute a comprehensive blasting MFS evaluation system based on AI techniques.Among all the models,the GWO-v-SVR-based model shows the best comprehensive performance in predicting MFS in blasting operation.Three types of mathematical indices,i.e.mean square error(MSE),coefficient of determination(R^(2)) and variance accounted for(VAF),are utilized for evaluating the performance of different prediction models.The R^(2),MSE and VAF values for the training set are 0.8355,0.00138 and 80.98,respectively,whereas 0.8353,0.00348 and 82.41,respectively for the testing set.Finally,sensitivity analysis is performed to understand the influence of input parameters on MFS.It shows that the most sensitive factor in blasting MFS is the uniaxial compressive strength.
基金supported by the National Natural Science Foundation of China(61172127)the Natural Science Foundation of Anhui Province(1408085MF121)
文摘Removal of cloud cover on the satellite remote sensing image can effectively improve the availability of remote sensing images. For thin cloud cover, support vector value contourlet transform is used to achieve multi-scale decomposition of the area of thin cloud cover on remote sensing images. Through enhancing coefficients of high frequency and suppressing coefficients of low frequency, the thin cloud is removed. For thick cloud cover, if the areas of thick cloud cover on multi-source or multi-temporal remote sensing images do not overlap, the multi-output support vector regression learning method is used to remove this kind of thick clouds. If the thick cloud cover areas overlap, by using the multi-output learning of the surrounding areas to predict the surface features of the overlapped thick cloud cover areas, this kind of thick cloud is removed. Experimental results show that the proposed cloud removal method can effectively solve the problems of the cloud overlapping and radiation difference among multi-source images. The cloud removal image is clear and smooth.
文摘A novel data-driven, soft sensor based on support vector regression (SVR) integrated with a data compression technique was developed to predict the product quality for the hydrodesulfurization (HDS) process. A wide range of experimental data was taken from a HDS setup to train and test the SVR model. Hyper-parameter tuning is one of the main challenges to improve predictive accuracy of the SVR model. Therefore, a hybrid approach using a combination of genetic algorithm (GA) and sequential quadratic programming (SQP) methods (GA-SQP) was developed. Performance of different optimization algorithms including GA-SQP, GA, pattern search (PS), and grid search (GS) indicated that the best average absolute relative error (AARE), squared correlation coefficient (R2), and computation time (CT) (AARE = 0.0745, R2 = 0.997 and CT = 56 s) was accomplished by the hybrid algorithm. Moreover, to reduce the CT and improve the accuracy of the SVR model, the vector quantization (VQ) technique was used. The results also showed that the VQ technique can decrease the training time and improve prediction performance of the SVR model. The proposed method can provide a robust, soft sensor in a wide range of sulfur contents with good accuracy.
基金supported by the National Natural Science Foundation of China (61074127)
文摘As the solutions of the least squares support vector regression machine (LS-SVRM) are not sparse, it leads to slow prediction speed and limits its applications. The defects of the ex- isting adaptive pruning algorithm for LS-SVRM are that the training speed is slow, and the generalization performance is not satis- factory, especially for large scale problems. Hence an improved algorithm is proposed. In order to accelerate the training speed, the pruned data point and fast leave-one-out error are employed to validate the temporary model obtained after decremental learning. The novel objective function in the termination condition which in- volves the whole constraints generated by all training data points and three pruning strategies are employed to improve the generali- zation performance. The effectiveness of the proposed algorithm is tested on six benchmark datasets. The sparse LS-SVRM model has a faster training speed and better generalization performance.
文摘Prediction of primary quality variables in real time with adaptation capability for varying process conditions is a critical task in process industries.This article focuses on the development of non-linear adaptive soft sensors for prediction of naphtha initial boiling point(IBP)and end boiling point(EBP)in crude distillation unit.In this work,adaptive inferential sensors with linear and non-linear local models are reported based on recursive just in time learning(JITL)approach.The different types of local models designed are locally weighted regression(LWR),multiple linear regression(MLR),partial least squares regression(PLS)and support vector regression(SVR).In addition to model development,the effect of relevant dataset size on model prediction accuracy and model computation time is also investigated.Results show that the JITL model based on support vector regression with iterative single data algorithm optimization(ISDA)local model(JITL-SVR:ISDA)yielded best prediction accuracy in reasonable computation time.
基金Sponsored by the Projects of International Cooperation and Exchange of the National Natural Science Foundation of China(Grant No.51561135003)the Scientific Research Foundation of Graduated School of Southeast University(Grant No.YBJJ1842)
文摘In order to accurately predict bus travel time, a hybrid model based on combining wavelet transform technique with support vector regression(WT-SVR) model is employed. In this model, wavelet decomposition is used to extract important information of data at different levels and enhances the forecasting ability of the model. After wavelet transform different components are forecasted by their corresponding SVR predictors. The final prediction result is obtained by the summation of the predicted results for each component. The proposed hybrid model is examined by the data of bus route No.550 in Nanjing, China. The performance of WT-SVR model is evaluated by mean absolute error(MAE), mean absolute percent error(MAPE) and relative mean square error(RMSE), and also compared to regular SVR and ANN models. The results show that the prediction method based on wavelet transform and SVR has better tracking ability and dynamic behavior than regular SVR and ANN models. The forecasting performance is remarkably improved to obtain within 6% MAPE for testing section Ⅰ and 8% MAPE for testing section Ⅱ, which proves that the suggested approach is feasible and applicable in bus travel time prediction.
基金Supported by the Harbin Technological Innovation Special Fund Research Projects, China(No.RC2006QN020015)
文摘The modern near-infrared(NIR) spectroscopy analysis is a simple, efficient and nondestructive technique, which has been used in chemical analysis in diverse fields. Shortwave NIR spectroscopy is also a rapid, flexible, and cost-effective method to control product quality in food industry. The method of support vector regression coupled with shortwave NIR spectroscopy was explored for the nondestructive quantitative analysis of the important quality parameters of soy sauce, including amino nitrogen content, total acid content, salt content and color ratio. In this study, the support vector regression(SVR) models based on subtractive spectra and positive spectra were found and compared, the results show that the subtractive spectrum was more excellent than the positive spectrum. Meanwhile, R and RSE were determined, respectively, by means of original spectra and pretreated spectra[standard normal variate (SNV), first-derivative and second-derivative], and the corresponding models were successfully established. The best prediction was achieved by a support vector regression model of the first derivative transformed dataset. In addition, the result obtained by the proposed method was compared with that of Partial Least Squares(PLS), which showed that the generalization performance of the classifier based on SVR was much better than that of PLS. The results demonstrate that shortwave NIR spectroscopy combined with SVR is promising for the quality control of soy sauce.
文摘Support Vector-based learning methods are an important part of Computational Intelligence techniques. Recent efforts have been dealing with the problem of learning from very large datasets. This paper reviews the most commonly used formulations of support vector machines for regression (SVRs) aiming to emphasize its usability on large-scale applications. We review the general concept of support vector machines (SVMs), address the state-of-the-art on training methods SVMs, and explain the fundamental principle of SVRs. The most common learning methods for SVRs are introduced and linear programming-based SVR formulations are explained emphasizing its suitability for large-scale learning. Finally, this paper also discusses some open problems and current trends.
基金Supported by the Ministerial Level Advanced Research Foundation(3031030)the"111"Project(B08043)
文摘A method of multiple outputs least squares support vector regression (LS-SVR) was developed and described in detail, with the radial basis function (RBF) as the kernel function. The method was applied to predict the future state of the power-shift steering transmission (PSST). A prediction model of PSST was gotten with multiple outputs LS-SVR. The model performance was greatly influenced by the penalty parameter γ and kernel parameter σ2 which were optimized using cross validation method. The training and prediction of the model were done with spectrometric oil analysis data. The predictive and actual values were compared and a fault in the second PSST was found. The research proved that this method had good accuracy in PSST fault prediction, and any possible problem in PSST could be found through a comparative analysis.
文摘To study the relationship between chlorophyll-a and environmental variables during spring algal bloom in Xiangxi Bay of Three Gorges Reservoir, the support vector regression (SVR) model was established. In surveys, 11 stations have been investigated and 264 samples were collected weekly from March 4 to May 13 in 2007 and February 16 to May 10 in 2008. The parameters in SVR model were optimized by leave one out cross validation. The squared correlation coefficient R2 and the cross validated squared correlation coefficient Q2 of the optimal SVR model are 0.8202 and 0.7301, respectively. Compared with stepwise multiple linear regression and back propagation artificial neural network models using external validation, the SVR model has been shown to perform well for regression with the predictive squared correlation coefficient R2pred value of 0.7842 for the test set.