Comparison of debris flow susceptibility assessment methods:support vector machine,particle swarm optimization,and feature selection techniques

The selection of important factors in machine learning-based susceptibility assessments is crucial to obtain reliable susceptibility results.In this study,metaheuristic optimization and feature selection techniques were applied to identify the most important input parameters for mapping debris flow susceptibility in the southern mountain area of Chengde City in Hebei Province,China,by using machine learning algorithms.In total,133 historical debris flow records and 16 related factors were selected.The support vector machine(SVM)was first used as the base classifier,and then a hybrid model was introduced by a two-step process.First,the particle swarm optimization(PSO)algorithm was employed to select the SVM model hyperparameters.Second,two feature selection algorithms,namely principal component analysis(PCA)and PSO,were integrated into the PSO-based SVM model,which generated the PCA-PSO-SVM and FS-PSO-SVM models,respectively.Three statistical metrics(accuracy,recall,and specificity)and the area under the receiver operating characteristic curve(AUC)were employed to evaluate and validate the performance of the models.The results indicated that the feature selection-based models exhibited the best performance,followed by the PSO-based SVM and SVM models.Moreover,the performance of the FS-PSO-SVM model was better than that of the PCA-PSO-SVM model,showing the highest AUC,accuracy,recall,and specificity values in both the training and testing processes.It was found that the selection of optimal features is crucial to improving the reliability of debris flow susceptibility assessment results.Moreover,the PSO algorithm was found to be not only an effective tool for hyperparameter optimization,but also a useful feature selection algorithm to improve prediction accuracies of debris flow susceptibility by using machine learning algorithms.The high and very high debris flow susceptibility zone appropriately covers 38.01%of the study area,where debris flow may occur under intensive human activities and heavy rainfall events.

Feature Extraction of Stored-grain Insects Based on Ant Colony Optimization and Support Vector Machine Algorithm

[Objective] The aim was to study the feature extraction of stored-grain insects based on ant colony optimization and support vector machine algorithm, and to explore the feasibility of the feature extraction of stored-grain insects. [Method] Through the analysis of feature extraction in the image recognition of the stored-grain insects, the recognition accuracy of the cross-validation training model in support vector machine （SVM） algorithm was taken as an important factor of the evaluation principle of feature extraction of stored-grain insects. The ant colony optimization （ACO） algorithm was applied to the automatic feature extraction of stored-grain insects. [Result] The algorithm extracted the optimal feature subspace of seven features from the 17 morphological features, including area and perimeter. The ninety image samples of the stored-grain insects were automatically recognized by the optimized SVM classifier, and the recognition accuracy was over 95%. [Conclusion] The experiment shows that the application of ant colony optimization to the feature extraction of grain insects is practical and feasible.

HHO optimized support vector machine classifier for traditional Chinese medicine syndrome differentiation of diabetic retinopathy

AIM:To develop a classifier for traditional Chinese medicine(TCM)syndrome differentiation of diabetic retinopathy(DR),using optimized machine learning algorithms,which can provide the basis for TCM objective and intelligent syndrome differentiation.METHODS:Collated data on real-world DR cases were collected.A variety of machine learning methods were used to construct TCM syndrome classification model,and the best performance was selected as the basic model.Genetic Algorithm(GA)was used for feature selection to obtain the optimal feature combination.Harris Hawk Optimization(HHO)was used for parameter optimization,and a classification model based on feature selection and parameter optimization was constructed.The performance of the model was compared with other optimization algorithms.The models were evaluated with accuracy,precision,recall,and F1 score as indicators.RESULTS:Data on 970 cases that met screening requirements were collected.Support Vector Machine(SVM)was the best basic classification model.The accuracy rate of the model was 82.05%,the precision rate was 82.34%,the recall rate was 81.81%,and the F1 value was 81.76%.After GA screening,the optimal feature combination contained 37 feature values,which was consistent with TCM clinical practice.The model based on optimal combination and SVM(GA_SVM)had an accuracy improvement of 1.92%compared to the basic classifier.SVM model based on HHO and GA optimization(HHO_GA_SVM)had the best performance and convergence speed compared with other optimization algorithms.Compared with the basic classification model,the accuracy was improved by 3.51%.CONCLUSION:HHO and GA optimization can improve the model performance of SVM in TCM syndrome differentiation of DR.It provides a new method and research idea for TCM intelligent assisted syndrome differentiation.

Parameter selection of support vector machine for function approximation based on chaos optimization

The support vector machine （SVM） is a novel machine learning method, which has the ability to approximate nonlinear functions with arbitrary accuracy. Setting parameters well is very crucial for SVM learning results and generalization ability, and now there is no systematic, general method for parameter selection. In this article, the SVM parameter selection for function approximation is regarded as a compound optimization problem and a mutative scale chaos optimization algorithm is employed to search for optimal paraxneter values. The chaos optimization algorithm is an effective way for global optimal and the mutative scale chaos algorithm could improve the search efficiency and accuracy. Several simulation examples show the sensitivity of the SVM parameters and demonstrate the superiority of this proposed method for nonlinear function approximation.

Identifcation of large-scale goaf instability in underground mine using particle swarm optimization and support vector machine

An approach which combines particle swarm optimization and support vector machine(PSO–SVM)is proposed to forecast large-scale goaf instability(LSGI).Firstly,influencing factors of goaf safety are analyzed,and following parameters were selected as evaluation indexes in the LSGI:uniaxial compressive strength(UCS)of rock,elastic modulus(E)of rock,rock quality designation(RQD),area ration of pillar(Sp),the ratio of width to height of the pillar(w/h),depth of ore body(H),volume of goaf(V),dip of ore body(a)and area of goaf(Sg).Then LSGI forecasting model by PSO-SVM was established according to the influencing factors.The performance of hybrid model(PSO+SVM=PSO–SVM)has been compared with the grid search method of support vector machine(GSM–SVM)model.The actual data of 40 goafs are applied to research the forecasting ability of the proposed method,and two cases of underground mine are also validated by the proposed model.The results indicated that the heuristic algorithm of PSO can speed up the SVM parameter optimization search,and the predictive ability of the PSO–SVM model with the RBF kernel function is acceptable and robust,which might hold a high potential to become a useful tool in goaf risky prediction research.

Support vector machine forecasting method improved by chaotic particle swarm optimization and its application

By adopting the chaotic searching to improve the global searching performance of the particle swarm optimization (PSO), and using the improved PSO to optimize the key parameters of the support vector machine (SVM) forecasting model, an improved SVM model named CPSO-SVM model was proposed. The new model was applied to predicting the short term load, and the improved effect of the new model was proved. The simulation results of the South China Power Market’s actual data show that the new method can effectively improve the forecast accuracy by 2.23% and 3.87%, respectively, compared with the PSO-SVM and SVM methods. Compared with that of the PSO-SVM and SVM methods, the time cost of the new model is only increased by 3.15 and 4.61 s, respectively, which indicates that the CPSO-SVM model gains significant improved effects.

A new support vector machine optimized by improved particle swarm optimization and its application

A new support vector machine （SVM） optimized by an improved particle swarm optimization （PSO） combined with simulated annealing algorithm （SA） was proposed. By incorporating with the simulated annealing method, the global searching capacity of the particle swarm optimization（SAPSO） was enchanced, and the searching capacity of the particle swarm optimization was studied. Then, the improyed particle swarm optimization algorithm was used to optimize the parameters of SVM （c,σ and ε）. Based on the operational data provided by a regional power grid in north China, the method was used in the actual short term load forecasting. The results show that compared to the PSO-SVM and the traditional SVM, the average time of the proposed method in the experimental process reduces by 11.6 s and 31.1 s, and the precision of the proposed method increases by 1.24% and 3.18%, respectively. So, the improved method is better than the PSO-SVM and the traditional SVM.

Intelligent Optimization Methods for High-Dimensional Data Classification for Support Vector Machines

Support vector machine (SVM) is a popular pattern classification method with many application areas. SVM shows its outstanding performance in high-dimensional data classification. In the process of classification, SVM kernel parameter setting during the SVM training procedure, along with the feature selection significantly influences the classification accuracy. This paper proposes two novel intelligent optimization methods, which simultaneously determines the parameter values while discovering a subset of features to increase SVM classification accuracy. The study focuses on two evolutionary computing approaches to optimize the parameters of SVM: particle swarm optimization (PSO) and genetic algorithm (GA). And we combine above the two intelligent optimization methods with SVM to choose appropriate subset features and SVM parameters, which are termed GA-FSSVM (Genetic Algorithm-Feature Selection Support Vector Machines) and PSO-FSSVM(Particle Swarm Optimization-Feature Selection Support Vector Machines) models. Experimental results demonstrate that the classification accuracy by our proposed methods outperforms traditional grid search approach and many other approaches. Moreover, the result indicates that PSO-FSSVM can obtain higher classification accuracy than GA-FSSVM classification for hyperspectral data.

Support vector machine based on chaos particle swarm optimization for fault diagnosis of rotating machine

The performance of the support vector machine models depends on a proper setting of its parameters to a great extent.A novel method of searching the optimal parameters of support vector machine based on chaos particle swarm optimization is proposed.A multi-fault classification model based on SVM optimized by chaos particle swarm optimization is established and applied to the fault diagnosis of rotating machines.The results show that the proposed fault classification model outperforms the neural network trained by chaos particle swarm optimization and least squares support vector machine,and the precision and reliability of the fault classification results can meet the requirement of practical application.It indicates that chaos particle swarm optimization is a suitable method for searching the optimal parameters of support vector machine.

Design of Ballistic Consistency Based on Least Squares Support Vector Machine and Particle Swarm Optimization

In order to improve the firing efficiency of projectiles,it is required to use the universal firing table for gun weapon system equipped with a variety of projectiles.Moreover,the foundation of sharing the universal firing table is the ballistic matching for two types of projectiles.Therefore,a method is proposed in the process of designing new type of projectile.The least squares support vector machine is utilized to build the ballistic trajectory model of the original projectile,thus it is viable to compare the two trajectories.Then the particle swarm optimization is applied to find the combination of trajectory parameters which meet the criterion of ballistic matching best.Finally,examples show the proposed method is valid and feasible.

Seasonal Least Squares Support Vector Machine with Fruit Fly Optimization Algorithm in Electricity Consumption Forecasting

Electricity is the guarantee of economic development and daily life. Thus, accurate monthly electricity consumption forecasting can provide reliable guidance for power construction planning. In this paper, a hybrid model in combination of least squares support vector machine(LSSVM) model with fruit fly optimization algorithm(FOA) and the seasonal index adjustment is constructed to predict monthly electricity consumption. The monthly electricity consumption demonstrates a nonlinear characteristic and seasonal tendency. The LSSVM has a good fit for nonlinear data, so it has been widely applied to handling nonlinear time series prediction. However, there is no unified selection method for key parameters and no unified method to deal with the effect of seasonal tendency. Therefore, the FOA was hybridized with the LSSVM and the seasonal index adjustment to solve this problem. In order to evaluate the forecasting performance of hybrid model, two samples of monthly electricity consumption of China and the United States were employed, besides several different models were applied to forecast the two empirical time series. The results of the two samples all show that, for seasonal data, the adjusted model with seasonal indexes has better forecasting performance. The forecasting performance is better than the models without seasonal indexes. The fruit fly optimized LSSVM model outperforms other alternative models. In other words, the proposed hybrid model is a feasible method for the electricity consumption forecasting.

Analysis of Water Pollution Causes and Control Countermeasures in Liaohe Estuary via Support Vector Machine Particle Swarm Optimization under Deep Learning

This study explores the loss or degradation of the ecosystem and its service function in the Liaohe estuary coastal zone due to the deterioration ofwater quality.Aprediction systembased on support vectormachine(SVM)-particle swarm optimization(PSO)(SVM-PSO)algorithm is proposed under the background of deep learning.SVM-PSO algorithm is employed to analyze the pollution status of the Liaohe estuary,so is the difference in water pollution of different sea consuming types.Based on the analysis results for causes of pollution,the control countermeasures of water pollution in Liaohe estuary are put forward.The results suggest that the water pollution index prediction model based on SVM-PSO algorithm shows the maximum error of 2.41%,the average error of 1.24%in predicting the samples,the root mean square error(RMSE)of 5.36×10^(−4),and the square of correlation coefficient of 0.91.Therefore,the prediction system in this study is feasible.At present,the water pollution status of Liaohe estuary is of moderate and severe levels of eutrophication,and the water pollution status basically remains at the level of mild pollution.The general trend is fromphosphorus moderate restricted eutrophication to phosphorus restricted potential eutrophication.To sumup,the SVM-PSO algorithm shows good sewage prediction ability,which can be applied and promoted in water pollution control and has reliable reference significance.

Application of particle swarm optimization-based least square support vector machine in quantitative analysis of extraction solution of yangxinshi tablet using near infrared spectroscopy

A particle swarm optimization(PSO)-based least square support vector machine(LS-SVM)method was investigated for quantitative analysis of extraction solution of Y angxinshi tablet using near infrared(NIR)spectroscopy.The usable spectral region(5400-6200cm^(-1))was identified,then the first derivative spectra smoothed using a Savitzky-Golay filter were employed to establish calibration models.The PSO algorithm was applied to select the LS-SVM hyper-parameters(including the regularization and kernel parametens).The calibration models of total flavonoids,puerarin,salvianolic acid B and icarin were established using the optimumn hyper-parameters of LS SVM.The performance of LS SVM models were compared with partial least squares(PLS)regression,feed forward back propagation network(BPANN)and support vector machine(SVM).Experimental results showed that both the calibration results and prediction accuracy of the PSO-based LS SVM method were superior to PLS,BP-ANN and SVM.For PSO-based LS-SVM models,the determination cofficients(R2)for the calibration set were above 0.9881,and the RSEP values were controlled within 5.772%.For the validation set,the RMSEP values were close to RMSEC and less than 0.042,the RSEP values were under 8.778%,which were much lower than the PLS,BP-ANN and SVM models.The PSO-based LS SVM algorithm employed in this study exhibited excellent calibration performance and prediction accuracy,which has definite practice significance and application value.

Hybrid Optimization of Support Vector Machine for Intrusion Detection

Support vector machine (SVM) technique has recently become a research focus in intrusion detection field for its better generalization performance when given less priori knowledge than other soft-computing techniques. But the randomicity of parameter selection in its implement often prevents it achieving expected performance. By utilizing genetic algorithm (GA) to optimize the parameters in data preprocessing and the training model of SVM simultaneously, a hybrid optimization algorithm is proposed in the paper to address this problem. The experimental results demonstrate that it’s an effective method and can improve the performance of SVM-based intrusion detection system further.

A Transductive Support Vector Machine Algorithm Based on Ant Colony Optimization

Transductive support vector machine optimization problem is a NP problem, in the case of larger number of labeled samples, it is often difficult to obtain a global optimal solution, thereby the good generalization ability of transductive learning has been affected. Previous methods can not give consideration to both running efficiency and classification precision. In this paper, a transductive support vector machine algorithm based on ant colony optimization is proposed to overcome the drawbacks of the previous methods. The proposed algorithm approaches the approximate optimal solution of Transductive support vector machine optimization problem by ant colony optimization algorithm, and the advantage of transductive learning can be fully demonstrated. Experiments on several UCI standard datasets and the newsgroups 20 dataset showed that, with respect to running time and classification precision, the proposed algorithm has obvious advantage over the previous algorithms.

Support vector machine based nonlinear model multi-step-ahead optimizing predictive control

A support vector machine with guadratic polynomial kernel function based nonlinear model multi-step-ahead optimizing predictive controller was presented. A support vector machine based predictive model was established by black-box identification. And a quadratic objective function with receding horizon was selected to obtain the controller output. By solving a nonlinear optimization problem with equality constraint of model output and boundary constraint of controller output using Nelder-Mead simplex direct search method, a sub-optimal control law was achieved in feature space. The effect of the controller was demonstrated on a recognized benchmark problem and a continuous-stirred tank reactor. The simulation results show that the multi-step-ahead predictive controller can be well applied to nonlinear system, with better performance in following reference trajectory and disturbance-rejection.

Optimized Complex Power Quality Classifier Using One vs. Rest Support Vector Machines

Nowadays, power quality issues are becoming a significant research topic because of the increasing inclusion of very sensitive devices and considerable renewable energy sources. In general, most of the previous power quality classification techniques focused on single power quality events and did not include an optimal feature selection process. This paper presents a classification system that employs Wavelet Transform and the RMS profile to extract the main features of the measured waveforms containing either single or complex disturbances. A data mining process is designed to select the optimal set of features that better describes each disturbance present in the waveform. Support Vector Machine binary classifiers organized in a “One Vs Rest” architecture are individually optimized to classify single and complex disturbances. The parameters that rule the performance of each binary classifier are also individually adjusted using a grid search algorithm that helps them achieve optimal performance. This specialized process significantly improves the total classification accuracy. Several single and complex disturbances were simulated in order to train and test the algorithm. The results show that the classifier is capable of identifying >99% of single disturbances and >97% of complex disturbances.

Iterative optimal control based on support vector machine modeling within the Bayesian evidence framework

In the paper, an iterative method is presented to the optimal control of batch processes. Generally it is very difficult to acquire an accurate mechanistic model for a batch process. Because support vector machine is powerful for the problems characterized by small samples, nonlinearity, high dimension and local minima, support vector regression models are developed for the optimal control of batch processes where end-point properties are required. The model parameters are selected within the Bayesian evidence framework. Based on the model, an iterative method is used to exploit the repetitive nature of batch processes to determine the optimal operating policy. Numerical simulation shows that the iterative optimal control can improve the process performance through iterations.

Cuckoo Optimized Convolution Support Vector Machine for Big Health Data Processing

Big health data collection and storing for further analysis is a challenging task because this knowledge is big and has many features.Several cloud-based IoT health providers have been described in the literature previously.Furthermore,there are a number of issues related to time consumed and overall network performance when it comes to big data information.In the existing method,less performed optimization algorithms were used for optimizing the data.In the proposed method,the Chaotic Cuckoo Optimization algorithm was used for feature selection,and Convolutional Support Vector Machine(CSVM)was used.The research presents a method for analyzing healthcare information that uses in future prediction.The major goal is to take a variety of data while improving efficiency and minimizing process time.The suggested method employs a hybrid method that is divided into two stages.In the first stage,it reduces the features by using the Chaotic Cuckoo Optimization algorithm with Levy flight,opposition-based learning,and distributor operator.In the second stage,CSVM is used which combines the benefits of convolutional neural network(CNN)and SVM.The CSVM modifies CNN’s convolution product to learn hidden deep inside data sources.For improved economic flexibility,greater protection,greater analytics with confidentiality,and lower operating cost,the suggested approach is built on fog computing.Overall results of the experiments show that the suggested method can minimize the number of features in the datasets,enhances the accuracy by 82%,and decrease the time of the process.

A Hybrid Model Based on Back-Propagation Neural Network and Optimized Support Vector Machine with Particle Swarm Algorithm for Assessing Blade Icing on Wind Turbines

With the continuous increase in the proportional use of wind energy across the globe,the reduction of power generation efficiency and safety hazards caused by the icing on wind turbine blades have attracted more consideration for research.Therefore,it is crucial to accurately analyze the thickness of icing on wind turbine blades,which can serve as a basis for formulating corresponding control measures and ensure a safe and stable operation of wind turbines in winter times and/or in high altitude areas.This paper fully utilized the advantages of the support vector machine(SVM)and back-propagation neural network(BPNN),with the incorporation of particle swarm optimization(PSO)algorithms to optimize the parameters of the SVM.The paper proposes a hybrid assessment model of PSO-SVM and BPNN based on dynamic weighting rules.Three sets of icing data under a rotating working state of the wind turbine were used as examples for model verification.Based on a comparative analysis with other models,the results showed that the proposed model has better accuracy and stability in analyzing the icing on wind turbine blades.