POSITIVE DEFINITE KERNEL IN SUPPORT VECTOR MACHINE(SVM)

The relationship among Mercer kernel, reproducing kernel and positive definite kernel in support vector machine （SVM） is proved and their roles in SVM are discussed. The quadratic form of the kernel matrix is used to confirm the positive definiteness and their construction. Based on the Bochner theorem, some translation invariant kernels are checked in their Fourier domain. Some rotation invariant radial kernels are inspected according to the Schoenberg theorem. Finally, the construction of discrete scaling and wavelet kernels, the kernel selection and the kernel parameter learning are discussed.

Machine learning model based on non-convex penalized huberized-SVM

The support vector machine(SVM)is a classical machine learning method.Both the hinge loss and least absolute shrinkage and selection operator(LASSO)penalty are usually used in traditional SVMs.However,the hinge loss is not differentiable,and the LASSO penalty does not have the Oracle property.In this paper,the huberized loss is combined with non-convex penalties to obtain a model that has the advantages of both the computational simplicity and the Oracle property,contributing to higher accuracy than traditional SVMs.It is experimentally demonstrated that the two non-convex huberized-SVM methods,smoothly clipped absolute deviation huberized-SVM(SCAD-HSVM)and minimax concave penalty huberized-SVM(MCP-HSVM),outperform the traditional SVM method in terms of the prediction accuracy and classifier performance.They are also superior in terms of variable selection,especially when there is a high linear correlation between the variables.When they are applied to the prediction of listed companies,the variables that can affect and predict financial distress are accurately filtered out.Among all the indicators,the indicators per share have the greatest influence while those of solvency have the weakest influence.Listed companies can assess the financial situation with the indicators screened by our algorithm and make an early warning of their possible financial distress in advance with higher precision.

Facial Expression Recognition Model Depending on Optimized Support Vector Machine

In computer vision,emotion recognition using facial expression images is considered an important research issue.Deep learning advances in recent years have aided in attaining improved results in this issue.According to recent studies,multiple facial expressions may be included in facial photographs representing a particular type of emotion.It is feasible and useful to convert face photos into collections of visual words and carry out global expression recognition.The main contribution of this paper is to propose a facial expression recognitionmodel(FERM)depending on an optimized Support Vector Machine(SVM).To test the performance of the proposed model(FERM),AffectNet is used.AffectNet uses 1250 emotion-related keywords in six different languages to search three major search engines and get over 1,000,000 facial photos online.The FERM is composed of three main phases:(i)the Data preparation phase,(ii)Applying grid search for optimization,and(iii)the categorization phase.Linear discriminant analysis(LDA)is used to categorize the data into eight labels(neutral,happy,sad,surprised,fear,disgust,angry,and contempt).Due to using LDA,the performance of categorization via SVM has been obviously enhanced.Grid search is used to find the optimal values for hyperparameters of SVM(C and gamma).The proposed optimized SVM algorithm has achieved an accuracy of 99%and a 98%F1 score.

Support vector machine forecasting method improved by chaotic particle swarm optimization and its application

By adopting the chaotic searching to improve the global searching performance of the particle swarm optimization (PSO), and using the improved PSO to optimize the key parameters of the support vector machine (SVM) forecasting model, an improved SVM model named CPSO-SVM model was proposed. The new model was applied to predicting the short term load, and the improved effect of the new model was proved. The simulation results of the South China Power Market’s actual data show that the new method can effectively improve the forecast accuracy by 2.23% and 3.87%, respectively, compared with the PSO-SVM and SVM methods. Compared with that of the PSO-SVM and SVM methods, the time cost of the new model is only increased by 3.15 and 4.61 s, respectively, which indicates that the CPSO-SVM model gains significant improved effects.

Casing life prediction using Borda and support vector machine methods

Eight casing failure modes and 32 risk factors in oil and gas wells are given in this paper. According to the quantitative analysis of the influence degree and occurrence probability of risk factors, the Borda counts for failure modes are obtained with the Borda method. The risk indexes of failure modes are derived from the Borda matrix. Based on the support vector machine （SVM）, a casing life prediction model is established. In the prediction model, eight risk indexes are defined as input vectors and casing life is defined as the output vector. The ideal model parameters are determined with the training set from 19 wells with casing failure. The casing life prediction software is developed with the SVM model as a predictor. The residual life of 60 wells with casing failure is predicted with the software, and then compared with the actual casing life. The comparison results show that the casing life prediction software with the SVM model has high accuracy.

Time-variant reliability analysis of three-dimensional slopes based on Support Vector Machine method

In the reliability analysis of slope, the performance functions derived from the most available stability analysis procedures of slopes are usually implicit and cannot be solved by first-order second-moment approach. A new reliability analysis approach was presented based on three-dimensional Morgenstem-Price method to investigate three-dimensional effect of landslide in stability analyses. To obtain the reliability index, Support Vector Machine （SVM） was applied to approximate the performance function. The time-consuming of this approach is only 0.028% of that using Monte-Carlo method at the same computation accuracy. Also, the influence of time effect of shearing strength parameters of slope soils on the long-term reliability of three-dimensional slopes was investigated by this new approach. It is found that the reliability index of the slope would decrease by 52.54% and the failure probability would increase from 0.000 705% to 1.966%. In the end, the impact of variation coefficients of c andfon reliability index of slopes was taken into discussion and the changing trend was observed.

Intelligent Optimization Methods for High-Dimensional Data Classification for Support Vector Machines

Support vector machine (SVM) is a popular pattern classification method with many application areas. SVM shows its outstanding performance in high-dimensional data classification. In the process of classification, SVM kernel parameter setting during the SVM training procedure, along with the feature selection significantly influences the classification accuracy. This paper proposes two novel intelligent optimization methods, which simultaneously determines the parameter values while discovering a subset of features to increase SVM classification accuracy. The study focuses on two evolutionary computing approaches to optimize the parameters of SVM: particle swarm optimization (PSO) and genetic algorithm (GA). And we combine above the two intelligent optimization methods with SVM to choose appropriate subset features and SVM parameters, which are termed GA-FSSVM (Genetic Algorithm-Feature Selection Support Vector Machines) and PSO-FSSVM(Particle Swarm Optimization-Feature Selection Support Vector Machines) models. Experimental results demonstrate that the classification accuracy by our proposed methods outperforms traditional grid search approach and many other approaches. Moreover, the result indicates that PSO-FSSVM can obtain higher classification accuracy than GA-FSSVM classification for hyperspectral data.

An Efficient and Robust Fall Detection System Using Wireless Gait Analysis Sensor with Artificial Neural Network (ANN) and Support Vector Machine (SVM) Algorithms

In this work, a total of 322 tests were taken on young volunteers by performing 10 different falls, 6 different Activities of Daily Living (ADL) and 7 Dynamic Gait Index (DGI) tests using a custom-designed Wireless Gait Analysis Sensor (WGAS). In order to perform automatic fall detection, we used Back Propagation Artificial Neural Network (BP-ANN) and Support Vector Machine (SVM) based on the 6 features extracted from the raw data. The WGAS, which includes a tri-axial accelerometer, 2 gyroscopes, and a MSP430 microcontroller, is worn by the subjects at either T4 (at back) or as a belt-clip in front of the waist during the various tests. The raw data is wirelessly transmitted from the WGAS to a near-by PC for real-time fall classification. The BP ANN is optimized by varying the training, testing and validation data sets and training the network with different learning schemes. SVM is optimized by using three different kernels and selecting the kernel for best classification rate. The overall accuracy of BP ANN is obtained as 98.20% with LM and RPROP training from the T4 data, while from the data taken at the belt, we achieved 98.70% with LM and SCG learning. The overall accuracy using SVM was 98.80% and 98.71% with RBF kernel from the T4 and belt position data, respectively.

Support Vector Machines(SVM)-Markov Chain Prediction Model of Mining Water Inflow

This study was conducted to establish a Support Vector Machines(SVM)-Markov Chain prediction model for prediction of mining water inflow. According to the raw data sequence, the Support Vector Machines(SVM) model was built, and then revised by means of a Markov state change probability matrix. Through dividing the state and analyzing absolute errors and relative errors and other indexes of the measured value and the fitted value of SVM, the prediction results were improved. Finally,the model was used to calculate relative errors. Through predicting and analyzing mining water inflow, the prediction results of the model were satisfactory. The results of this study enlarge the application scope of the Support Vector Machines(SVM) prediction model and provide a new method for scientific forecasting water inflow in coal mining.

Vibration reliability analysis for aeroengine compressor blade based on support vector machine response surface method

To ameliorate reliability analysis efficiency for aeroengine components, such as compressor blade, support vector machine response surface method(SRSM) is proposed. SRSM integrates the advantages of support vector machine(SVM) and traditional response surface method(RSM), and utilizes experimental samples to construct a suitable response surface function(RSF) to replace the complicated and abstract finite element model. Moreover, the randomness of material parameters, structural dimension and operating condition are considered during extracting data so that the response surface function is more agreeable to the practical model. The results indicate that based on the same experimental data, SRSM has come closer than RSM reliability to approximating Monte Carlo method(MCM); while SRSM(17.296 s) needs far less running time than MCM(10958 s) and RSM(9840 s). Therefore,under the same simulation conditions, SRSM has the largest analysis efficiency, and can be considered a feasible and valid method to analyze structural reliability.

Novel Method of Predicting Network Bandwidth Based on Support Vector Machines

In order to solve the problems of small sample over-fitting and local minima when neural networks learn online, a novel method of predicting network bandwidth based on support vector machines(SVM) is proposed. The prediction and learning online will be completed by the proposed moving window learning algorithm(MWLA). The simulation research is done to validate the proposed method, which is compared with the method based on neural networks.

Method for Detecting Fluff Quality of Fabric Surface Based on Support Vector Machine

In order to improve the accuracy of using visual methods to detect the quality of fluff fabrics,based on the previous research,this paper proposes a method of rapid classification detection using support vector machine(SVM).The fabric image is acquired by the principle of light-cut imaging,and the region of interest is extracted by the method of grayscale horizontal projection.The obtained coordinates of the upper edge of the fabric are decomposed into high frequency information and low frequency information by wavelet transform,and the high frequency information is used as a data set for training.After experimental comparison and analysis,the detection rate of the SVM method proposed in this paper is higher than the previously proposed back propagation(BP)neural network and particle swarm optimization BP(PSO-BP)neural network detection methods,and the accuracy rate can reach 99.41%,which can meet the needs of industrial testing.

Krylov Iterative Methods for Support Vector Machines to Classify Galaxy Morphologies

Large catalogues of classified galaxy images have been useful in many studies of the universe in astronomy. There are too many objects to classify manually in the Sloan Digital Sky Survey, one of the premier data sources in astronomy. Therefore, efficient machine learning and classification algorithms are required to automate the classifying process. We propose to apply the Support Vector Machine (SVM) algorithm to classify galaxy morphologies and Krylov iterative methods to improve runtime of the classification. The accuracy of the classification is measured on various categories of galaxies from the survey. A three-class algorithm is presented that makes use of multiple SVMs. This algorithm is used to assign the categories of spiral, elliptical, and irregular galaxies. A selection of Krylov iterative solvers are compared based on their efficiency and accuracy of the resulting classification. The experimental results demonstrate that runtime can be significantly improved by utilizing Krylov iterative methods without impacting classification accuracy. The generalized minimal residual method (GMRES) is shown to be the most efficient solver to classify galaxy morphologies.

Structural Reliability Analysis Based on Support Vector Machine and Dual Neural Network Direct Integration Method

Aiming at the reliability analysis of small sample data or implicit structural function,a novel structural reliability analysis model based on support vector machine(SVM)and neural network direct integration method(DNN)is proposed.Firstly,SVM with good small sample learning ability is used to train small sample data,fit structural performance functions and establish regular integration regions.Secondly,DNN is approximated the integral function to achieve multiple integration in the integration region.Finally,structural reliability was obtained by DNN.Numerical examples are investigated to demonstrate the effectiveness of the present method,which provides a feasible way for the structural reliability analysis.

Support vector machines approach to mean particle size of rock fragmentation due to bench blasting prediction

Aiming at the problems of the traditional method of assessing distribution of particle size in bench blasting, a support vector machines （SVMs） regression methodology was used to predict the mean particle size （X50） resulting from rock blast fragmentation in various mines based on the statistical learning theory. The data base consisted of blast design parameters, explosive parameters, modulus of elasticity and in-situ block size. The seven input independent variables used for the SVMs model for the prediction of X50 of rock blast fragmentation were the ratio of bench height to drilled burden （H/B）, ratio of spacing to burden （S/B）, ratio of burden to hole diameter （B/D）, ratio of stemming to burden （T/B）, powder factor （Pf）, modulus of elasticity （E） and in-situ block size （XB）. After using the 90 sets of the measured data in various mines and rock formations in the world for training and testing, the model was applied to 12 another blast data for validation of the trained support vector regression （SVR） model. The prediction results of SVR were compared with those of artificial neural network （ANN）, multivariate regression analysis （MVRA） models, conventional Kuznetsov method and the measured X50 values. The proposed method shows promising results and the prediction accuracy of SVMs model is acceptable.

采用改进遗传算法优化LS-SVM逆系统的外转子无铁心无轴承永磁同步发电机解耦控制

为了实现外转子无铁心无轴承永磁同步发电机(outer rotor coreless bearingless permanent magnet synchronous generator,ORC-BPMSG)的精确控制,提出一种基于改进遗传算法(improved genetic algorithm,IGA)优化最小二乘支持向量机(least square support vector machine,LS-SVM)逆系统的解耦控制策略。首先,基于ORC-BPMSG的结构及工作原理,推导其数学模型,并分析其可逆性。其次,建立LS-SVM回归方程,并采用IGA优化LS-SVM的性能参数,从而训练得到逆系统。然后,将逆系统与原系统串接,形成伪线性系统,实现了ORC-BPMSG的线性化和解耦。最后,将提出的控制方法与传统LS-SVM逆系统控制方法进行对比仿真和实验。仿真和实验结果表明:所提出的控制策略可以较好地实现ORC-BPMSG输出电压和悬浮力、以及悬浮力之间的解耦控制。

基于RS-PCA-SVM的建筑项目安全预测模型

为了减少建筑项目安全事故的发生,文章提出一种基于RS-PCA-SVM建筑项目安全组合预测模型,采用粗糙集理论(rough set,RS)对数据进行属性约简,剔除交叉和冗余信息,降低输入变量维数和计算复杂度,减少训练时间;利用主成分分析(principal component analysis,PCA)法进行降维处理,除去贡献率较低的主成分,将剩余主成分作为支持向量机(support vector machine,SVM)的输入变量,并选择自适应权重粒子群优化算法(particle swarm optimization,PSO)优化SVM的参数,避免参数选择的盲目性。结果表明:该模型的平均预测准确率为93.78%,相比传统方法预测精度高、计算速度快。

基于SVM的干线输气管道泄漏压降速率信号识别

为解决压缩机抽吸或截断阀截断形成的压降信号导致截断阀发生误关断,以及小孔泄漏因管道压降不显著导致截断阀不动作的问题,以某输气干线为对象建立仿真模型,获取压缩机抽吸、截断阀紧急截断及管道泄漏3类不同工况下的300组压降信号,根据对点检测法计算出压降信号的压降速率值;以奇异值分解(SVD)法和极差归一化方法提取压降速率信号特征,采用支持向量机(SVM)法识别不同压降速率特征值信号,获取所对应的工况类型;针对SVM模型中的核函数参数与惩罚因子设置不合理,影响算法识别准确性的问题,采用教与学优化算法(TLBO)优化核函数参数与惩罚因子,建立干线输气管道泄漏信号智能识别的TLBO-SVM模型;应用该模型,分类识别该管道在3类工况下的300组模拟压降速率信号。结果表明:该模型对3类不同工况下压降速率信号的识别准确率为92.22%;对泄漏口径为50~125 mm,压降速率范围为0.01~0.07 MPa/min的小孔泄漏,识别准确率为96.67%。针对某干线管道的实际泄漏压降速率信号,TLBO-SVM识别到的准确率为100%。

参数优化的IZOA-SVM机械设备故障诊断方法

在复杂的工作环境中,机械设备振动信号的复杂性常常会导致机械设备故障诊断的准确性不高,为解决设备运行中因信号复杂性引发的故障诊断难题,提出了一种参数优化的斑马优化算法优化支持向量机(IZOA-SVM)的故障诊断方法。首先,引入了柯西变异和反向学习的改进策略到斑马优化算法(ZOA)中,提出了改进的斑马优化算法(IZOA),旨在改善原有斑马优化算法在迭代后期容易陷入局部极值等问题,从而有效增强了其全局搜索能力;其次,利用IZOA优化支持向量机(SVM)的核参数g和惩罚参数c以寻找SVM最优参数组合[c,g],并构建了IZOA-SVM模型;然后,计算了样本的13个时域特征以构成特征向量,并将特征向量分别输入到IZOA-SVM模型、斑马优化算法优化支持向量机(ZOA-SVM)模型、粒子群算法优化支持向量机(PSO-SVM)模型、遗传算法优化支持向量机(GA-SVM)模型和支持向量机模型,进行了故障分类;最后,通过旋转机械振动及故障模拟试验验证了该方法的有效性。研究结果表明:IZOA-SVM模型在分类准确率方面得到了明显的提高,达到了98.33%;该模型能够精准而稳定地识别故障类型,提高故障识别的准确性,在准确率方面相较于其他对比方法表现出更为显著的优势。因此,该方法在全局搜索和故障分类准确性方面都取得了明显的改进,为复杂环境下的故障诊断提供了可参考的解决方案。