Machine learning model based on non-convex penalized huberized-SVM

The support vector machine(SVM)is a classical machine learning method.Both the hinge loss and least absolute shrinkage and selection operator(LASSO)penalty are usually used in traditional SVMs.However,the hinge loss is not differentiable,and the LASSO penalty does not have the Oracle property.In this paper,the huberized loss is combined with non-convex penalties to obtain a model that has the advantages of both the computational simplicity and the Oracle property,contributing to higher accuracy than traditional SVMs.It is experimentally demonstrated that the two non-convex huberized-SVM methods,smoothly clipped absolute deviation huberized-SVM(SCAD-HSVM)and minimax concave penalty huberized-SVM(MCP-HSVM),outperform the traditional SVM method in terms of the prediction accuracy and classifier performance.They are also superior in terms of variable selection,especially when there is a high linear correlation between the variables.When they are applied to the prediction of listed companies,the variables that can affect and predict financial distress are accurately filtered out.Among all the indicators,the indicators per share have the greatest influence while those of solvency have the weakest influence.Listed companies can assess the financial situation with the indicators screened by our algorithm and make an early warning of their possible financial distress in advance with higher precision.

POSITIVE DEFINITE KERNEL IN SUPPORT VECTOR MACHINE(SVM)

The relationship among Mercer kernel, reproducing kernel and positive definite kernel in support vector machine （SVM） is proved and their roles in SVM are discussed. The quadratic form of the kernel matrix is used to confirm the positive definiteness and their construction. Based on the Bochner theorem, some translation invariant kernels are checked in their Fourier domain. Some rotation invariant radial kernels are inspected according to the Schoenberg theorem. Finally, the construction of discrete scaling and wavelet kernels, the kernel selection and the kernel parameter learning are discussed.

An Efficient and Robust Fall Detection System Using Wireless Gait Analysis Sensor with Artificial Neural Network (ANN) and Support Vector Machine (SVM) Algorithms

In this work, a total of 322 tests were taken on young volunteers by performing 10 different falls, 6 different Activities of Daily Living (ADL) and 7 Dynamic Gait Index (DGI) tests using a custom-designed Wireless Gait Analysis Sensor (WGAS). In order to perform automatic fall detection, we used Back Propagation Artificial Neural Network (BP-ANN) and Support Vector Machine (SVM) based on the 6 features extracted from the raw data. The WGAS, which includes a tri-axial accelerometer, 2 gyroscopes, and a MSP430 microcontroller, is worn by the subjects at either T4 (at back) or as a belt-clip in front of the waist during the various tests. The raw data is wirelessly transmitted from the WGAS to a near-by PC for real-time fall classification. The BP ANN is optimized by varying the training, testing and validation data sets and training the network with different learning schemes. SVM is optimized by using three different kernels and selecting the kernel for best classification rate. The overall accuracy of BP ANN is obtained as 98.20% with LM and RPROP training from the T4 data, while from the data taken at the belt, we achieved 98.70% with LM and SCG learning. The overall accuracy using SVM was 98.80% and 98.71% with RBF kernel from the T4 and belt position data, respectively.

Support Vector Machines(SVM)-Markov Chain Prediction Model of Mining Water Inflow

This study was conducted to establish a Support Vector Machines(SVM)-Markov Chain prediction model for prediction of mining water inflow. According to the raw data sequence, the Support Vector Machines(SVM) model was built, and then revised by means of a Markov state change probability matrix. Through dividing the state and analyzing absolute errors and relative errors and other indexes of the measured value and the fitted value of SVM, the prediction results were improved. Finally,the model was used to calculate relative errors. Through predicting and analyzing mining water inflow, the prediction results of the model were satisfactory. The results of this study enlarge the application scope of the Support Vector Machines(SVM) prediction model and provide a new method for scientific forecasting water inflow in coal mining.

A novel machine learning approach(svm Somatic) to distinguish somatic and germline mutations using next-generation sequencing data

DEAR EDITOR,Somatic mutations are a large category of genetic variations,which play an essential role in tumorigenesis. Detection of somatic single nucleotide variants(SNVs) could facilitate downstream analysis of tumorigenesis. Many computational methods have been developed to detect SNVs, but most require normal matched samples to differentiate somatic SNVs from the normal state, which can be difficult to obtain.

Hybrid Machine Learning Model for Face Recognition Using SVM

Face recognition systems have enhanced human-computer interactions in the last ten years.However,the literature reveals that current techniques used for identifying or verifying faces are not immune to limitations.Principal Component Analysis-Support Vector Machine(PCA-SVM)and Principal Component Analysis-Artificial Neural Network(PCA-ANN)are among the relatively recent and powerful face analysis techniques.Compared to PCA-ANN,PCA-SVM has demonstrated generalization capabilities in many tasks,including the ability to recognize objects with small or large data samples.Apart from requiring a minimal number of parameters in face detection,PCA-SVM minimizes generalization errors and avoids overfitting problems better than PCA-ANN.PCA-SVM,however,is ineffective and inefficient in detecting human faces in cases in which there is poor lighting,long hair,or items covering the subject’s face.This study proposes a novel PCASVM-based model to overcome the recognition problem of PCA-ANN and enhance face detection.The experimental results indicate that the proposed model provides a better face recognition outcome than PCA-SVM.

A Machine Learning Classification Model for Detecting Prediabetes

The incidence of prediabetes is in a dangerous condition in the USA. The likelihood of increasing chronic and complex health issues is very high if this stage of prediabetes is ignored. So, early detection of prediabetes conditions is critical to decrease or avoid type 2 diabetes and other health issues that come as a result of untreated and undiagnosed prediabetes condition. This study is done in order to detect the prediabetes condition with an artificial intelligence method. Data used for this study is collected from the Centers for Disease Control and Prevention’s (CDC) survey conducted by the Division of Health and Nutrition Examination Surveys (DHANES). In this study, several machine learning algorithms are exploited and compared to determine the best algorithm based on Average Squared Error (ASE), Kolmogorov-Smirnov (Youden) scores, areas under the ROC and some other measures of the machine learning algorithm. Based on these scores, the champion model is selected, and Random Forest is the champion model with approximately 89% accuracy.

Support vector machines approach to mean particle size of rock fragmentation due to bench blasting prediction

Aiming at the problems of the traditional method of assessing distribution of particle size in bench blasting, a support vector machines （SVMs） regression methodology was used to predict the mean particle size （X50） resulting from rock blast fragmentation in various mines based on the statistical learning theory. The data base consisted of blast design parameters, explosive parameters, modulus of elasticity and in-situ block size. The seven input independent variables used for the SVMs model for the prediction of X50 of rock blast fragmentation were the ratio of bench height to drilled burden （H/B）, ratio of spacing to burden （S/B）, ratio of burden to hole diameter （B/D）, ratio of stemming to burden （T/B）, powder factor （Pf）, modulus of elasticity （E） and in-situ block size （XB）. After using the 90 sets of the measured data in various mines and rock formations in the world for training and testing, the model was applied to 12 another blast data for validation of the trained support vector regression （SVR） model. The prediction results of SVR were compared with those of artificial neural network （ANN）, multivariate regression analysis （MVRA） models, conventional Kuznetsov method and the measured X50 values. The proposed method shows promising results and the prediction accuracy of SVMs model is acceptable.

基于改进CNN-SVM的井下钻头磨损状态评估研究

现有钻头磨损评估方法中,存在人工特征提取过程可能无法完全提取正确分类所需的信号动态特征,及需要对各个统计量进行大量计算等问题。为此,提出了一种新的基于改进卷积神经网络支持向量机(CNN-SVM)的钻头磨损程度评估算法。该算法将采集的近钻头原始振动数据导入CNN-Softmax模型,通过训练好的CNN模型从近钻头数据中提取主要的特征参数,将提取的稀疏特征向量输入SVM并进行故障分类,利用遗传算法实现SVM参数的优化选择,最后应用t分布随机邻域法近邻嵌入,使其故障特征学习过程可视化,以评估其特征提取能力。采用该算法对钻头磨损的现场试验数据进行了分析。分析结果表明:基于改进CNN-SVM的井下钻头磨损状态评估算法准确率高达98.33%。所得结论可为实现钻头磨损状态的进一步监测提供理论支撑。

基于粗糙集理论与PCA-APSO-SVM的沥青路面使用性能预测

针对传统沥青路面使用性能预测精度较低的问题,建立了基于粗糙集理论(rough set,RS)与主成分分析法(principal compoent analysis,PCA)-自适应粒子群算法(adaptive particle swarm optimization,APSO)-支持向量机(support vector machine,SVM)的沥青路面使用性能预测模型。基于沥青路面的时序指标与影响因素指标,建立了11个初始预测指标(包括前3年的路面使用性能、当量轴次、路龄、养护性质、坑槽率、修补率、年降水量、平均气温、日照时数);通过RS属性约减筛选出9个核心指标;利用PCA提取4个主成分,得到了基于4个主成分的数据集;将APSO引入到SVM中,对数据集进行训练,并优化了SVM模型参数;建立了路面使用性能的PCA-APSO-SVM预测模型,并以G6京藏高速甘肃境内某段道路为例,对路面使用性能进行预测。研究结果表明:PCA-APSO-SVM模型预测精度较PCA-PSO-SVM、APSO-SVM、PSO-SVM有较大提高,预测结果与实际情况更加符合,能为路面养护决策提供相关参考。

基于RS-PCA-SVM的建筑项目安全预测模型

为了减少建筑项目安全事故的发生,文章提出一种基于RS-PCA-SVM建筑项目安全组合预测模型,采用粗糙集理论(rough set,RS)对数据进行属性约简,剔除交叉和冗余信息,降低输入变量维数和计算复杂度,减少训练时间;利用主成分分析(principal component analysis,PCA)法进行降维处理,除去贡献率较低的主成分,将剩余主成分作为支持向量机(support vector machine,SVM)的输入变量,并选择自适应权重粒子群优化算法(particle swarm optimization,PSO)优化SVM的参数,避免参数选择的盲目性。结果表明:该模型的平均预测准确率为93.78%,相比传统方法预测精度高、计算速度快。

采用改进遗传算法优化LS-SVM逆系统的外转子无铁心无轴承永磁同步发电机解耦控制

为了实现外转子无铁心无轴承永磁同步发电机(outer rotor coreless bearingless permanent magnet synchronous generator,ORC-BPMSG)的精确控制,提出一种基于改进遗传算法(improved genetic algorithm,IGA)优化最小二乘支持向量机(least square support vector machine,LS-SVM)逆系统的解耦控制策略。首先,基于ORC-BPMSG的结构及工作原理,推导其数学模型,并分析其可逆性。其次,建立LS-SVM回归方程,并采用IGA优化LS-SVM的性能参数,从而训练得到逆系统。然后,将逆系统与原系统串接,形成伪线性系统,实现了ORC-BPMSG的线性化和解耦。最后,将提出的控制方法与传统LS-SVM逆系统控制方法进行对比仿真和实验。仿真和实验结果表明:所提出的控制策略可以较好地实现ORC-BPMSG输出电压和悬浮力、以及悬浮力之间的解耦控制。

参数优化的IZOA-SVM机械设备故障诊断方法

在复杂的工作环境中,机械设备振动信号的复杂性常常会导致机械设备故障诊断的准确性不高,为解决设备运行中因信号复杂性引发的故障诊断难题,提出了一种参数优化的斑马优化算法优化支持向量机(IZOA-SVM)的故障诊断方法。首先,引入了柯西变异和反向学习的改进策略到斑马优化算法(ZOA)中,提出了改进的斑马优化算法(IZOA),旨在改善原有斑马优化算法在迭代后期容易陷入局部极值等问题,从而有效增强了其全局搜索能力;其次,利用IZOA优化支持向量机(SVM)的核参数g和惩罚参数c以寻找SVM最优参数组合[c,g],并构建了IZOA-SVM模型;然后,计算了样本的13个时域特征以构成特征向量,并将特征向量分别输入到IZOA-SVM模型、斑马优化算法优化支持向量机(ZOA-SVM)模型、粒子群算法优化支持向量机(PSO-SVM)模型、遗传算法优化支持向量机(GA-SVM)模型和支持向量机模型,进行了故障分类;最后,通过旋转机械振动及故障模拟试验验证了该方法的有效性。研究结果表明:IZOA-SVM模型在分类准确率方面得到了明显的提高,达到了98.33%;该模型能够精准而稳定地识别故障类型,提高故障识别的准确性,在准确率方面相较于其他对比方法表现出更为显著的优势。因此,该方法在全局搜索和故障分类准确性方面都取得了明显的改进,为复杂环境下的故障诊断提供了可参考的解决方案。

基于SVM的干线输气管道泄漏压降速率信号识别

为解决压缩机抽吸或截断阀截断形成的压降信号导致截断阀发生误关断,以及小孔泄漏因管道压降不显著导致截断阀不动作的问题,以某输气干线为对象建立仿真模型,获取压缩机抽吸、截断阀紧急截断及管道泄漏3类不同工况下的300组压降信号,根据对点检测法计算出压降信号的压降速率值;以奇异值分解(SVD)法和极差归一化方法提取压降速率信号特征,采用支持向量机(SVM)法识别不同压降速率特征值信号,获取所对应的工况类型;针对SVM模型中的核函数参数与惩罚因子设置不合理,影响算法识别准确性的问题,采用教与学优化算法(TLBO)优化核函数参数与惩罚因子,建立干线输气管道泄漏信号智能识别的TLBO-SVM模型;应用该模型,分类识别该管道在3类工况下的300组模拟压降速率信号。结果表明:该模型对3类不同工况下压降速率信号的识别准确率为92.22%;对泄漏口径为50~125 mm,压降速率范围为0.01~0.07 MPa/min的小孔泄漏,识别准确率为96.67%。针对某干线管道的实际泄漏压降速率信号,TLBO-SVM识别到的准确率为100%。

基于SVM算法的虚假航迹识别

针对云雨杂波和主被动干扰导致多雷达传感器产生虚假目标航迹的问题,利用支持向量机(SVM)算法的自主学习能力,通过构建基于数据驱动的判别模型进行虚假航迹识别。针对航迹起始得到的目标潜在航迹,利用人工智能数据驱动、自学习的特点,设计了SVM算法。通过对已标记真假的目标航迹样本进行离线学习,形成虚假航迹识别的SVM分类器,实现了基于数据驱动的判别模型代替先验知识规则约束的固定模型,并在工程应用中,利用SVM分类器在线识别虚假航迹,完成实时剔除。通过实测雷达数据实验验证,该算法的目标虚假航迹准确率高达95%以上,完全满足实际的工程应用需求。相比基于阈值或规则进行硬性判断的传统虚假航迹识别方法,所提出的算法不仅提高了准确率,还具有较高的实时性,能够适应复杂多变的杂波环境,在实际应用中具有更强的适应性和实用性。因此,提出的基于SVM算法的虚假航迹识别方法对于密集杂波场景下的虚假航迹剔除问题具有显著的实际应用价值。

不平衡数据下基于SVM增量学习的指挥信息系统状态监控方法

针对指挥信息系统历史状态样本有限的特点,基于支持向量机(support vector machines,SVM)设计了一种面向不平衡数据的SVM增量学习方法。针对系统正常/异常状态样本不平衡的情况,首先利用支持向量生成一部分新样本,然后通过分带的思想逐带产生分布更加均匀的新样本以调节原样本集的不平衡比。针对系统监控实时性要求高且在运行过程中会有新样本不断加入的特点,采用增量学习的方式对分类模型进行持续更新,在放松KKT(Karush-Kuhn-Tucker)更新触发条件的基础上,通过定义样本重要度并引入保留率和遗忘率的方式减少了增量学习过程中所需训练的样本数量。为了验证算法的有效性和优越性,实验部分在真实系统中获得的数据集以及UCI数据集中3类6组不平衡数据集中与现有的算法进行了对比。结果表明,所提算法能够有效实现对不平衡数据的增量学习,从而满足指挥信息系统状态监控的需求。

Parameter selection of support vector machine for function approximation based on chaos optimization

The support vector machine （SVM） is a novel machine learning method, which has the ability to approximate nonlinear functions with arbitrary accuracy. Setting parameters well is very crucial for SVM learning results and generalization ability, and now there is no systematic, general method for parameter selection. In this article, the SVM parameter selection for function approximation is regarded as a compound optimization problem and a mutative scale chaos optimization algorithm is employed to search for optimal paraxneter values. The chaos optimization algorithm is an effective way for global optimal and the mutative scale chaos algorithm could improve the search efficiency and accuracy. Several simulation examples show the sensitivity of the SVM parameters and demonstrate the superiority of this proposed method for nonlinear function approximation.

Decision tree support vector machine based on genetic algorithm for multi-class classification

To solve the multi-class fault diagnosis tasks, decision tree support vector machine （DTSVM）, which combines SVM and decision tree using the concept of dichotomy, is proposed. Since the classification performance of DTSVM highly depends on its structure, to cluster the multi-classes with maximum distance between the clustering centers of the two sub-classes, genetic algorithm is introduced into the formation of decision tree, so that the most separable classes would be separated at each node of decisions tree. Numerical simulations conducted on three datasets compared with ＂one-against-all＂ and ＂one-against-one＂ demonstrate the proposed method has better performance and higher generalization ability than the two conventional methods.

Parameters selection in gene selection using Gaussian kernel support vector machines by genetic algorithm

In microarray-based cancer classification, gene selection is an important issue owing to the large number of variables and small number of samples as well as its non-linearity. It is difficult to get satisfying results by using conventional linear sta- tistical methods. Recursive feature elimination based on support vector machine (SVM RFE) is an effective algorithm for gene selection and cancer classification, which are integrated into a consistent framework. In this paper, we propose a new method to select parameters of the aforementioned algorithm implemented with Gaussian kernel SVMs as better alternatives to the common practice of selecting the apparently best parameters by using a genetic algorithm to search for a couple of optimal parameter. Fast implementation issues for this method are also discussed for pragmatic reasons. The proposed method was tested on two repre- sentative hereditary breast cancer and acute leukaemia datasets. The experimental results indicate that the proposed method per- forms well in selecting genes and achieves high classification accuracies with these genes.

结合SVM与XGBoost的链式多路径覆盖测试用例生成

机器学习方法可很好地与软件测试相结合,增强测试效果,但少有学者将其运用于测试数据生成方面.为进一步提高测试数据生成效率,提出一种结合SVM(support vector machine)和XGBoost(extreme gradient boosting)的链式模型,并基于此模型借助遗传算法实现多路径测试数据生成.首先,利用一定样本训练若干个用于预测路径节点状态的子模型(SVM和XGBoost),通过子模型的预测精度值筛选最优子模型,并根据路径节点顺序将其依次链接,形成一个链式模型C-SVMXGBoost(chained SVM and XGBoost).在利用遗传算法生成测试用例时,使用训练好的链式模型代替插桩法获取测试数据覆盖路径(预测路径),寻找预测路径与目标路径相似的路径集,对存在相似路径集的预测路径进行插桩验证,获取精确路径,计算适应度值.在交叉变异过程中引入样本集中路径层级深度较大的优秀测试用例进行重用,生成覆盖目标路径的测试数据.最后,保留进化生成中产生的适应度较高的个体,更新链式模型C-SVMXGBoost,进一步提高测试效率.实验表明,C-SVMXGBoost较其他各对比链式模型更适合解决路径预测问题,可提高测试效率.并且通过与已有经典方法相比,所提方法在覆盖率上提高可达15%,平均进化代数也有所降低,在较大规模程序上其降低百分比可达65%.