基于SVM分类的云集群失败作业主动预测方法

Predicting Job Failure in Cloud Cluster: Based on SVM Classification

提出了一种使用支持向量机(SVM)模型预测作业终止状态的方法.以Google数据集为研究对象,首先分析作业终止状态的影响因素,提出使用作业的静态特征和动态特征作为终止状态分类的特征向量,选择SVM模型主动预测终止状态;然后从特征向量和分类模型2个层面对准确率、假负率、精确度指标进行验证.特征向量实验结果表明,基于静态和动态特征的SVM预测模型比单独使用静态特征和动态特征,分别提高0.94%、-0.01%、1.35%和9.08%、-1.36%、10.91%.分类模型的比较结果显示,SVM分类预测方法比传统的神经网络模型、朴素贝叶斯模型、逻辑回归模型的预测效果好.

A job failure predicting method based on support vector machine（ SVM） model was presented. Google cluster traces were studied. The relevant factors of jobs failure were analyzed and the combination of the static and dynamic characteristic was chosen as the feature vectors. The SVM algorithm was chosen to predict termination status of the jobs. Experiments were conducted to compare different kinds of feature vectors and classification models with Google traces dataset in terms of the accuracy rate,false negative rate and precision rate. It is shown that the combination of static and dynamic features are0. 94%,-0. 01% and 1. 35% higher than the static features,and 9. 08%,-1. 36% and 8. 91%higher than the dynamic features. Experiments also demonstrate that the SVM model is superior to the traditional neural network extreme machine learning,naive Bayes and logistic regression model in these indexes.