One-class classification problem has become a popular problem in many fields, with a wide range of applications in anomaly detection, fault diagnosis, and face recognition. We investigate the one-class classification ...One-class classification problem has become a popular problem in many fields, with a wide range of applications in anomaly detection, fault diagnosis, and face recognition. We investigate the one-class classification problem for second-order tensor data. Traditional vector-based one-class classification methods such as one-class support vector machine (OCSVM) and least squares one-class support vector machine (LSOCSVM) have limitations when tensor is used as input data, so we propose a new tensor one-class classification method, LSOCSTM, which directly uses tensor as input data. On one hand, using tensor as input data not only enables to classify tensor data, but also for vector data, classifying it after high dimensionalizing it into tensor still improves the classification accuracy and overcomes the over-fitting problem. On the other hand, different from one-class support tensor machine (OCSTM), we use squared loss instead of the original loss function so that we solve a series of linear equations instead of quadratic programming problems. Therefore, we use the distance to the hyperplane as a metric for classification, and the proposed method is more accurate and faster compared to existing methods. The experimental results show the high efficiency of the proposed method compared with several state-of-the-art methods.展开更多
To improve the training speed of support vector machine (SVM), a method called improved center distance ratio method (ICDRM) with determining thresholds automatically is presented here without reduce the identific...To improve the training speed of support vector machine (SVM), a method called improved center distance ratio method (ICDRM) with determining thresholds automatically is presented here without reduce the identification rate. In this method border vectors are chosen from the given samples by comparing sample vectors with center distance ratio in advance. The number of training samples is reduced greatly and the training speed is improved. This method is used to the identification for license plate characters. Experimental resuhs show that the improved SVM method-ICDRM does well at identification rate and training speed.展开更多
Turbopump condition monitoring is a significant approach to ensure the safety of liquid rocket engine (LRE).Because of lack of fault samples,a monitoring system cannot be trained on all possible condition patterns.T...Turbopump condition monitoring is a significant approach to ensure the safety of liquid rocket engine (LRE).Because of lack of fault samples,a monitoring system cannot be trained on all possible condition patterns.Thus it is important to differentiate abnormal or unknown patterns from normal pattern with novelty detection methods.One-class support vector machine (OCSVM) that has been commonly used for novelty detection cannot deal well with large scale samples.In order to model the normal pattern of the turbopump with OCSVM and so as to monitor the condition of the turbopump,a monitoring method that integrates OCSVM with incremental clustering is presented.In this method,the incremental clustering is used for sample reduction by extracting representative vectors from a large training set.The representative vectors are supposed to distribute uniformly in the object region and fulfill the region.And training OCSVM on these representative vectors yields a novelty detector.By applying this method to the analysis of the turbopump's historical test data,it shows that the incremental clustering algorithm can extract 91 representative points from more than 36 000 training vectors,and the OCSVM detector trained on these 91 representative points can recognize spikes in vibration signals caused by different abnormal events such as vane shedding,rub-impact and sensor faults.This monitoring method does not need fault samples during training as classical recognition methods.The method resolves the learning problem of large samples and is an alternative method for condition monitoring of the LRE turbopump.展开更多
Accurate forecasting of wind velocity can improve the economic dispatch and safe operation of the power system. Support vector machine (SVM) has been proved to be an efficient approach for forecasting. According to th...Accurate forecasting of wind velocity can improve the economic dispatch and safe operation of the power system. Support vector machine (SVM) has been proved to be an efficient approach for forecasting. According to the analysis with support vector machine method, the drawback of determining the parameters only by experts' experience should be improved. After a detailed description of the methodology of SVM and simulated annealing, an improved algorithm was proposed for the automatic optimization of parameters using SVM method. An example has proved that the proposed method can efficiently select the parameters of the SVM method. And by optimizing the parameters, the forecasting accuracy of the max wind velocity increases by 34.45%, which indicates that the new SASVM model improves the forecasting accuracy.展开更多
For the problems of nonlinearity,uncertainty and low prediction accuracy in the gas outburst prediction of coal mining face,the least squares support vector machine(LSSVM)is proposed to establish the prediction model....For the problems of nonlinearity,uncertainty and low prediction accuracy in the gas outburst prediction of coal mining face,the least squares support vector machine(LSSVM)is proposed to establish the prediction model.Firstly,considering the inertia coefficients as global parameters lacks the ability to improve the solution for the traditional particle swarm optimization(PSO),an improved PSO(IPSO)algorithm is introduced to adjust different inertia weights in updating the particle swarm and solve the fitness to stagnate.Secondly,the penalty factor and kernel function parameter of LSSVM are searched automatically,and the regression accuracy and generalization performance is enhanced by applying IPSO.Finally,to verify the proposed prediction model,the model is applied for gas outburst prediction of Jiuli Hill coal mine in Jiaozuo City,and the results are compared with that of PSO-SVM model,IGA-LSSVM model and BP model.The results show that the relative errors of the proposed model are not greater than 2.7%,and the prediction accuracy is higher than other three prediction models.The IPSO-LSSVM model can be used to predict the intensity of gas outburst of coal mining face effectively.展开更多
Diabetic retinopathy(DR) is one of the most important causes of visual impairment. Automatic recognition of DR lesions, like hard exudates(EXs), in retinal images can contribute to the diagnosis and screening of the d...Diabetic retinopathy(DR) is one of the most important causes of visual impairment. Automatic recognition of DR lesions, like hard exudates(EXs), in retinal images can contribute to the diagnosis and screening of the disease. To achieve this goal, an automatically detecting approach based on improved FCM(IFCM) as well as support vector machines(SVM) was established and studied. Firstly, color fundus images were segmented by IFCM, and candidate regions of EXs were obtained. Then, the SVM classifier is confirmed with the optimal subset of features and judgments of these candidate regions, as a result hard exudates are detected from fundus images. Our database was composed of 126 images with variable color, brightness, and quality. 70 of them were used to train the SVM and the remaining 56 to assess the performance of the method. Using a lesion based criterion, we achieved a mean sensitivity of 94.65% and a mean positive predictive value of 97.25%. With an image-based criterion, our approach reached a 100% mean sensitivity, 96.43% mean specificity and 98.21% mean accuracy. Furthermore, the average time cost in processing an image is 4.56 s. The results suggest that the proposed method can efficiently detect EXs from color fundus images and it could be a diagnostic aid for ophthalmologists in the screening for DR.展开更多
Much attention has been paid to relevant feedback in intelligent computation for social computing, especially in content-based image retrieval which based on WeChat platform for the medical auxiliary. It has a good ef...Much attention has been paid to relevant feedback in intelligent computation for social computing, especially in content-based image retrieval which based on WeChat platform for the medical auxiliary. It has a good effect on reducing the semantic gap between high semantics and low semantics of images. There are many kinds of support vector machines (SVM) based relevance feedback methods in image retrieval, but all of them may encounter some problems, such as a small size of sample, an asymmetric positive sample and negative sample as well as a long feedback cycle. To deal with these problems, an improved asymmetric bagging (IAB) relevance feedback algorithm is proposed. Furthermore, we apply a new fuzzy support machine (FSVM) to cooperate with IAB. To solve the over-fitting and real-time problems, we use modified local binary patterns (MLBP) as image features. Finally, experimental results demonstrate that our method performs other methods in terms of improving retrieval precision as well as retrieval efficiency.展开更多
针对浮选过程变量滞后、耦合特征及建模样本数量少所导致精矿品位难以准确预测的问题,提出了一种基于改进麻雀搜索算法(Improved Sparrow Search Algorithm,ISSA)优化混核最小二乘支持向量机(Hybrid Kernel Least Squares Support Vecto...针对浮选过程变量滞后、耦合特征及建模样本数量少所导致精矿品位难以准确预测的问题,提出了一种基于改进麻雀搜索算法(Improved Sparrow Search Algorithm,ISSA)优化混核最小二乘支持向量机(Hybrid Kernel Least Squares Support Vector Machine,HKLSSVM)的浮选过程精矿品位预测方法.首先采集浮选现场载流X荧光品位分析仪数据作为建模变量并进行预处理,建立基于最小二乘支持向量机(Least Squares Support Vector Machine,LSSVM)的预测模型,以此构建新型混合核函数,将输入空间映射至高维特征空间,再引入改进麻雀搜索算法对模型参数进行优化,提出基于ISSA-HKLSSVM方法实现精矿品位预测,最后开发基于LabVIEW的浮选精矿品位预测系统对本文提出方法实际验证.实验结果表明,本文提出方法对于浮选过程小样本建模具有良好拟合能力,相比现有方法提高了预测准确率,可实现精矿品位的准确在线预测,为浮选过程的智能调控提供实时可靠的精矿品位反馈信息.展开更多
One-class support vector machines (one-class SVMs) are powerful tools that are widely used in many applications. This paper describes a semi-supervised one-class SVM that uses supervision in terms of relative compar...One-class support vector machines (one-class SVMs) are powerful tools that are widely used in many applications. This paper describes a semi-supervised one-class SVM that uses supervision in terms of relative comparisons. The analysis uses a hypersphere version of one-class SVMs with a penalty term appended to the objective function. The method simultaneously finds the minimum sphere in the feature space that encloses most of the target points and considers the relative comparisons. The result is a standard convex quadratic programming problem, which can be solved by adapting standard methods for SVM training, i.e., sequential minimal optimization. This one-class SVM can be applied to semi-supervised clustering and multi-classification problems. Tests show that this method achieves higher accuracy and better generalization performance than previous SVMs.展开更多
One-class support vector machine (OCSVM) and support vector data description (SVDD) are two main domain-based one-class (kernel) classifiers. To reveal their relationship with density estimation in the case of t...One-class support vector machine (OCSVM) and support vector data description (SVDD) are two main domain-based one-class (kernel) classifiers. To reveal their relationship with density estimation in the case of the Gaussian kernel, OCSVM and SVDD are firstly unified into the framework of kernel density estimation, and the essential relationship between them is explicitly revealed. Then the result proves that the density estimation induced by OCSVM or SVDD is in agreement with the true density. Meanwhile, it can also reduce the integrated squared error (ISE). Finally, experiments on several simulated datasets verify the revealed relationships.展开更多
文摘One-class classification problem has become a popular problem in many fields, with a wide range of applications in anomaly detection, fault diagnosis, and face recognition. We investigate the one-class classification problem for second-order tensor data. Traditional vector-based one-class classification methods such as one-class support vector machine (OCSVM) and least squares one-class support vector machine (LSOCSVM) have limitations when tensor is used as input data, so we propose a new tensor one-class classification method, LSOCSTM, which directly uses tensor as input data. On one hand, using tensor as input data not only enables to classify tensor data, but also for vector data, classifying it after high dimensionalizing it into tensor still improves the classification accuracy and overcomes the over-fitting problem. On the other hand, different from one-class support tensor machine (OCSTM), we use squared loss instead of the original loss function so that we solve a series of linear equations instead of quadratic programming problems. Therefore, we use the distance to the hyperplane as a metric for classification, and the proposed method is more accurate and faster compared to existing methods. The experimental results show the high efficiency of the proposed method compared with several state-of-the-art methods.
基金Sponsored by the National Natural Science Foundation of China(60472110)
文摘To improve the training speed of support vector machine (SVM), a method called improved center distance ratio method (ICDRM) with determining thresholds automatically is presented here without reduce the identification rate. In this method border vectors are chosen from the given samples by comparing sample vectors with center distance ratio in advance. The number of training samples is reduced greatly and the training speed is improved. This method is used to the identification for license plate characters. Experimental resuhs show that the improved SVM method-ICDRM does well at identification rate and training speed.
基金supported by National Natural Science Foundation of China (Grant No. 50675219)Hu’nan Provincial Science Committee Excellent Youth Foundation of China (Grant No. 08JJ1008)
文摘Turbopump condition monitoring is a significant approach to ensure the safety of liquid rocket engine (LRE).Because of lack of fault samples,a monitoring system cannot be trained on all possible condition patterns.Thus it is important to differentiate abnormal or unknown patterns from normal pattern with novelty detection methods.One-class support vector machine (OCSVM) that has been commonly used for novelty detection cannot deal well with large scale samples.In order to model the normal pattern of the turbopump with OCSVM and so as to monitor the condition of the turbopump,a monitoring method that integrates OCSVM with incremental clustering is presented.In this method,the incremental clustering is used for sample reduction by extracting representative vectors from a large training set.The representative vectors are supposed to distribute uniformly in the object region and fulfill the region.And training OCSVM on these representative vectors yields a novelty detector.By applying this method to the analysis of the turbopump's historical test data,it shows that the incremental clustering algorithm can extract 91 representative points from more than 36 000 training vectors,and the OCSVM detector trained on these 91 representative points can recognize spikes in vibration signals caused by different abnormal events such as vane shedding,rub-impact and sensor faults.This monitoring method does not need fault samples during training as classical recognition methods.The method resolves the learning problem of large samples and is an alternative method for condition monitoring of the LRE turbopump.
基金Project(71071052) supported by the National Natural Science Foundation of ChinaProject(JB2011097) supported by the Fundamental Research Funds for the Central Universities of China
文摘Accurate forecasting of wind velocity can improve the economic dispatch and safe operation of the power system. Support vector machine (SVM) has been proved to be an efficient approach for forecasting. According to the analysis with support vector machine method, the drawback of determining the parameters only by experts' experience should be improved. After a detailed description of the methodology of SVM and simulated annealing, an improved algorithm was proposed for the automatic optimization of parameters using SVM method. An example has proved that the proposed method can efficiently select the parameters of the SVM method. And by optimizing the parameters, the forecasting accuracy of the max wind velocity increases by 34.45%, which indicates that the new SASVM model improves the forecasting accuracy.
基金Key Project of Science and Technology of Education Department of Henan Province(19B120002)Key Laboratory of Control Engineering of Henan Province(KG2016-17).
文摘For the problems of nonlinearity,uncertainty and low prediction accuracy in the gas outburst prediction of coal mining face,the least squares support vector machine(LSSVM)is proposed to establish the prediction model.Firstly,considering the inertia coefficients as global parameters lacks the ability to improve the solution for the traditional particle swarm optimization(PSO),an improved PSO(IPSO)algorithm is introduced to adjust different inertia weights in updating the particle swarm and solve the fitness to stagnate.Secondly,the penalty factor and kernel function parameter of LSSVM are searched automatically,and the regression accuracy and generalization performance is enhanced by applying IPSO.Finally,to verify the proposed prediction model,the model is applied for gas outburst prediction of Jiuli Hill coal mine in Jiaozuo City,and the results are compared with that of PSO-SVM model,IGA-LSSVM model and BP model.The results show that the relative errors of the proposed model are not greater than 2.7%,and the prediction accuracy is higher than other three prediction models.The IPSO-LSSVM model can be used to predict the intensity of gas outburst of coal mining face effectively.
基金Supported by the National High Technology Research and Development Program of China(863 Program)(No.2006AA020804)Fundamental Research Funds for the Central Universities(No.NJ20120007)+2 种基金Jiangsu Province Science and Technology Support Plan(No.BE2010652)Program Sponsored for Scientific Innovation Research of College Graduate in Jangsu Province(No.CXLX11_0218)Shanghai University Scientific Selection and Cultivation for Outstanding Young Teachers in Special Fund(No.ZZGCD15081)
文摘Diabetic retinopathy(DR) is one of the most important causes of visual impairment. Automatic recognition of DR lesions, like hard exudates(EXs), in retinal images can contribute to the diagnosis and screening of the disease. To achieve this goal, an automatically detecting approach based on improved FCM(IFCM) as well as support vector machines(SVM) was established and studied. Firstly, color fundus images were segmented by IFCM, and candidate regions of EXs were obtained. Then, the SVM classifier is confirmed with the optimal subset of features and judgments of these candidate regions, as a result hard exudates are detected from fundus images. Our database was composed of 126 images with variable color, brightness, and quality. 70 of them were used to train the SVM and the remaining 56 to assess the performance of the method. Using a lesion based criterion, we achieved a mean sensitivity of 94.65% and a mean positive predictive value of 97.25%. With an image-based criterion, our approach reached a 100% mean sensitivity, 96.43% mean specificity and 98.21% mean accuracy. Furthermore, the average time cost in processing an image is 4.56 s. The results suggest that the proposed method can efficiently detect EXs from color fundus images and it could be a diagnostic aid for ophthalmologists in the screening for DR.
基金This work is supported by the National Natural Science Foundation of China (No. 61472161, 61133011, 61402195, 61502198, 61303132, 61202308), Science & Technology Development Project of Jilin Province (No. 20140101201JC).
文摘Much attention has been paid to relevant feedback in intelligent computation for social computing, especially in content-based image retrieval which based on WeChat platform for the medical auxiliary. It has a good effect on reducing the semantic gap between high semantics and low semantics of images. There are many kinds of support vector machines (SVM) based relevance feedback methods in image retrieval, but all of them may encounter some problems, such as a small size of sample, an asymmetric positive sample and negative sample as well as a long feedback cycle. To deal with these problems, an improved asymmetric bagging (IAB) relevance feedback algorithm is proposed. Furthermore, we apply a new fuzzy support machine (FSVM) to cooperate with IAB. To solve the over-fitting and real-time problems, we use modified local binary patterns (MLBP) as image features. Finally, experimental results demonstrate that our method performs other methods in terms of improving retrieval precision as well as retrieval efficiency.
文摘针对浮选过程变量滞后、耦合特征及建模样本数量少所导致精矿品位难以准确预测的问题,提出了一种基于改进麻雀搜索算法(Improved Sparrow Search Algorithm,ISSA)优化混核最小二乘支持向量机(Hybrid Kernel Least Squares Support Vector Machine,HKLSSVM)的浮选过程精矿品位预测方法.首先采集浮选现场载流X荧光品位分析仪数据作为建模变量并进行预处理,建立基于最小二乘支持向量机(Least Squares Support Vector Machine,LSSVM)的预测模型,以此构建新型混合核函数,将输入空间映射至高维特征空间,再引入改进麻雀搜索算法对模型参数进行优化,提出基于ISSA-HKLSSVM方法实现精矿品位预测,最后开发基于LabVIEW的浮选精矿品位预测系统对本文提出方法实际验证.实验结果表明,本文提出方法对于浮选过程小样本建模具有良好拟合能力,相比现有方法提高了预测准确率,可实现精矿品位的准确在线预测,为浮选过程的智能调控提供实时可靠的精矿品位反馈信息.
基金Supported by the National Natural Science Foundation of China(No. 60872070)
文摘One-class support vector machines (one-class SVMs) are powerful tools that are widely used in many applications. This paper describes a semi-supervised one-class SVM that uses supervision in terms of relative comparisons. The analysis uses a hypersphere version of one-class SVMs with a penalty term appended to the objective function. The method simultaneously finds the minimum sphere in the feature space that encloses most of the target points and considers the relative comparisons. The result is a standard convex quadratic programming problem, which can be solved by adapting standard methods for SVM training, i.e., sequential minimal optimization. This one-class SVM can be applied to semi-supervised clustering and multi-classification problems. Tests show that this method achieves higher accuracy and better generalization performance than previous SVMs.
基金Supported by the National Natural Science Foundation of China(60603029)the Natural Science Foundation of Jiangsu Province(BK2007074)the Natural Science Foundation for Colleges and Universities in Jiangsu Province(06KJB520132)~~
文摘One-class support vector machine (OCSVM) and support vector data description (SVDD) are two main domain-based one-class (kernel) classifiers. To reveal their relationship with density estimation in the case of the Gaussian kernel, OCSVM and SVDD are firstly unified into the framework of kernel density estimation, and the essential relationship between them is explicitly revealed. Then the result proves that the density estimation induced by OCSVM or SVDD is in agreement with the true density. Meanwhile, it can also reduce the integrated squared error (ISE). Finally, experiments on several simulated datasets verify the revealed relationships.