Fault diagnosis of power-shift steering transmission based on multiple outputs least squares support vector regression

A method of multiple outputs least squares support vector regression （LS-SVR） was developed and described in detail, with the radial basis function （RBF） as the kernel function. The method was applied to predict the future state of the power-shift steering transmission （PSST）. A prediction model of PSST was gotten with multiple outputs LS-SVR. The model performance was greatly influenced by the penalty parameter γ and kernel parameter σ2 which were optimized using cross validation method. The training and prediction of the model were done with spectrometric oil analysis data. The predictive and actual values were compared and a fault in the second PSST was found. The research proved that this method had good accuracy in PSST fault prediction, and any possible problem in PSST could be found through a comparative analysis.

Improved adaptive pruning algorithm for least squares support vector regression

As the solutions of the least squares support vector regression machine （LS-SVRM） are not sparse, it leads to slow prediction speed and limits its applications. The defects of the ex- isting adaptive pruning algorithm for LS-SVRM are that the training speed is slow, and the generalization performance is not satis- factory, especially for large scale problems. Hence an improved algorithm is proposed. In order to accelerate the training speed, the pruned data point and fast leave-one-out error are employed to validate the temporary model obtained after decremental learning. The novel objective function in the termination condition which in- volves the whole constraints generated by all training data points and three pruning strategies are employed to improve the generali- zation performance. The effectiveness of the proposed algorithm is tested on six benchmark datasets. The sparse LS-SVRM model has a faster training speed and better generalization performance.

Flatness intelligent control via improved least squares support vector regression algorithm

To overcome the disadvantage that the standard least squares support vector regression(LS-SVR) algorithm is not suitable to multiple-input multiple-output(MIMO) system modelling directly,an improved LS-SVR algorithm which was defined as multi-output least squares support vector regression(MLSSVR) was put forward by adding samples' absolute errors in objective function and applied to flatness intelligent control.To solve the poor-precision problem of the control scheme based on effective matrix in flatness control,the predictive control was introduced into the control system and the effective matrix-predictive flatness control method was proposed by combining the merits of the two methods.Simulation experiment was conducted on 900HC reversible cold roll.The performance of effective matrix method and the effective matrix-predictive control method were compared,and the results demonstrate the validity of the effective matrix-predictive control method.

Improved Scheme for Fast Approximation to Least Squares Support Vector Regression

The solution of normal least squares support vector regression(LSSVR)is lack of sparseness,which limits the real-time and hampers the wide applications to a certain degree.To overcome this obstacle,a scheme,named I2FSA-LSSVR,is proposed.Compared with the previously approximate algorithms,it not only adopts the partial reduction strategy but considers the influence between the previously selected support vectors and the willselected support vector during the process of computing the supporting weights.As a result,I2FSA-LSSVR reduces the number of support vectors and enhances the real-time.To confirm the feasibility and effectiveness of the proposed algorithm,experiments on benchmark data sets are conducted,whose results support the presented I2FSA-LSSVR.

Improved scheme to accelerate sparse least squares support vector regression

The pruning algorithms for sparse least squares support vector regression machine are common methods, and easily com- prehensible, but the computational burden in the training phase is heavy due to the retraining in performing the pruning process, which is not favorable for their applications. To this end, an im- proved scheme is proposed to accelerate sparse least squares support vector regression machine. A major advantage of this new scheme is based on the iterative methodology, which uses the previous training results instead of retraining, and its feasibility is strictly verified theoretically. Finally, experiments on bench- mark data sets corroborate a significant saving of the training time with the same number of support vectors and predictive accuracy compared with the original pruning algorithms, and this speedup scheme is also extended to classification problem.

A sparse algorithm for adaptive pruning least square support vector regression machine based on global representative point ranking

Least square support vector regression(LSSVR)is a method for function approximation,whose solutions are typically non-sparse,which limits its application especially in some occasions of fast prediction.In this paper,a sparse algorithm for adaptive pruning LSSVR algorithm based on global representative point ranking(GRPR-AP-LSSVR)is proposed.At first,the global representative point ranking(GRPR)algorithm is given,and relevant data analysis experiment is implemented which depicts the importance ranking of data points.Furthermore,the pruning strategy of removing two samples in the decremental learning procedure is designed to accelerate the training speed and ensure the sparsity.The removed data points are utilized to test the temporary learning model which ensures the regression accuracy.Finally,the proposed algorithm is verified on artificial datasets and UCI regression datasets,and experimental results indicate that,compared with several benchmark algorithms,the GRPR-AP-LSSVR algorithm has excellent sparsity and prediction speed without impairing the generalization performance.

Cloud removal of remote sensing image based on multi-output support vector regression

Removal of cloud cover on the satellite remote sensing image can effectively improve the availability of remote sensing images. For thin cloud cover, support vector value contourlet transform is used to achieve multi-scale decomposition of the area of thin cloud cover on remote sensing images. Through enhancing coefficients of high frequency and suppressing coefficients of low frequency, the thin cloud is removed. For thick cloud cover, if the areas of thick cloud cover on multi-source or multi-temporal remote sensing images do not overlap, the multi-output support vector regression learning method is used to remove this kind of thick clouds. If the thick cloud cover areas overlap, by using the multi-output learning of the surrounding areas to predict the surface features of the overlapped thick cloud cover areas, this kind of thick cloud is removed. Experimental results show that the proposed cloud removal method can effectively solve the problems of the cloud overlapping and radiation difference among multi-source images. The cloud removal image is clear and smooth.

On-line forecasting model for zinc output based on self-tuning support vector regression and its application

An on-line forecasting model based on self-tuning support vectors regression for zinc output was put forward to maximize zinc output by adjusting operational parameters in the process of imperial smelting furnace. In this model, the mathematical model of support vector regression was converted into the same format as support vector machine for classification. Then a simplified sequential minimal optimization for classification was applied to train the regression coefficient vector α- α* and threshold b. Sequentially penalty parameter C was tuned dynamically through forecasting result during the training process. Finally, an on-line forecasting algorithm for zinc output was proposed. The simulation result shows that in spite of a relatively small industrial data set, the effective error is less than 10% with a remarkable performance of real time. The model was applied to the optimization operation and fault diagnosis system for imperial smelting furnace.

Endpoint Prediction of EAF Based on Multiple Support Vector Machines

The endpoint parameters are very important to the process of EAF steel-making, but their on-line measurement is difficult. The soft sensor technology is widely used for the prediction of endpoint parameters. Based on the analysis of the smelting process of EAF and the advantages of support vector machines, a soft sensor model for predicting the endpoint parameters was built using multiple support vector machines （MSVM）. In this model, the input space was divided by subtractive clustering and a sub-model based on LS-SVM was built in each sub-space. To decrease the correlation among the sub-models and to improve the accuracy and robustness of the model, the sub- models were combined by Principal Components Regression. The accuracy of the soft sensor model is perfectly improved. The simulation result demonstrates the practicability and efficiency of the MSVM model for the endpoint prediction of EAF.

Improved IMM algorithm based on support vector regression for UAV tracking

With the development of technology, the relevant performance of unmanned aerial vehicles(UAVs) has been greatly improved, and various highly maneuverable UAVs have been developed, which puts forward higher requirements on target tracking technology. Strong maneuvering refers to relatively instantaneous and dramatic changes in target acceleration or movement patterns, as well as continuous changes in speed,angle, and acceleration. However, the traditional UAV tracking algorithm model has poor adaptability and large amount of calculation. This paper applies support vector regression(SVR)to the interacting multiple model(IMM) algorithm. The simulation results show that the improved algorithm has higher tracking accuracy for highly maneuverable targets than the original algorithm, and can adjust parameters adaptively, making it more adaptable.

A Multiple Model Approach to Modeling Based on Fuzzy Support Vector Machines

A new multiple models(MM) approach was proposed to model complex industrial process by using Fuzzy Support Vector Machines(F -SVMs). By applying the proposed approach to a pH neutralization titration experiment, F -SVMs MM not only provides satisfactory approximation and generalization property, but also achieves superior performance to USOCPN multiple modeling method and single modeling method based on standard SVMs.

基于图像处理的水培生菜冠层图像叶面积估测研究

为实现精准、高效、无损地获取植物工厂环境下水培生菜相关长势参数叶面积(Leaf area,LA),基于数字图像处理和机器学习回归方法建立单株水培生菜冠层图像LA估测模型。首先,通过智能手机获取2个生菜品种不同生长期的冠层可见光图像,利用Photoshop图像处理软件将原始图像统一剪裁为900像素×900像素大小,采用中值滤波(MedianBlur)法对剪裁后的图像进行去噪运算,将RGB图像转化为HSV颜色空间,再采用mask掩膜法分割彩色图像;然后,利用图像法获取单株生菜LA实测值,构建以LA实测值为因变量,以生菜冠层投影面积(Projected leaf area,PLA)为自变量的线性回归(Linear regression,LR)模型和以全局图像特征(颜色、形状、纹理等)为自变量的支持向量回归(Support vector regression,SVR)、多元线性回归(Multiple linear regression,MLR)和随机森林(Random forest,RF)等LA估测模型进行对比分析;最后,采用决定系数(Coefficient of determination,R^(2))和均方根误差(Root mean square error,RMSE)评估模型的准确性。结果表明:RF模型估测效果最好,对于生菜品种‘绿萝’单株LA估测结果的R^(2)为0.9714、RMSE为8.89 cm2,对于品种‘碧霄’估测结果的R^(2)为0.9201、RMSE为23.34 cm2。本研究验证了RF回归模型能够较准确地估测生菜单株叶面积,可为植物工厂水培生菜LA无损估测提供新的解决方案和研究基础。

微胶囊相变材料改良粉砂土的导热系数及预测模型

【目的】针对季节冻土地区渠道冻融破坏,分析微胶囊相变材料(microencapsulated phase change materials,mPCM)改良粉砂土层渠基的温度场,对改良粉砂土的导热系数进行研究。【方法】以mPCM为改良剂,掺入渠基粉砂土形成mPCM改良粉砂土;对mPCM改良粉砂土进行导热系数实验和内部结构表征;采用多元线性回归和支持向量机(support vector machine,SVM)方法分别建立mPCM改良粉砂土的导热系数预测模型。【结果】mPCM改良粉砂土导热系数与含水率、干密度、mPCM掺量有关,且受冰水相对含量、冰水相变潜热、mPCM相变潜热和mPCM填充密实作用的影响,具有明显的温度效应;mPCM改良粉砂土导热系数的变化与实验温度和mPCM相变温度有关,可分为快速降低、缓慢降低和逐步上升3个阶段;多元线性回归和SVM模型均能较好地拟合预测mPCM改良粉砂土的导热系数,但SVM模型更适用于表征mPCM改良粉砂土导热系数各影响因素间的非线性关系。【结论】mPCM改良粉砂土的导热系数提高能够有效调控渠基土温度场,减轻渠道冻害,且SVM模型能更加准确地进行导热系数预测。

Primal least squares twin support vector regression

The training algorithm of classical twin support vector regression (TSVR) can be attributed to the solution of a pair of quadratic programming problems (QPPs) with inequality constraints in the dual space.However,this solution is affected by time and memory constraints when dealing with large datasets.In this paper,we present a least squares version for TSVR in the primal space,termed primal least squares TSVR (PLSTSVR).By introducing the least squares method,the inequality constraints of TSVR are transformed into equality constraints.Furthermore,we attempt to directly solve the two QPPs with equality constraints in the primal space instead of the dual space;thus,we need only to solve two systems of linear equations instead of two QPPs.Experimental results on artificial and benchmark datasets show that PLSTSVR has comparable accuracy to TSVR but with considerably less computational time.We further investigate its validity in predicting the opening price of stock.

A Novel Method for Flatness Pattern Recognition via Least Squares Support Vector Regression

To adapt to the new requirement of the developing flatness control theory and technology, cubic patterns were introduced on the basis of the traditional linear, quadratic and quartic flatness basic patterns. Linear, quadratic, cubic and quartic Legendre orthogonal polynomials were adopted to express the flatness basic patterns. In order to over- come the defects live in the existent recognition methods based on fuzzy, neural network and support vector regres- sion （SVR） theory, a novel flatness pattern recognition method based on least squares support vector regression （LS-SVR） was proposed. On this basis, for the purpose of determining the hyper-parameters of LS-SVR effectively and enhan- cing the recognition accuracy and generalization performance of the model, particle swarm optimization algorithm with leave-one-out （LOO） error as fitness function was adopted. To overcome the disadvantage of high computational complexity of naive cross-validation algorithm, a novel fast cross-validation algorithm was introduced to calculate the LOO error of LDSVR. Results of experiments on flatness data calculated by theory and a 900HC cold-rolling mill practically measured flatness signals demonstrate that the proposed approach can distinguish the types and define the magnitudes of the flatness defects effectively with high accuracy, high speed and strong generalization ability.

基于高光谱成像技术的涌泉蜜桔糖度最优检测位置

本文旨在探索涌泉蜜桔糖度的最优检测位置和最佳预测模型,以便为蜜桔糖度检测分级提供理论依据。本文利用波长为390.2~981.3 nm的高光谱成像系统对涌泉蜜桔糖度最佳检测位置进行研究,将涌泉蜜桔的花萼、果茎、赤道和全局的光谱信息与其对应部位的糖度结合,建立其预测模型。使用标准正态变量变换(SNV)、多元散射校正(MSC)、基线校准(Baseline)和SG平滑(Savitzkv-Golay)4种预处理方法对不同部位的原始光谱进行预处理,用预处理后的光谱数据建立偏最小二乘回归(PLSR)和最小二乘支持向量机(LSSVM)模型。找出蜜桔不同部位的最佳预处理方式,对经过最佳预处理后的光谱数据采用竞争性自适应重加权算法(CARS)和无信息变量消除法(UVE)进行特征波长筛选。最后,用筛选后的光谱数据建立PLSR和LSSVM模型并进行分析比较。研究结果表明,全局的MSC-CARS-LSSVM模型预测效果最佳,其预测集相关系数Rp=0.955,均方根误差RMSEP=0.395,其次是蜜桔赤道部位的SNV-PLSR模型,其预测集相关系数Rp=0.936,均方根误差RMSEP=0.37。两者预测集相关系数相近,因此可将赤道位置作为蜜桔糖度的最优检测位置。本研究表明根据蜜桔不同部位建立的糖度预测模型的预测效果有所差异,研究最优检测位置和最佳预测模型可以为蜜桔进行糖度检测分级提供理论依据。

基于无人机多光谱影像的云南松林蓄积量估测模型

【目的】无人机多光谱遥感影像较可见光影像具有更丰富的光谱信息,在森林蓄积量估测中具有较大潜力。以无人机载多光谱遥感影像为主要数据源,探索森林蓄积量的遥感估测模型,以克服传统地面调查工作量大、耗时长、成本高等弊端。【方法】以滇中地区典型天然云南松Pinusyunnanensis纯林为研究对象,利用无人机多光谱影像提取单波段反射率、各类植被指数、纹理特征等,计算各特征变量的标准地均值;筛选与云南松林蓄积量相关性显著的特征变量,采用多元线性、随机森林、支持向量机建立云南松林蓄积量估测模型,以决定系数(R^(2))、平均绝对误差(E_(MA))、均方根误差(E_(RMS))、平均相对误差(EMR)评价模型精度。【结果】①3种模型中,随机森林的精度最高(R^(2)=0.89,E_(MA)=4.69 m^(3)·hm^(-2),E_(RMS)=5.45 m^(3)·hm^(-2),EMR=14.5%),其次为支持向量机(R^(2)=0.74,E_(MA)=5.27 m^(3)·hm^(-2),E_(RMS)=8.31 m^(3)·hm^(-2),EMR=13.1%),最低为多元线性回归模型(R^(2)=0.35,E_(MA)=10.12 m^(3)·hm^(-2),E_(RMS)=12.85 m^(3)·hm^(-2),EMR=28.1%);3种模型在测试集上的估测精度均有所降低,随机森林的模型表现最好,支持向量机次之,多元线性最差。②3种模型在云南松林蓄积量估测中均存在一定的低值高估和高值低估现象。③基于无人机多光谱影像估测云南松林蓄积量,纹理特征仍是不可忽视的重要因子。【结论】基于无人机多光谱影像,在不进行单木分割的情景下,提取标准地的单波段反射率、植被指数、纹理特征均值,筛选适用于蓄积量估算的变量构建估测模型。通过对3种模型进行精度评价,随机森林为云南松林蓄积量估测的最佳模型。

基于近红外光谱技术结合ARO-LSSVR的天麻中有效成分含量快速检测

为实现对天麻中天麻素和对羟基苯甲醇含量的快速、无损检测,以云南昭通乌天麻为实验对象,采集900~1 700 nm波长范围内的光谱数据。首先,采用卷积平滑和标准正态变量变换进行光谱数据预处理,其次通过竞争性自适应重加权采样法(competitive adapative reweighted sampling,CARS)与迭代保留信息变量算法进行特征波长的提取,根据基于特征波长建立最小二乘支持向量回归(least squares support vector machine,LSSVR)模型的结果,选择最佳特征波长提取方法。为了提高模型的准确率,本研究引入人工兔智能算法对LSSVR中的正则化参数γ和核函数密度σ2进行优化,并与粒子群优化算法(particle swarm optimization,PSO)、灰狼优化算法(grey wolf optimizer,GWO)进行对比,评估人工兔优化算法(artificial rabbits optimization,ARO)的优越性。结果表明,ARO算法在寻优速度、寻优能力上优于PSO、GWO;天麻素、对羟基苯甲醇的最佳预测模型均为CARS-AROLSSVR,其Rp2分别为0.969 6和0.957 7,预测均方根误差分别为0.014和0.020。综上,近红外光谱可用于天麻中有效成分的定量检测,本研究可为天麻快速检测装置的研发提供理论依据。

基于PSO-LSSVR的机器人磨抛材料去除模型

为了建立磨抛工艺参数与材料去除深度的关系,建立一种基于最小二乘法支持向量回归机(LSSVR)的材料去除深度预测模型,并引入粒子群优化(PSO)算法来优化LSSVR的超参数,可提高LSSVR模型的预测准确性和全局优寻能力。搭建叶片机器人砂带磨抛实验平台,设计并进行多工艺参数实验,考虑工艺参数:砂带粒度、砂带转速、进给速度、接触力和叶片表面曲率半径,获得叶片表面的材料去除深度,最终利用实验数据建立了PSO-LSSVR叶片材料去除深度预测模型。结果表明,PSO-LSSVR模型的预测准确率为95.37%,平均预测误差为0.003463,说明PSO-LSSVR模型具有较高的预测精度,并结合实际加工情况进行实验验证可行性,证明PSO-LSSVR模型可以有效合理地建立工艺参数与材料去除深度的关系。

可见-近红外与中红外光谱预测土壤养分的比较研究

对土壤养分的快速和准确测定有助于适时指导施肥。为进一步研究可见-近红外(350~2500 nm)与中红外光谱(4000~650 cm^(–1))对土壤养分的预测能力,以贵州省500个土样为例,对光谱进行Savitzky-Golay(SG)平滑去噪处理,再用标准正态化(SNV)方法进行基线校正,然后分别应用偏最小二乘回归(PLSR)和支持向量机(SVM)两种方法进行建模,探讨了可见-近红外和中红外光谱对土壤全氮(TN)、全磷(TP)、全钾(TK)和碱解氮(AN)、有效磷(AP)、速效钾(AK)共六种土壤养分的预测效果。结果表明:(1)无论基于可见-近红外光谱还是中红外光谱,PLSR模型的预测精度整体均优于SVM模型。(2)中红外光谱对TN、TK和AN的预测精度均显著高于可见-近红外光谱,可见-近红外和中红外光谱均可以可靠地预测TN和TK(性能与四分位间隔距离的比率(RPIQ)大于2.10),中红外光谱可相对较可靠地预测AN(RPIQ=1.87);但两类光谱对TP、AP和AK的预测效果均较差(RPIQ<1.34)。(3)当变量投影重要性得分(VIP)大于1.5时,PLSR模型在中红外光谱区域预测TN和TK的重要波段多于可见-近红外光谱区域,TN的重要波段主要集中于可见-近红外光谱区域的1910和2207 nm附近,中红外光谱区域的1120、1000、960、910、770和668 cm^(–1)附近;TK的重要波段主要集中于可见-近红外光谱区域的540、2176、2225和2268 nm附近,中红外光谱区域的1040、960、910、776、720和668 cm^(–1)附近。因此,中红外光谱技术结合PLSR模型对土壤养分预测效果较好,可快速准确预测土壤TN和TK,可为指导适时施肥提供技术支撑。