Forecast Urban Air Pollution in Mexico City by Using Support Vector Machines: A Kernel Performance Approach

The development of forecasting models for pollution particles shows a nonlinear dynamic behavior;hence, implementation is a non-trivial process. In the literature, there have been multiple models of particulate pollutants, which use softcomputing techniques and machine learning such as: multilayer perceptrons, neural networks, support vector machines, kernel algorithms, and so on. This paper presents a prediction pollution model using support vector machines and kernel functions, which are: Gaussian, Polynomial and Spline. Finally, the prediction results of ozone (O3), particulate matter (PM10) and nitrogen dioxide (NO2) at Mexico City are presented as a case study using these techniques.

Nonlinear Model Predictive Control Based on Support Vector Machine with Multi-kernel

非线性的系统和它的特定的鉴定方法的 Multi-kernel-based 支持向量机器(SVM ) 模型结构被建议，它 SVM 是镇静的，线性内核功能与花键内核功能由 SVM 在系列列在后面。在这个模型的帮助下，非线性的模型预兆的控制能被转变到线性模型预兆的控制，并且因而预兆的控制是可能的发源的 multi-step-ahead 的最佳的输入的一个统一分析答案。这个算法不要求联机反复的优化以便对有更少的计算的即时控制合适。pH 中立化过程和 CSTR 反应堆的模拟结果显示出介绍算法的有效性和优点。

WAVELET KERNEL SUPPORT VECTOR MACHINES FOR SPARSE APPROXIMATION

Wavelet, a powerful tool for signal processing, can be used to approximate the target func-tion. For enhancing the sparse property of wavelet approximation, a new algorithm was proposed by using wavelet kernel Support Vector Machines (SVM), which can converge to minimum error with bet-ter sparsity. Here, wavelet functions would be firstly used to construct the admitted kernel for SVM according to Mercy theory; then new SVM with this kernel can be used to approximate the target fun-citon with better sparsity than wavelet approxiamtion itself. The results obtained by our simulation ex-periment show the feasibility and validity of wavelet kernel support vector machines.

Temperature prediction control based on least squares support vector machines

A prediction control algorithm is presented based on least squares support vector machines (LS-SVM) model for a class of complex systems with strong nonlinearity. The nonlinear off-line model of the controlled plant is built by LS-SVM with radial basis function (RBF) kernel. In the process of system running, the off-line model is linearized at each sampling instant, and the generalized prediction control (GPC) algorithm is employed to implement the prediction control for the controlled plant. The obtained algorithm is applied to a boiler temperature control system with complicated nonlinearity and large time delay. The results of the experiment verify the effectiveness and merit of the algorithm.

SVM with Quadratic Polynomial Kernel Function Based Nonlinear Model One-step-ahead Predictive Control

A support vector machine (SVM) with quadratic polynomial kernel function based nonlinear model one-step-ahead predictive controller is presented. The SVM based predictive model is established with black-box identification method. By solving a cubic equation in the feature space, an explicit predictive control law is obtained through the predictive control mechanism. The effect of controller is demonstrated on a recognized benchmark problem and on the control of continuous-stirred tank reactor (CSTR). Simulation results show that SVM with quadratic polynomial kernel function based predictive controller can be well applied to nonlinear systems, with good performance in following reference trajectory as well as in disturbance-rejection.

Support Vector Machine:A Novel Tool for Mineral Prospectivity Mapping

Support Vector Machine(SVM) was demonstrated as a potentially useful tool to integrate multi-variables and to produce a predictive map for mineral deposits. The e 1071,a free R package,was used to construct a SVM with radial kernel function to integrate four evidence layers and to map prospectivity for Gangdese porphyry copper deposits.The results demonstrate that the predicted prospective target area for Cu occupies 20.5%of the total study area and contains 52.4%of the total number of known porphyry copper deposits.The results obtained

New predictive control algorithms based on Least Squares Support Vector Machines

Used for industrial process with different degree of nonlinearity, the two predictive control algorithms presented in this paper are based on Least Squares Support Vector Machines (LS-SVM) model. For the weakly nonlinear system, the system model is built by using LS-SVM with linear kernel function, and then the obtained linear LS-SVM model is transformed into linear input-output relation of the controlled system. However, for the strongly nonlinear system, the off-line model of the controlled system is built by using LS-SVM with Radial Basis Function (RBF) kernel. The obtained nonlinear LS-SVM model is linearized at each sampling instant of system running, after which the on-line linear input-output model of the system is built. Based on the obtained linear input-output model, the Generalized Predictive Control (GPC) algorithm is employed to implement predictive control for the controlled plant in both algorithms. The simulation results after the presented algorithms were implemented in two different industrial processes model; respectively revealed the effectiveness and merit of both algorithms.

Mandarin Digits Speech Recognition Using Support Vector Machines

A method of applying support vector machine (SVM) in speech recognition was proposed, and a speech recognition system for mandarin digits was built up by SVMs. In the system, vectors were linearly extracted from speech feature sequence to make up time-aligned input patterns for SVM, and the decisions of several 2-class SVM classifiers were employed for constructing an N-class classifier. Four kinds of SVM kernel functions were compared in the experiments of speaker-independent speech recognition of mandarin digits. And the kernel of radial basis function has the highest accurate rate of 99.33%, which is better than that of the baseline system based on hidden Markov models (HMM) (97.08%). And the experiments also show that SVM can outperform HMM especially when the samples for learning were very limited.

Support vector machine based nonlinear model multi-step-ahead optimizing predictive control

A support vector machine with guadratic polynomial kernel function based nonlinear model multi-step-ahead optimizing predictive controller was presented. A support vector machine based predictive model was established by black-box identification. And a quadratic objective function with receding horizon was selected to obtain the controller output. By solving a nonlinear optimization problem with equality constraint of model output and boundary constraint of controller output using Nelder-Mead simplex direct search method, a sub-optimal control law was achieved in feature space. The effect of the controller was demonstrated on a recognized benchmark problem and a continuous-stirred tank reactor. The simulation results show that the multi-step-ahead predictive controller can be well applied to nonlinear system, with better performance in following reference trajectory and disturbance-rejection.

Application of wavelet support vector regression on SAR data de-noising

A new filtering method for SAR data de-noising using wavelet support vector regression （WSVR） is developed. On the basis of the grey scale distribution character of SAR imagery, the logarithmic SAR image as a noise polluted signal is taken and the noise model assumption in logarithmic domain with Gaussian noise and impact noise is proposed. Based on the better per- formance of support vector regression （SVR） for complex signal approximation and the wavelet for signal detail expression, the wavelet kernel function is chosen as support vector kernel func- tion. Then the logarithmic SAR image is regressed with WSVR. Furthermore the regression distance is used as a judgment index of the noise type. According to the judgment of noise type every pixel can be adaptively de-noised with different filters. Through an approximation experiment for a one-dimensional complex signal, the feasibility of SAR data regression based on WSVR is con- firmed. Afterward the SAR image is treated as a two-dimensional continuous signal and filtered by an SVR with wavelet kernel function. The results show that the method proposed here reduces the radar speckle noise effectively while maintaining edge features and details well.

Signal Classification Method Based on Support Vector Machine and High-Order Cumulants

In this paper, a classification method based on Support Vector Machine (SVM) is given in the digital modulation signal classification. The second, fourth and sixth order cumulants of the received signals are used as classification vectors firstly, then the kernel thought is used to map the feature vector to the high dimensional feature space and the optimum separating hyperplane is constructed in space to realize signal recognition. In order to build an effective and robust SVM classifier, the radial basis kernel function is selected, one against one or one against rest of multi-class classifier is designed, and method of parameter selection using cross- validation grid is adopted. Through the experiments it can be concluded that the classifier based on SVM has high performance and is more robust.

Protein-Protein Interaction Extraction Based on Convex Combination Kernel Function

Owing to the effect of classified models was different in Protein-Protein Interaction(PPI) extraction, which was made by different single kernel functions, and only using single kernel function hardly trained the optimal classified model to extract PPI, this paper presents a strategy to find the optimal kernel function from a kernel function set. The strategy is that in the kernel function set which consists of different single kernel functions, endlessly finding the last two kernel functions on the performance in PPI extraction, using their optimal kernel function to replace them, until there is only one kernel function and it’s the final optimal kernel function. Finally, extracting PPI using the classified model made by this kernel function. This paper conducted the PPI extraction experiment on AIMed corpus, the experimental result shows that the optimal convex combination kernel function this paper presents can effectively improve the extraction performance than single kernel function, and it gets the best precision which reaches 65.0 among the similar PPI extraction systems.

Kernel matrix learning with a general regularized risk functional criterion

Kernel-based methods work by embedding the data into a feature space and then searching linear hypothesis among the embedding data points. The performance is mostly affected by which kernel is used. A promising way is to learn the kernel from the data automatically. A general regularized risk functional （RRF） criterion for kernel matrix learning is proposed. Compared with the RRF criterion, general RRF criterion takes into account the geometric distributions of the embedding data points. It is proven that the distance between different geometric distdbutions can be estimated by their centroid distance in the reproducing kernel Hilbert space. Using this criterion for kernel matrix learning leads to a convex quadratically constrained quadratic programming （QCQP） problem. For several commonly used loss functions, their mathematical formulations are given. Experiment results on a collection of benchmark data sets demonstrate the effectiveness of the proposed method.

The seam offset identification based on support vector regression machines

The principle of the support vector regression machine（SVR） is first analysed. Then the new data-dependent kernel function is constructed from information geometry perspective. The current waveforms change regularly in accordance with the different horizontal offset when the rotational frequency of the high speed rotational arc sensor is in the range from 15 Hz to 30 Hz. The welding current data is pretreated by wavelet filtering, mean filtering and normalization treatment. The SVR model is constructed by making use of the evolvement laws, the decision function can be achieved by training the SVR and the seam offset can be identified. The experimental results show that the precision of the offset identification can be greatly improved by modifying the SVR and applying mean filteringfrom the longitudinal direction.

Traffic Sign Recognition Based on CNN and Twin Support Vector Machine Hybrid Model

With the progress of deep learning research, convolutional neural networks have become the most important method in feature extraction. How to effectively classify and recognize the extracted features will directly affect the performance of the entire network. Traditional processing methods include classification models such as fully connected network models and support vector machines. In order to solve the problem that the traditional convolutional neural network is prone to over-fitting for the classification of small samples, a CNN-TWSVM hybrid model was proposed by fusing the twin support vector machine (TWSVM) with higher computational efficiency as the CNN classifier, and it was applied to the traffic sign recognition task. In order to improve the generalization ability of the model, the wavelet kernel function is introduced to deal with the nonlinear classification task. The method uses the network initialized from the ImageNet dataset to fine-tune the specific domain and intercept the inner layer of the network to extract the high abstract features of the traffic sign image. Finally, the TWSVM based on wavelet kernel function is used to identify the traffic signs, so as to effectively solve the over-fitting problem of traffic signs classification. On GTSRB and BELGIUMTS datasets, the validity and generalization ability of the improved model is verified by comparing with different kernel functions and different SVM classifiers.

基于多特征核的高光谱遥感影像分类方法

支持向量机(SVM)的核函数选取是制约其分类性能的重要因素,而当前的核函数大多以光谱距离作为构核元素,而忽略了光谱角度这一光谱特征。文章提出一种均衡化光谱距离与光谱角多特征组合核(ESAD)的SVM分类器,对2003年意大利帕维亚大学的ROSIS高光谱数据作分类处理,并对影像的分类精度作评价分析。实验结果表明:ESAD核SVM整体分类精度相较于光谱距离核SVM和光谱角核SVM分别提升8.88%和11.03%,分类精度理想,一定程度上抑制了“同谱异物”现象。

基于SVM混合核的不透水面提取及扩张分析

利用支持向量机中单一核函数提取不透水面时存在时间复杂度高和提取精度低的问题。针对该问题,本文在径向基核函数的基础上引入多项式核函数,提出了一种混合核函数的不透水面提取方法。首先,由于属性不同的地物具有相似的光谱信息,在特征提取过程中将光谱信息与图像熵纹理信息相结合,可更加清楚地区分各地物类别。然后,在径向基核函数的基础上引入多项式核,可分别从局部和全局角度获取影像的特征信息,提高不透水面提取精度。最后,在不透水面提取结果基础上进行时空演变分析。本文利用阜新市主城区2009—2021年Landsat影像进行试验。结果表明,光谱与熵纹理相结合方法可改善特征提取效果,提升不透水面提取精度。与单一核函数提取方法对比,利用本文方法提取不透水面精度提高了2.5%,证明了该方法的有效性。

多核支持向量机预测电网系统可靠性

为了改善电网系统可靠性预测性能,构建多个目标函数并采用多核支持向量机算法对配电网进行可靠性预测;从电网样本特征中筛选供电可用率、户均停电时间、户均停电次数3个关键指标,建立可靠性评价目标函数,且采用多核支持向量机训练可靠性指标特征;将高斯核函数、多项式核函数和Sigmoid核函数进行多核组合,采用多核支持向量机求解不同目标函数,获得电网系统可靠性预测结果,进而确定更佳的可靠性预测核函数组合。结果表明,合理选择核函数组合和电网可靠性指标,多核支持向量机对供电可用率、户均停电时间和户均停电次数指标预测准确率较高,且稳定性好,高斯核函数-Sigmoid核函数组合的可靠性预测准确性最佳,高斯核函数-多项式核函数-Sigmoid核函数组合的预测稳定性最好。

基于神经正切核的小数据集回归任务

回归是常见的一类任务,两类特殊的回归模型:支持向量回归(SVR)与核岭回归(KRR)通过核函数解决数据在原始空间线性不可分的问题。一种新型核函数(NTK)被提出用于拟合无限宽神经网络的训练过程,相关研究显示NTK利于处理小数据集。选取多领域数据集在两种模型中比较NTK与常用核的性能,并对NTK进行了鲁棒性研究。结果表明NTK-SVR模型在部分数据集上取得了2.5%~20%的提升。