WAVELET KERNEL SUPPORT VECTOR MACHINES FOR SPARSE APPROXIMATION

Wavelet, a powerful tool for signal processing, can be used to approximate the target func-tion. For enhancing the sparse property of wavelet approximation, a new algorithm was proposed by using wavelet kernel Support Vector Machines (SVM), which can converge to minimum error with bet-ter sparsity. Here, wavelet functions would be firstly used to construct the admitted kernel for SVM according to Mercy theory; then new SVM with this kernel can be used to approximate the target fun-citon with better sparsity than wavelet approxiamtion itself. The results obtained by our simulation ex-periment show the feasibility and validity of wavelet kernel support vector machines.

Acoustic emission source identification based on harmonic wavelet packet and support vector machine

In order to solve the fatigue damage identification problem of helicopter moving components, a new approach for acoustic emission （AE） source type identification based on the harmonic wavelet packet （HWPT） feature extraction and the hierarchy support vector machine （H-SVM） classifier is proposed. After a four-level decomposition of the HWPT, the energy feature of AE signals in different frequency bands is extracted, which overcomes the shortcomings of the traditional wavelet packet including energy leakage, and inflexible frequency band selection and different frequency resolutions on different levels. The H-SVM classifier is trained with a subset of the experimental data for known AE source types and tested using the remaining set of data. The results of pressure-off experiments on the specimens of carbon fiber materials indicate that the proposed approach can effectively implement the AE source type identification, and has a better performance in terms of computational efficiency and identification accuracy than the wavelet packet （WPT） feature extraction.

POSITIVE DEFINITE KERNEL IN SUPPORT VECTOR MACHINE(SVM)

The relationship among Mercer kernel, reproducing kernel and positive definite kernel in support vector machine （SVM） is proved and their roles in SVM are discussed. The quadratic form of the kernel matrix is used to confirm the positive definiteness and their construction. Based on the Bochner theorem, some translation invariant kernels are checked in their Fourier domain. Some rotation invariant radial kernels are inspected according to the Schoenberg theorem. Finally, the construction of discrete scaling and wavelet kernels, the kernel selection and the kernel parameter learning are discussed.

Ignition Pattern Analysis for Automotive Engine Trouble Diagnosis Using Wavelet Packet Transform and Support Vector Machines

Engine spark ignition is an important source for diagnosis of engine faults.Based on the waveform of the ignition pattern,a mechanic can guess what may be the potential malfunctioning parts of an engine with his/her experience and handbooks.However,this manual diagnostic method is imprecise because many spark ignition patterns are very similar.Therefore,a diagnosis needs many trials to identify the malfunctioning parts.Meanwhile the mechanic needs to disassemble and assemble the engine parts for verification.To tackle this problem,an intelligent diagnosis system was established based on ignition patterns.First,the captured patterns were normalized and compressed.Then wavelet packet transform（WPT） was employed to extract the representative features of the ignition patterns.Finally,a classification system was constructed by using multi-class support vector machines（SVM） and the extracted features.The classification system can intelligently classify the most likely engine fault so as to reduce the number of diagnosis trials.Experimental results show that SVM produces higher diagnosis accuracy than the traditional multilayer feedforward neural network.This is the first trial on the combination of WPT and SVM to analyze ignition patterns and diagnose automotive engines.

Nonlinear Model Predictive Control Based on Support Vector Machine with Multi-kernel

Multi-kernel-based support vector machine （SVM） model structure of nonlinear systems and its specific identification method is proposed, which is composed of a SVM with linear kernel function followed in series by a SVM with spline kernel function. With the help of this model, nonlinear model predictive control can be transformed to linear model predictive control, and consequently a unified analytical solution of optimal input of multi-step-ahead predictive control is possible to derive. This algorithm does not require online iterative optimization in order to be suitable for real-time control with less calculation. The simulation results of pH neutralization process and CSTR reactor show the effectiveness and advantages of the presented algorithm.

Classification using wavelet packet decomposition and support vector machine for digital modulations

To make the modulation classification system more suitable for signals in a wide range of signal to noise rate （SNR）, a feature extraction method based on signal wavelet packet transform modulus maxima matrix （WPTMMM） and a novel support vector machine fuzzy network （SVMFN） classifier is presented. The WPTMMM feature extraction method has less computational complexity, more stability, and has the preferable advantage of robust with the time parallel moving and white noise. Further, the SVMFN uses a new definition of fuzzy density that incorporates accuracy and uncertainty of the classifiers to improve recognition reliability to classify nine digital modulation types （i.e. 2ASK, 2FSK, 2PSK, 4ASK, 4FSK, 4PSK, 16QAM, MSK, and OQPSK）. Computer simulation shows that the proposed scheme has the advantages of high accuracy and reliability （success rates are over 98% when SNR is not lower than 0dB）, and it adapts to engineering applications.

Incremental support vector machine algorithm based on multi-kernel learning

A new incremental support vector machine （SVM） algorithm is proposed which is based on multiple kernel learning. Through introducing multiple kernel learning into the SVM incremental learning, large scale data set learning problem can be solved effectively. Furthermore, different punishments are adopted in allusion to the training subset and the acquired support vectors, which may help to improve the performance of SVM. Simulation results indicate that the proposed algorithm can not only solve the model selection problem in SVM incremental learning, but also improve the classification or prediction precision.

Radar Emitter Signal Recognition Using Wavelet Packet Transform and Support Vector Machines

This paper presents a novel method for radar emitter signal recognition. First, wavelet packet transform （WPT） is introduced to extract features from radar emitter signals. Then, rough set theory is used to select the optimal feature subset with good discriminability from original feature set, and support vector machines （SVMs） are employed to design classifiers. A large number of experimental results show that the proposed method achieves very high recognition rates for 9 radar emitter signals in a wide range of signal-to-noise rates, and proves a feasible and valid method.

Use of Discrete Wavelet Features and Support Vector Machine for Fault Diagnosis of Face Milling Tool

This paper presents the fault diagnosis of face milling tool based on machine learning approach.While machining,spindle vibration signals in feed direction under healthy and faulty conditions of the milling tool are acquired.A set of discrete wavelet features is extracted from the vibration signals using discrete wavelet transform(DWT)technique.The decision tree technique is used to select significant features out of all extracted wavelet features.C-support vector classification(C-SVC)andν-support vector classification(ν-SVC)models with different kernel functions of support vector machine(SVM)are used to study and classify the tool condition based on selected features.From the results obtained,C-SVC is the best model thanν-SVC and it can be able to give 94.5%classification accuracy for face milling of special steel alloy 42CrMo4.

Chaotic time series prediction using fuzzy sigmoid kernel-based support vector machines

Support vector machines （SVM） have been widely used in chaotic time series predictions in recent years. In order to enhance the prediction efficiency of this method and implement it in hardware, the sigmoid kernel in SVM is drawn in a more natural way by using the fuzzy logic method proposed in this paper. This method provides easy hardware implementation and straightforward interpretability. Experiments on two typical chaotic time series predictions have been carried out and the obtained results show that the average CPU time can be reduced significantly at the cost of a small decrease in prediction accuracy, which is favourable for the hardware implementation for chaotic time series prediction.

Least-Square Support Vector Machine and Wavelet Selection for Hearing Loss Identification

Hearing loss(HL)is a kind of common illness,which can significantly reduce the quality of life.For example,HL often results in mishearing,misunderstanding,and communication problems.Therefore,it is necessary to provide early diagnosis and timely treatment for HL.This study investigated the advantages and disadvantages of three classical machine learning methods:multilayer perceptron(MLP),support vector machine(SVM),and least-square support vector machine(LS-SVM)approach andmade a further optimization of the LS-SVM model via wavelet entropy.The investigation illustrated that themultilayer perceptron is a shallowneural network,while the least square support vector machine uses hinge loss function and least-square optimizationmethod.Besides,a wavelet selection method was proposed,and we found db4 can achieve the best results.The experiments showed that the LS-SVM method can identify the hearing loss disease with an overall accuracy of three classes as 84.89±1.77,which is superior to SVM andMLP.The results show that the least-square support vector machine is effective in hearing loss identification.

Forecast Urban Air Pollution in Mexico City by Using Support Vector Machines: A Kernel Performance Approach

The development of forecasting models for pollution particles shows a nonlinear dynamic behavior;hence, implementation is a non-trivial process. In the literature, there have been multiple models of particulate pollutants, which use softcomputing techniques and machine learning such as: multilayer perceptrons, neural networks, support vector machines, kernel algorithms, and so on. This paper presents a prediction pollution model using support vector machines and kernel functions, which are: Gaussian, Polynomial and Spline. Finally, the prediction results of ozone (O3), particulate matter (PM10) and nitrogen dioxide (NO2) at Mexico City are presented as a case study using these techniques.

A Kernel Clustering Algorithm for Fast Training of Support Vector Machines

A new algorithm named kernel bisecting k-means and sample removal(KBK-SR) is proposed as sampling preprocessing for support vector machine(SVM) training to improve the efficiency.The proposed algorithm tends to quickly produce balanced clusters of similar sizes in the kernel feature space,which makes it efficient and effective for reducing training samples.Theoretical analysis and experimental results on three UCI real data benchmarks both show that,with very short sampling time,the proposed algorithm dramatically accelerates SVM sampling and training while maintaining high test accuracy.

Machinery Condition Prediction Based on Support Vector Machine Model with Wavelet Transform

Soft failure of mechanical equipment makes its performance drop gradually,which occupies a large proportion and has certain regularity. The performance can be evaluated and predicted through early state monitoring and data analysis. The vibration signal was modeled from the double row bearing,and wavelet transform and support vector machine model( WT-SVM model) was constructed and trained for bearing degradation process prediction. Besides Hazen plotting position relationships was applied to describing the degradation trend distribution and a 95%confidence level based on t-distribution was given. The single SVM model and neural network( NN) approach were also investigated as a comparison. Results indicate that the WT-SVM model outperforms the NN and single SVM models,and is feasible and effective in machinery condition prediction.

Support vector machine with mixture of kernels for automatic image annotation

Automatic image annotation(AIA)has become an important and challenging problem in computer vision due to the existence of semantic gap.In this paper,a novel support vector machine with mixture of kernels(SVM-MK)for automatic image annotation is proposed.On one hand,the combined global and local block-based image features are extracted in order to reflect the intrinsic content of images as complete as possible.On the other hand,SVM-MK is constructed to shoot for better annotating performance.Experimental results on Corel dataset show that the proposed image feature representation method as well as automatic image annotation classifier,SVM-MK,can achieve higher annotating accuracy than SVM with any single kernel and mi-SVM for semantic image annotation.

A Novel Kernel for Least Squares Support Vector Machine

Extreme learning machine(ELM) has attracted much attention in recent years due to its fast convergence and good performance.Merging both ELM and support vector machine is an important trend,thus yielding an ELM kernel.ELM kernel based methods are able to solve the nonlinear problems by inducing an explicit mapping compared with the commonly-used kernels such as Gaussian kernel.In this paper,the ELM kernel is extended to the least squares support vector regression(LSSVR),so ELM-LSSVR was proposed.ELM-LSSVR can be used to reduce the training and test time simultaneously without extra techniques such as sequential minimal optimization and pruning mechanism.Moreover,the memory space for the training and test was relieved.To confirm the efficacy and feasibility of the proposed ELM-LSSVR,the experiments are reported to demonstrate that ELM-LSSVR takes the advantage of training and test time with comparable accuracy to other algorithms.

Particle Swarm Optimization-Support Vector Machine Model for Machinery Fault Diagnoses in High-Voltage Circuit Breakers

According to statistic data,machinery faults contribute to largest proportion of High-voltage circuit breaker failures,and traditional maintenance methods exist some disadvantages for that issue.Therefore,based on the wavelet packet decomposition approach and support vector machines,a new diagnosis model is proposed for such fault diagnoses in this study.The vibration eigenvalue extraction is analyzed through wavelet packet decomposition,and a four-layer support vector machine is constituted as a fault classifier.The Gaussian radial basis function is employed as the kernel function for the classifier.The penalty parameter c and kernel parameterδof the support vector machine are vital for the diagnostic accuracy,and these parameters must be carefully predetermined.Thus,a particle swarm optimizationsupport vector machine model is developed in which the optimal parameters c andδfor the support vector machine in each layer are determined by the particle swarm algorithm.The validity of this fault diagnosis model is determined with a real dataset from the operation experiment.Moreover,comparative investigations of fault diagnosis experiments with a normal support vector machine and a particle swarm optimization back-propagation neural network are also implemented.The results indicate that the proposed fault diagnosis model yields better accuracy and e-ciency than these other models.

Temperature prediction control based on least squares support vector machines

A prediction control algorithm is presented based on least squares support vector machines (LS-SVM) model for a class of complex systems with strong nonlinearity. The nonlinear off-line model of the controlled plant is built by LS-SVM with radial basis function (RBF) kernel. In the process of system running, the off-line model is linearized at each sampling instant, and the generalized prediction control (GPC) algorithm is employed to implement the prediction control for the controlled plant. The obtained algorithm is applied to a boiler temperature control system with complicated nonlinearity and large time delay. The results of the experiment verify the effectiveness and merit of the algorithm.

Support vector machine based nonlinear model multi-step-ahead optimizing predictive control

A support vector machine with guadratic polynomial kernel function based nonlinear model multi-step-ahead optimizing predictive controller was presented. A support vector machine based predictive model was established by black-box identification. And a quadratic objective function with receding horizon was selected to obtain the controller output. By solving a nonlinear optimization problem with equality constraint of model output and boundary constraint of controller output using Nelder-Mead simplex direct search method, a sub-optimal control law was achieved in feature space. The effect of the controller was demonstrated on a recognized benchmark problem and a continuous-stirred tank reactor. The simulation results show that the multi-step-ahead predictive controller can be well applied to nonlinear system, with better performance in following reference trajectory and disturbance-rejection.

New predictive control algorithms based on Least Squares Support Vector Machines

Used for industrial process with different degree of nonlinearity, the two predictive control algorithms presented in this paper are based on Least Squares Support Vector Machines (LS-SVM) model. For the weakly nonlinear system, the system model is built by using LS-SVM with linear kernel function, and then the obtained linear LS-SVM model is transformed into linear input-output relation of the controlled system. However, for the strongly nonlinear system, the off-line model of the controlled system is built by using LS-SVM with Radial Basis Function (RBF) kernel. The obtained nonlinear LS-SVM model is linearized at each sampling instant of system running, after which the on-line linear input-output model of the system is built. Based on the obtained linear input-output model, the Generalized Predictive Control (GPC) algorithm is employed to implement predictive control for the controlled plant in both algorithms. The simulation results after the presented algorithms were implemented in two different industrial processes model; respectively revealed the effectiveness and merit of both algorithms.