Application of support vector machine in trip chaining pattern recognition and analysis of explanatory variable effects

In order to improve the accuracy of travel demand forecast and considering the distribution of travel behaviors within time dimension, a trip chaining pattern recognition model was established based on activity purposes by applying three methods： the support vector machine （SVM） model, the radial basis function neural network （RBFNN） model and the multinomial logit （MNL） model. The effect of explanatory factors on trip chaining behaviors and their contribution to model performace were investigated by sensitivity analysis. Results show that the SVM model has a better performance than the RBFNN model and the MNL model due to its higher overall and partial accuracy, indicating its recognition advantage under a smai sample size scenario. It is also proved that the SVM model is capable of estimating the effect of multi-category factors on trip chaining behaviors more accurately. The different contribution of explanatory, factors to trip chaining pattern recognition reflects the importance of refining trip chaining patterns ad exploring factors that are specific to each pattern. It is shown that the SVM technology in travel demand forecast modeling and analysis of explanatory variable effects is practical.

Ignition Pattern Analysis for Automotive Engine Trouble Diagnosis Using Wavelet Packet Transform and Support Vector Machines

Engine spark ignition is an important source for diagnosis of engine faults.Based on the waveform of the ignition pattern,a mechanic can guess what may be the potential malfunctioning parts of an engine with his/her experience and handbooks.However,this manual diagnostic method is imprecise because many spark ignition patterns are very similar.Therefore,a diagnosis needs many trials to identify the malfunctioning parts.Meanwhile the mechanic needs to disassemble and assemble the engine parts for verification.To tackle this problem,an intelligent diagnosis system was established based on ignition patterns.First,the captured patterns were normalized and compressed.Then wavelet packet transform（WPT） was employed to extract the representative features of the ignition patterns.Finally,a classification system was constructed by using multi-class support vector machines（SVM） and the extracted features.The classification system can intelligently classify the most likely engine fault so as to reduce the number of diagnosis trials.Experimental results show that SVM produces higher diagnosis accuracy than the traditional multilayer feedforward neural network.This is the first trial on the combination of WPT and SVM to analyze ignition patterns and diagnose automotive engines.

Defocus Blur Segmentation Using Local Binary Patterns with Adaptive Threshold

Enormousmethods have been proposed for the detection and segmentation of blur and non-blur regions of the images.Due to the limited available information about blur type,scenario and the level of blurriness,detection and segmentation is a challenging task.Hence,the performance of the blur measure operator is an essential factor and needs improvement to attain perfection.In this paper,we propose an effective blur measure based on local binary pattern(LBP)with adaptive threshold for blur detection.The sharpness metric developed based on LBP used a fixed threshold irrespective of the type and level of blur,that may not be suitable for images with variations in imaging conditions,blur amount and type.Contrarily,the proposed measure uses an adaptive threshold for each input image based on the image and blur properties to generate improved sharpness metric.The adaptive threshold is computed based on the model learned through support vector machine(SVM).The performance of the proposed method is evaluated using two different datasets and is compared with five state-of-the-art methods.Comparative analysis reveals that the proposed method performs significantly better qualitatively and quantitatively against all of the compared methods.

Quality evaluation of layerlike backfilling and flow pattern of backfill slurry in stope

Stability condition and quality evaluation formula of layerlike backfilling roof,Q≥C,where Q denotes is quality index depending on allowable compressive or tensile strength and integrity of backfilling,and C is the technical index depending on mining method and backfilling technology,were inferred according to simply supported beam theorem.Technical treatment measures for instable backfilling roof,including optimum of appropriate filling materials and dosage for excellent flow property and reduction of backfill cost.It is proved that slope equation of backfill slurry in a stope to be filled is y=hexp[x2/(2σ)2)],where h is height of cone and σ2 is mean square,and that optimum drainage point of backfill slurry can be determined by the equation and sizes of stope.Case study indicates that the results can give a theoretical support for quality evaluation and control of layerlike backfilling.

Fast Training of Support Vector Machines Using Error-Center-Based Optimization

This paper presents a new algorithm for Support Vector Machine (SVM) training, which trains a machine based on the cluster centers of errors caused by the current machine. Experiments with various training sets show that the computation time of this new algorithm scales almost linear with training set size and thus may be applied to much larger training sets, in comparison to standard quadratic programming (QP) techniques.

A Real-Time and Ubiquitous Network Attack Detection Based on Deep Belief Network and Support Vector Machine

In recent years, network traffic data have become larger and more complex, leading to higher possibilities of network intrusion. Traditional intrusion detection methods face difficulty in processing high-speed network data and cannot detect currently unknown attacks. Therefore, this paper proposes a network attack detection method combining a flow calculation and deep learning. The method consists of two parts: a real-time detection algorithm based on flow calculations and frequent patterns and a classification algorithm based on the deep belief network and support vector machine(DBN-SVM). Sliding window(SW) stream data processing enables real-time detection, and the DBN-SVM algorithm can improve classification accuracy. Finally, to verify the proposed method, a system is implemented.Based on the CICIDS2017 open source data set, a series of comparative experiments are conducted. The method's real-time detection efficiency is higher than that of traditional machine learning algorithms. The attack classification accuracy is 0.7 percentage points higher than that of a DBN, which is 2 percentage points higher than that of the integrated algorithm boosting and bagging methods. Hence, it is suitable for the real-time detection of high-speed network intrusions.

Antenna selection for MIMO system based on pattern recognition

This paper proposes a novel Multiple-Input Multiple-Output (MIMO) transmission scheme based on Pattern Recognition (PR), which is termed as the PR aided Transmission Antenna Selection MIMO (PR-TAS aided MIMO). As the conventional TAS algorithms need to search all possible legitimate antenna subsets, they may impose some redundant calculations. In order to avoid this problem, we employ some pattern recognition methods to carry out the TAS algorithm in this paper. To be specific, two PR algorithms, namely the K-Nearest Neighbor (KNN) algorithm and the Support Vector Machine (SVM) algorithm, are introduced and redesigned to obtain a TAS with lower complexity but higher efficiency. Moreover, in order to improve the performance of the SVM, we propose a new feature extraction of channel matrix for the TAS. Our simulation results show that the proposed KNN and SVM based PR-TAS algorithms are capable of striking a flexible tradeoff between the complexity and the Bit Error Rate (BER), and the new feature can effectively improve the BER performance compared with the conventional feature extraction method.

A Geometric Approach to Support Vector Regression and Its Application to Fermentation Process Fast Modeling

Support vector machine(SVM) has shown great potential in pattern recognition and regressive estima-tion.Due to the industrial development demands,such as the fermentation process modeling,improving the training performance on increasingly large sample sets is an important problem.However,solving a large optimization problem is computationally intensive and memory intensive.In this paper,a geometric interpretation of SVM re-gression(SVR) is derived,and μ-SVM is extended for both L1-norm and L2-norm penalty SVR.Further,Gilbert al-gorithm,a well-known geometric algorithm,is modified to solve SVR problems.Theoretical analysis indicates that the presented SVR training geometric algorithms have the same convergence and almost identical cost of computa-tion as their corresponding algorithms for SVM classification.Experimental results show that the geometric meth-ods are more efficient than conventional methods using quadratic programming and require much less memory.

Clinical decision support systems for brain tumor characterization using advanced magnetic resonance imaging techniques

In recent years, advanced magnetic resonance imaging(MRI) techniques, such as magnetic resonance spec-troscopy, diffusion weighted imaging, diffusion tensor imaging and perfusion weighted imaging have been used in order to resolve demanding diagnostic prob-lems such as brain tumor characterization and grading, as these techniques offer a more detailed and non-invasive evaluation of the area under study. In the last decade a great effort has been made to import and utilize intelligent systems in the so-called clinical deci-sion support systems(CDSS) for automatic processing, classification, evaluation and representation of MRI data in order for advanced MRI techniques to become a part of the clinical routine, since the amount of data from the aforementioned techniques has gradually inticle is two-fold. The first is to review and evaluate the progress that has been made towards the utilization of CDSS based on data from advanced MRI techniques. The second is to analyze and propose the future work that has to be done, based on the existing problems and challenges, especially taking into account the new imaging techniques and parameters that can be intro-duced into intelligent systems to significantly improve their diagnostic specificity and clinical application.

Hooke and Jeeves algorithm for linear support vector machine

Coordinate descent method is a unconstrained optimization technique. When it is applied to support vector machine （SVM）, at each step the method updates one component of w by solving a one-variable sub-problem while fixing other components. All components of w update after one iteration. Then go to next iteration. Though the method converges and converges fast in the beginning, it converges slow for final convergence. To improve the speed of final convergence of coordinate descent method, Hooke and Jeeves algorithm which adds pattern search after every iteration in coordinate descent method was applied to SVM and a global Newton algorithm was used to solve one-variable subproblems. We proved the convergence of the algorithm. Experimental results show Hooke and Jeeves＇ method does accelerate convergence specially for final convergence and achieves higher testing accuracy more quickly in classification.

Optimized Complex Power Quality Classifier Using One vs. Rest Support Vector Machines

Nowadays, power quality issues are becoming a significant research topic because of the increasing inclusion of very sensitive devices and considerable renewable energy sources. In general, most of the previous power quality classification techniques focused on single power quality events and did not include an optimal feature selection process. This paper presents a classification system that employs Wavelet Transform and the RMS profile to extract the main features of the measured waveforms containing either single or complex disturbances. A data mining process is designed to select the optimal set of features that better describes each disturbance present in the waveform. Support Vector Machine binary classifiers organized in a “One Vs Rest” architecture are individually optimized to classify single and complex disturbances. The parameters that rule the performance of each binary classifier are also individually adjusted using a grid search algorithm that helps them achieve optimal performance. This specialized process significantly improves the total classification accuracy. Several single and complex disturbances were simulated in order to train and test the algorithm. The results show that the classifier is capable of identifying >99% of single disturbances and >97% of complex disturbances.

Classification Methods Based on Pattern Discrimination Models for Web-Based Diagnosis of Rice Diseases

Two classification and identification methods based on pattern discrimination models and the majority-vote technique were investigated for implementing a World Wide Web-based system for the identification of rice diseases. The experiment was carried out using color and shape patterns in 425 images of three rice diseases, which were classified into four classes： two classes of leaf blast, and one class each of sheath blight and brown spot. A method consisting of two discrimination steps involving application of multiple discrimination models of a support vector machine gave the best result because of its capacity to evaluate the similarity of disease types. This accuracy of the method was 88% for leaf blast （A-type）, 94% for sheath blight, and 80% for leaf blast （B-type） and brown spot; on average, the accuracy of this method was 5% greater than that of the other method when three classes were used in the model. Although the accuracy of both methods was inadequate, the results of this study show that it is possible to estimate the least number of possible or similar diseases from a large number of diseases. Therefore, we conclude that there is merit in grouping classes into subgroups rather than attempting to discriminate between all classes simultaneously and that these methods are effective in identifying diseases for web-based diagnosis.

SVD-LSSVM and its application in chemical pattern classification

Pattern classification is an important field in machine learning; least squares support vector machine (LSSVM) is a powerful tool for pattern classification. A new version of LSSVM, SVD-LSSVM, to save time of selecting hyper parameters for LSSVM is proposed. SVD-LSSVM is trained through singular value decomposition (SVD) of kernel matrix. Cross validation time of selecting hyper parameters can be saved because a new hyper parameter, singular value contribution rate (SVCR), replaces the penalty factor of LSSVM. Several UCI benchmarking data and the Olive classification problem were used to test SVD-LSSVM. The result showed that SVD-LSSVM has good performance in classification and saves time for cross validation.

Least Squares Support Vector Machine Based Real-Time Fault Diagnosis Model for Gas Path Parameters of Aero Engines

Least squares support vector machine （LS-SVM） is applied in gas path fault diagnosis for aero engines. Firstly, the deviation data of engine cruise are analyzed. Then, model selection is conducted using pattern search method. Finally, by decoding aircraft communication addressing and reporting system （ACARS） report, a real-time cruise data set is acquired, and the diagnosis model is adopted to process data. In contrast to the radial basis function （RBF） neutral network, LS-SVM is more suitable for real-time diagnosis of gas turbine engine.

Intelligent decision support system of operation-optimization in copper smelting converter

An artificial intelligence technique was applied to the optimization of flux adding systems and air blasting systems, the display of on line parameters, forecasting of mass and compositions of slag in the slagging period, optimization of cold material adding systems and air blasting systems, the display of on line parameters, and the forecasting of copper mass in the copper blow period in copper smelting converters. They were integrated to build the Intelligent Decision Support System of the Operation Optimization of Copper Smelting Converter(IDSSOOCSC), which is self learning and self adaptating. Development steps, monoblock structure and basic functions of the IDSSOOCSC were introduced. After it was applied in a copper smelting converter, every production quota was clearly improved after IDSSOOCSC had been run for 4 months. Blister copper productivity is increased by 6%, processing load of cold input is increased by 8% and average converter life span is improved from 213 to 235 furnace times.

Forecasting regional economic growth using support vector machine model

Support vector machine(SVM)is a new technology in data mining.It is a new tool to solve machine learning problems with the help of optimization.Support vector machines belong to a new machine learning that extends from statistical learning theory.Its structure is relatively simple,with good generalization ability and global optimality.Support vector machine has provided a unified framework for solving finite sample learning problems,and there are many solutions proposed.It can deal with those more complex problems and introduce the characteristics of the support vector machine model.Aiming at the application of the model in economic forecasting,a method to improve the prediction accuracy of the model is proposed.The theoretical analysis and practical application verification are performed,which shows that this method can obtain more accurate prediction results.

Progressive transductive learning pattern classification via single sphere

In many machine learning problems, a large amount of data is available but only a few of them can be labeled easily. This provides a research branch to effectively combine unlabeled and labeled data to infer the labels of unlabeled ones, that is, to develop transductive learning. In this article, based on Pattern classification via single sphere （SSPC）, which seeks a hypersphere to separate data with the maximum separation ratio, a progressive transductive pattern classification method via single sphere （PTSSPC） is proposed to construct the classifier using both the labeled and unlabeled data. PTSSPC utilize the additional information of the unlabeled samples and obtain better classification performance than SSPC when insufficient labeled data information is available. Experiment results show the algorithm can yields better performance.