Review of Remotely Sensed Imagery Classification Patterns Based on Object-oriented Image Analysis

With the wide use of high-resolution remotely sensed imagery, the object-oriented remotely sensed informa- tion classification pattern has been intensively studied. Starting with the definition of object-oriented remotely sensed information classification pattern and a literature review of related research progress, this paper sums up 4 developing phases of object-oriented classification pattern during the past 20 years. Then, we discuss the three aspects of method- ology in detail, namely remotely sensed imagery segmentation, feature analysis and feature selection, and classification rule generation, through comparing them with remotely sensed information classification method based on per-pixel. At last, this paper presents several points that need to be paid attention to in the future studies on object-oriented RS in- formation classification pattern: 1) developing robust and highly effective image segmentation algorithm for multi-spectral RS imagery; 2) improving the feature-set including edge, spatial-adjacent and temporal characteristics; 3) discussing the classification rule generation classifier based on the decision tree; 4) presenting evaluation methods for classification result by object-oriented classification pattern.

Boosted Stacking Ensemble Machine Learning Method for Wafer Map Pattern Classification

Recently,machine learning-based technologies have been developed to automate the classification of wafer map defect patterns during semiconductormanufacturing.The existing approaches used in the wafer map pattern classification include directly learning the image through a convolution neural network and applying the ensemble method after extracting image features.This study aims to classify wafer map defects more effectively and derive robust algorithms even for datasets with insufficient defect patterns.First,the number of defects during the actual process may be limited.Therefore,insufficient data are generated using convolutional auto-encoder(CAE),and the expanded data are verified using the evaluation technique of structural similarity index measure(SSIM).After extracting handcrafted features,a boosted stacking ensemble model that integrates the four base-level classifiers with the extreme gradient boosting classifier as a meta-level classifier is designed and built for training the model based on the expanded data for final prediction.Since the proposed algorithm shows better performance than those of existing ensemble classifiers even for insufficient defect patterns,the results of this study will contribute to improving the product quality and yield of the actual semiconductor manufacturing process.

Encoding candlesticks as images for pattern classification using convolutional neural networks

Candlestick charts display the high,low,opening,and closing prices in a specific period.Candlestick patterns emerge because human actions and reactions are patterned and continuously replicate.These patterns capture information on the candles.According to Thomas Bulkowski’s Encyclopedia of Candlestick Charts,there are 103 candlestick patterns.Traders use these patterns to determine when to enter and exit.Candlestick pattern classification approaches take the hard work out of visually identifying these patterns.To highlight its capabilities,we propose a two-steps approach to recognize candlestick patterns automatically.The first step uses the Gramian Angular Field(GAF)to encode the time series as different types of images.The second step uses the Convolutional Neural Network(CNN)with the GAF images to learn eight critical kinds of candlestick patterns.In this paper,we call the approach GAF-CNN.In the experiments,our approach can identify the eight types of candlestick patterns with 90.7%average accuracy automatically in real-world data,outperforming the LSTM model.

Classification of Short Time Series in Early Parkinson’s Disease With Deep Learning of Fuzzy Recurrence Plots

There are many techniques using sensors and wearable devices for detecting and monitoring patients with Parkinson’s disease(PD).A recent development is the utilization of human interaction with computer keyboards for analyzing and identifying motor signs in the early stages of the disease.Current designs for classification of time series of computer-key hold durations recorded from healthy control and PD subjects require the time series of length to be considerably long.With an attempt to avoid discomfort to participants in performing long physical tasks for data recording,this paper introduces the use of fuzzy recurrence plots of very short time series as input data for the machine training and classification with long short-term memory(LSTM)neural networks.Being an original approach that is able to both significantly increase the feature dimensions and provides the property of deterministic dynamical systems of very short time series for information processing carried out by an LSTM layer architecture,fuzzy recurrence plots provide promising results and outperform the direct input of the time series for the classification of healthy control and early PD subjects.

SVD-LSSVM and its application in chemical pattern classification

Pattern classification is an important field in machine learning; least squares support vector machine (LSSVM) is a powerful tool for pattern classification. A new version of LSSVM, SVD-LSSVM, to save time of selecting hyper parameters for LSSVM is proposed. SVD-LSSVM is trained through singular value decomposition (SVD) of kernel matrix. Cross validation time of selecting hyper parameters can be saved because a new hyper parameter, singular value contribution rate (SVCR), replaces the penalty factor of LSSVM. Several UCI benchmarking data and the Olive classification problem were used to test SVD-LSSVM. The result showed that SVD-LSSVM has good performance in classification and saves time for cross validation.

Evolving Neural Network Using Variable String Genetic Algorithm for Color Infrared Aerial Image Classification

Coastal wetlands are characterized by complex patterns both in their geomorphlc and ecological teatures. Besides field observations, it is necessary to analyze the land cover of wetlands through the color infrared （CIR） aerial photography or remote sensing image. In this paper, we designed an evolving neural network classifier using variable string genetic algorithm （VGA） for the land cover classification of CIR aerial image. With the VGA, the classifier that we designed is able to evolve automatically the appropriate number of hidden nodes for modeling the neural network topology optimally and to find a near-optimal set of connection weights globally. Then, with backpropagation algorithm （BP）, it can find the best connection weights. The VGA-BP classifier, which is derived from hybrid algorithms mentioned above, is demonstrated on CIR images classification effectively. Compared with standard classifiers, such as Bayes maximum-likelihood classifier, VGA classifier and BP-MLP （multi-layer perception） classifier, it has shown that the VGA-BP classifier can have better performance on highly resolution land cover classification.

Comparison of wrist motion classification methods using surface electromyogram

The Gaussian mixture model (GMM), k-nearest neighbor (k-NN), quadratic discriminant analysis (QDA), and linear discriminant analysis (LDA) were compared to classify wrist motions using surface electromyogram (EMG). Effect of feature selection in EMG signal processing was also verified by comparing classification accuracy of each feature, and the enhancement of classification accuracy by normalization was confirmed. EMG signals were acquired from two electrodes placed on the forearm of twenty eight healthy subjects and used for recognition of wrist motion. Features were extracted from the obtained EMG signals in the time domain and were applied to classification methods. The difference absolute mean value (DAMV), difference absolute standard deviation value (DASDV), mean absolute value (MAV), root mean square (RMS) were used for composing 16 double features which were combined of two channels. In the classification methods, the highest accuracy of classification showed in the GMM. The most effective combination of classification method and double feature was (MAV, DAMV) of GMM and its classification accuracy was 96.85%. The results of normalization were better than those of non-normalization in GMM, k-NN, and LDA.

Multi-channel electromyography pattern classification using deep belief networks for enhanced user experience

An enhanced algorithm is proposed to recognize multi-channel electromyography(EMG) patterns using deep belief networks(DBNs). It is difficult to classify the EMG features because an EMG signal has nonlinear and time-varying characteristics.Therefore, in several previous studies, various machine-learning methods have been applied. A DBN is a fast, greedy learning algorithm that can find a fairly good set of weights rapidly, even in deep networks with a large number of parameters and many hidden layers. To evaluate this model, we acquired EMG signals, extracted their features, and then compared the model with the DBN and other conventional classifiers. The accuracy of the DBN is higher than that of the other algorithms. The classification performance of the DBN model designed is approximately 88.60%. It is 7.55%(p=9.82×10-12) higher than linear discriminant analysis(LDA) and 2.89%(p=1.94×10-5) higher than support vector machine(SVM). Further, the DBN is better than shallow learning algorithms or back propagation(BP), and this model is effective for an EMG-based user-interfaced system.

Diagnostic performance of endoscopic classifications for neoplastic lesions in patients with ulcerative colitis:A retrospective casecontrol study

BACKGROUND It is unclear whether the Japan Narrow-Band Imaging Expert Team(JNET)classification and pit pattern classification are applicable for diagnosing neoplastic lesions in patients with ulcerative colitis(UC).AIM To clarify the diagnostic performance of these classifications for neoplastic lesions in patients with UC.METHODS This study was conducted as a single-center,retrospective case-control study.Twenty-one lesions in 19 patients with UC-associated neoplasms(UCAN)and 23 lesions in 22 UC patients with sporadic neoplasms(SN),evaluated by magnifying image-enhanced endoscopy,were retrospectively and separately assessed by six endoscopists(three experts,three non-experts),using the JNET and pit pattern classifications.The results were compared with the pathological diagnoses to evaluate the diagnostic performance.Inter-and intra-observer agreements were calculated.RESULTS In this study,JNET type 2 A and pit pattern typeⅢ/Ⅳwere used as indicators of low-grade dysplasia,JNET type 2 B and pit pattern typeⅥlow irregularity were used as indicators of highgrade dysplasia to shallow submucosal invasive carcinoma,JNET type 3 and pit pattern typeⅥhigh irregularity/VN were used as indicators of deep submucosal invasive carcinoma.In the UCAN group,JNET type 2 A and pit pattern typeⅢ/Ⅳhad a low positive predictive value(PPV;50.0%and 40.0%,respectively);however,they had a high negative predictive value(NPV;94.7%and 100%,respectively).Conversely,in the SN group,JNET type 2 A and pit pattern typeⅢ/Ⅳhad a high PPV(100%for both)but a low NPV(63.6%and 77.8%,respectively).In both groups,JNET type 3 and pit pattern typeⅥ-high irregularity/VN showed high specificity.The interobserver agreement of JNET classification and pit pattern classification for UCAN among experts were 0.401 and 0.364,in the same manner for SN,0.666 and 0.597,respectively.The intra-observer agreements of JNET classification and pit pattern classification for UCAN among experts were 0.387,0.454,for SN,0.803 and 0.567,respectively.CONCLUSION The accuracy of endoscopic diagnosis using both classifications was lower for UCAN than for SN.Endoscopic diagnosis of UCAN tended to be underestimated compared with the pathological results.

Improved Algorithm of Pattern Classification and Recognition Applied in a Coal Dust Sensor

To resolve the conflicting requirements of measurement precision and real-time performance speed,an im-proved algorithm for pattern classification and recognition was developed. The angular distribution of diffracted light varies with particle size. These patterns could be classified into groups with an innovative classification based upon ref-erence dust samples. After such classification patterns could be recognized easily and rapidly by minimizing the vari-ance between the reference pattern and dust sample eigenvectors. Simulation showed that the maximum recognition speed improves 20 fold. This enables the use of a single-chip,real-time inversion algorithm. An increased number of reference patterns reduced the errors in total and respiring coal dust measurements. Experiments in coal mine testify that the accuracy of sensor achieves 95%. Results indicate the improved algorithm enhances the precision and real-time ca-pability of the coal dust sensor effectively.

Design and Implementation of Novel Precision Internet Marketing Patterns under the Big Data and Cloud Environment

Nowadays most of the cloud applications process large amount of data to provide the desired results. The Internet environment, the enterprise network advertising, network marketing plan, need partner sites selected as carrier and publishers. Website through static pages, dynamic pages, floating window, AD links, take the initiative to push a variety of ways to show the user enterprise marketing solutions, when the user access to web pages, use eye effect and concentration effect, attract users through reading web pages or click the page again, let the user detailed comprehensive understanding of the marketing plan, which affects the user＇ s real purchase decisions. Therefore, we combine the cloud environment with search engine optimization technique, the result shows that our method outperforms compared with other approaches.

Novel magnetic field computation model in pattern classification

Field computation, an emerging computation technique, has inspired passion of intelligence science research. A novel field computation model based on the magnetic field theory is constructed. The proposed magnetic field computation （MFC） model consists of a field simulator, a non-derivative optimization algo- rithm and an auxiliary data processing unit. The mathematical model is deduced and proved that the MFC model is equivalent to a quadratic discriminant function. Furthermore, the finite element prototype is derived, and the simulator is developed, combining with particle swarm optimizer for the field configuration. Two benchmark classification experiments are studied in the numerical experiment, and one notable advantage is demonstrated that less training samples are required and a better generalization can be achieved.

Self‐training maximum classifier discrepancy for EEG emotion recognition

Even with an unprecedented breakthrough of deep learning in electroencephalography(EEG),collecting adequate labelled samples is a critical problem due to laborious and time‐consuming labelling.Recent study proposed to solve the limited label problem via domain adaptation methods.However,they mainly focus on reducing domain discrepancy without considering task‐specific decision boundaries,which may lead to feature distribution overmatching and therefore make it hard to match within a large domain gap completely.A novel self‐training maximum classifier discrepancy method for EEG classification is proposed in this study.The proposed approach detects samples from a new subject beyond the support of the existing source subjects by maximising the discrepancies between two classifiers'outputs.Besides,a self‐training method that uses unlabelled test data to fully use knowledge from the new subject and further reduce the domain gap is proposed.Finally,a 3D Cube that incorporates the spatial and frequency information of the EEG data to create input features of a Convolutional Neural Network(CNN)is constructed.Extensive experiments on SEED and SEED‐IV are conducted.The experimental evaluations exhibit that the proposed method can effectively deal with domain transfer problems and achieve better performance.

A structural developmental neural network with information saturation for continual unsupervised learning

In this paper,we propose a structural developmental neural network to address the plasticity‐stability dilemma,computational inefficiency,and lack of prior knowledge in continual unsupervised learning.This model uses competitive learning rules and dynamic neurons with information saturation to achieve parameter adjustment and adaptive structure development.Dynamic neurons adjust the information saturation after winning the competition and use this parameter to modulate the neuron parameter adjustment and the division timing.By dividing to generate new neurons,the network not only keeps sensitive to novel features but also can subdivide classes learnt repeatedly.The dynamic neurons with information saturation and division mechanism can simulate the long short‐term memory of the human brain,which enables the network to continually learn new samples while maintaining the previous learning results.The parent‐child relationship between neurons arising from neuronal division enables the network to simulate the human cognitive process that gradually refines the perception of objects.By setting the clustering layer parameter,users can choose the desired degree of class subdivision.Experimental results on artificial and real‐world datasets demonstrate that the proposed model is feasible for unsupervised learning tasks in instance increment and class incre-ment scenarios and outperforms prior structural developmental neural networks.

Automated Burned Scar Mapping Using Sentinel-2 Imagery

The Sentinel-2 satellites are providing an unparalleled wealth of high-resolution remotely sensed information with a short revisit cycle, which is ideal for mapping burned areas both accurately and timely. However, the high detail and volume of information provided actually encumbers the automation of the mapping process, at least for the level of automation required to map systematically wildfires on a national level. This paper proposes a fully automated methodology for mapping burn scars using Sentinel-2 data. Information extracted from a pair of Sentinel-2 images, one pre-fire and one post-fire, is jointly used to automatically label a set of training patterns via two empirical rules. An initial pixel-based classification is derived using this training set by means of a Support Vector Machine (SVM) classifier. The latter is subsequently smoothed following a multiple spectral-spatial classification (MSSC) approach, which increases the mapping accuracy and thematic consistency of the final burned area delineation. The proposed methodology was tested on six recent wildfire events in Greece, selected to cover representative cases of the Greek ecosystems and to present challenges in burned area mapping. The lowest classification accuracy achieved was 92%, whereas Matthews correlation coefficient (MCC) was greater or equal to 0.85.

Deep Learning Based Attack Detection for Cyber-Physical System Cybersecurity:A Survey

With the booming of cyber attacks and cyber criminals against cyber-physical systems(CPSs),detecting these attacks remains challenging.It might be the worst of times,but it might be the best of times because of opportunities brought by machine learning(ML),in particular deep learning(DL).In general,DL delivers superior performance to ML because of its layered setting and its effective algorithm for extract useful information from training data.DL models are adopted quickly to cyber attacks against CPS systems.In this survey,a holistic view of recently proposed DL solutions is provided to cyber attack detection in the CPS context.A six-step DL driven methodology is provided to summarize and analyze the surveyed literature for applying DL methods to detect cyber attacks against CPS systems.The methodology includes CPS scenario analysis,cyber attack identification,ML problem formulation,DL model customization,data acquisition for training,and performance evaluation.The reviewed works indicate great potential to detect cyber attacks against CPS through DL modules.Moreover,excellent performance is achieved partly because of several highquality datasets that are readily available for public use.Furthermore,challenges,opportunities,and research trends are pointed out for future research.

Ignition Pattern Analysis for Automotive Engine Trouble Diagnosis Using Wavelet Packet Transform and Support Vector Machines

Engine spark ignition is an important source for diagnosis of engine faults.Based on the waveform of the ignition pattern,a mechanic can guess what may be the potential malfunctioning parts of an engine with his/her experience and handbooks.However,this manual diagnostic method is imprecise because many spark ignition patterns are very similar.Therefore,a diagnosis needs many trials to identify the malfunctioning parts.Meanwhile the mechanic needs to disassemble and assemble the engine parts for verification.To tackle this problem,an intelligent diagnosis system was established based on ignition patterns.First,the captured patterns were normalized and compressed.Then wavelet packet transform（WPT） was employed to extract the representative features of the ignition patterns.Finally,a classification system was constructed by using multi-class support vector machines（SVM） and the extracted features.The classification system can intelligently classify the most likely engine fault so as to reduce the number of diagnosis trials.Experimental results show that SVM produces higher diagnosis accuracy than the traditional multilayer feedforward neural network.This is the first trial on the combination of WPT and SVM to analyze ignition patterns and diagnose automotive engines.

Fast Training of Support Vector Machines Using Error-Center-Based Optimization

This paper presents a new algorithm for Support Vector Machine (SVM) training, which trains a machine based on the cluster centers of errors caused by the current machine. Experiments with various training sets show that the computation time of this new algorithm scales almost linear with training set size and thus may be applied to much larger training sets, in comparison to standard quadratic programming (QP) techniques.

Study of a Bionic Pattern Classifier Based on Olfactory Neural System

Simulating biological olfactory neural system, KⅢnetwork, which is a high-dimensional chaotic neural network, is designed in this paper. Different from conventional artificial neural network, the KⅢnetwork works in its chaotic trajectory. It can simulate not only the output EEG waveform observed in electrophysiological experiments, but also the biological intelligence for pattern classification. The simulation analysis and application to the recognition of handwriting numerals are presented here. The classification performance of the KⅢnetwork at different noise levels was also investigated.

The pattern characteristics of the tendency variations of earth resistivity and its relation to earthquakes

Through systematically summarizing the observational data of earth resistivity during 26 years from nearly a hundred stations in China, the author found that the pattern of the earth resistivity (ρs) tendency variations,based on monthly average data, could be divided into five types, three types of which were defined as anomalous variation, which have different qualitative and quantitative characteristics and different relations with earthquakes as well.The first type of tendency variation called “funnel” is related to strong earthquakes, the Second type called “scoop” has good corresponding relation with moderate earthquakes, and the third type called “tilt” has no relation with earthquakes. Preliminary discussions about the relations between the three types of ρs tendency variation patterns and earthquakes are made in this paper, according to the experimental results of pressed rocks. It is concluded that the different patterns of ρs tendency variation actually reflect the different stress conditions of underground soil-rock layers: the “funnel” type reflects high stress status, the “scoop” type shows moderate stress condition and the “tilt” type is related to stress relief. All of such knowledges mentioned above are very useful in making accurate medium-term earthquake prediction.