Direct linear discriminant analysis based on column pivoting QR decomposition and economic SVD

A direct linear discriminant analysis algorithm based on economic singular value decomposition （DLDA/ESVD） is proposed to address the computationally complex problem of the conventional DLDA algorithm, which directly uses ESVD to reduce dimension and extract eigenvectors corresponding to nonzero eigenvalues. Then a DLDA algorithm based on column pivoting orthogonal triangular （QR） decomposition and ESVD （DLDA/QR-ESVD） is proposed to improve the performance of the DLDA/ESVD algorithm by processing a high-dimensional low rank matrix, which uses column pivoting QR decomposition to reduce dimension and ESVD to extract eigenvectors corresponding to nonzero eigenvalues. The experimental results on ORL, FERET and YALE face databases show that the proposed two algorithms can achieve almost the same performance and outperform the conventional DLDA algorithm in terms of computational complexity and training time. In addition, the experimental results on random data matrices show that the DLDA/QR-ESVD algorithm achieves better performance than the DLDA/ESVD algorithm by processing high-dimensional low rank matrices.

Balanced multiple weighted linear discriminant analysis and its application to visual process monitoring

Visual process monitoring is important in complex chemical processes.To address the high state separation of industrial data,we propose a new criterion for feature extraction called balanced multiple weighted linear discriminant analysis(BMWLDA).Then,we combine BMWLDA with self-organizing map(SOM)for visual monitoring of industrial operation processes.BMWLDA can extract the discriminative feature vectors from the original industrial data and maximally separate industrial operation states in the space spanned by these discriminative feature vectors.When the discriminative feature vectors are used as the input to SOM,the training result of SOM can differentiate industrial operation states clearly.This function improves the performance of visual monitoring.Continuous stirred tank reactor is used to verify that the class separation performance of BMWLDA is more effective than that of traditional linear discriminant analysis,approximate pairwise accuracy criterion,max–min distance analysis,maximum margin criterion,and local Fisher discriminant analysis.In addition,the method that combines BMWLDA with SOM can effectively perform visual process monitoring in real time.

Kernel Model Applied in Kernel Direct Discriminant Analysis for the Recognition of Face with Nonlinear Variations

A kernel-based discriminant analysis method called kernel direct discriminant analysis is employed, which combines the merit of direct linear discriminant analysis with that of kernel trick. In order to demonstrate its better robustness to the complex and nonlinear variations of real face images, such as illumination, facial expression, scale and pose variations, experiments are carried out on the Olivetti Research Laboratory, Yale and self-built face databases. The results indicate that in contrast to kernel principal component analysis and kernel linear discriminant analysis, the method can achieve lower （7%） error rate using only a very small set of features. Furthermore, a new corrected kernel model is proposed to improve the recognition performance. Experimental results confirm its superiority （1% in terms of recognition rate） to other polynomial kernel models.

Emotion recognition of Uyghur speech using uncertain linear discriminant analysis

To achieve efficient a d compact low-dimensional features for speech emotion recognition,a novel featurereduction method using uncertain linear discriminant analysis is proposed.Using the same principles as for conventional linear discriminant analysis(LDA),uncertainties of the noisy or distorted input data ae employed in order to estimate maximaiy discriminant directions.The effectiveness of the proposed uncertain LDA(ULDA)is demonstrated in the Uyghur speech emotion recognition task.The emotional features of Uyghur speech,especially,the fundamental fequency and formant,a e analyzed in the collected emotional data.Then,ULDA is employed in dimensionality reduction of emotional features and better performance is achieved compared with other dimensionality reduction techniques.The speech emotion recognition of Uyghur is implemented by feeding the low-dimensional data to support vector machine(SVM)based on the proposed ULDA.The experimental results show that when employing a appropriate uncertainty estimation algorithm,uncertain LDA outperforms the conveetional LDA counterpart on Uyghur speech emotion recognition.

Linear Discriminant Analysis and Kernel Vector Quantization for Mandarin Digits Recognition

Linear discriminant analysis and kernel vector quantization are integrated into vector quantization based speech recognition system for improving the recognition accuracy of Mandarin digits. These techniques increase the class separability and optimize the clustering procedure. Speaker-dependent (SD) and speaker-independent (SI) experiments are performed to evaluate the performance of the proposed method. The experiment results show that the proposed method is capable of reaching the word error rate of 3.76% in SD case and 6.60 % in SI case. Such a system can be suitable for being embedded in personal digital assistant(PDA), mobile phone and so on to perform voice controlling such as digit dialing, calculating, etc.

Unsupervised Linear Discriminant Analysis

An algorithm for unsupervised linear discriminant analysis was presented. Optimal unsupervised discriminant vectors are obtained through maximizing covariance of all samples and minimizing covariance of local k-nearest neighbor samples. The experimental results show our algorithm is effective.

Incremental Linear Discriminant Analysis Dimensionality Reduction and 3D Dynamic Hierarchical Clustering WSNs

Optimizing the sensor energy is one of the most important concern in Three-Dimensional(3D)Wireless Sensor Networks(WSNs).An improved dynamic hierarchical clustering has been used in previous works that computes optimum clusters count and thus,the total consumption of energy is optimal.However,the computational complexity will be increased due to data dimension,and this leads to increase in delay in network data transmission and reception.For solving the above-mentioned issues,an efficient dimensionality reduction model based on Incremental Linear Discriminant Analysis(ILDA)is proposed for 3D hierarchical clustering WSNs.The major objective of the proposed work is to design an efficient dimensionality reduction and energy efficient clustering algorithm in 3D hierarchical clustering WSNs.This ILDA approach consists of four major steps such as data dimension reduction,distance similarity index introduction,double cluster head technique and node dormancy approach.This protocol differs from normal hierarchical routing protocols in formulating the Cluster Head(CH)selection technique.According to node’s position and residual energy,optimal cluster-head function is generated,and every CH is elected by this formulation.For a 3D spherical structure,under the same network condition,the performance of the proposed ILDA with Improved Dynamic Hierarchical Clustering(IDHC)is compared with Distributed Energy-Efficient Clustering(DEEC),Hybrid Energy Efficient Distributed(HEED)and Stable Election Protocol(SEP)techniques.It is observed that the proposed ILDA based IDHC approach provides better results with respect to Throughput,network residual energy,network lifetime and first node death round.

A Highly Accurate Dysphonia Detection System Using Linear Discriminant Analysis

The recognition of pathological voice is considered a difficult task for speech analysis.Moreover,otolaryngologists needed to rely on oral communication with patients to discover traces of voice pathologies like dysphonia that are caused by voice alteration of vocal folds and their accuracy is between 60%–70%.To enhance detection accuracy and reduce processing speed of dysphonia detection,a novel approach is proposed in this paper.We have leveraged Linear Discriminant Analysis(LDA)to train multiple Machine Learning(ML)models for dysphonia detection.Several ML models are utilized like Support Vector Machine(SVM),Logistic Regression,and K-nearest neighbor(K-NN)to predict the voice pathologies based on features like Mel-Frequency Cepstral Coefficients(MFCC),Fundamental Frequency(F0),Shimmer(%),Jitter(%),and Harmonic to Noise Ratio(HNR).The experiments were performed using Saarbrucken Voice Data-base(SVD)and a privately collected dataset.The K-fold cross-validation approach was incorporated to increase the robustness and stability of the ML models.According to the experimental results,our proposed approach has a 70%increase in processing speed over Principal Component Analysis(PCA)and performs remarkably well with a recognition accuracy of 95.24%on the SVD dataset surpassing the previous best accuracy of 82.37%.In the case of the private dataset,our proposed method achieved an accuracy rate of 93.37%.It can be an effective non-invasive method to detect dysphonia.

A Comparison of Two Linear Discriminant Analysis Methods That Use Block Monotone Missing Training Data

We revisit a comparison of two discriminant analysis procedures, namely the linear combination classifier of Chung and Han (2000) and the maximum likelihood estimation substitution classifier for the problem of classifying unlabeled multivariate normal observations with equal covariance matrices into one of two classes. Both classes have matching block monotone missing training data. Here, we demonstrate that for intra-class covariance structures with at least small correlation among the variables with missing data and the variables without block missing data, the maximum likelihood estimation substitution classifier outperforms the Chung and Han (2000) classifier regardless of the percent of missing observations. Specifically, we examine the differences in the estimated expected error rates for these classifiers using a Monte Carlo simulation, and we compare the two classifiers using two real data sets with monotone missing data via parametric bootstrap simulations. Our results contradict the conclusions of Chung and Han (2000) that their linear combination classifier is superior to the MLE classifier for block monotone missing multivariate normal data.

Modified algorithm of principal component analysis for face recognition

In principal component analysis （PCA） algorithms for face recognition, to reduce the influence of the eigenvectors which relate to the changes of the illumination on abstract features, a modified PCA （MPCA） algorithm is proposed. The method is based on the idea of reducing the influence of the eigenvectors associated with the large eigenvalues by normalizing the feature vector element by its corresponding standard deviation. The Yale face database and Yale face database B are used to verify the method. The simulation results show that, for front face and even under the condition of limited variation in the facial poses, the proposed method results in better performance than the conventional PCA and linear discriminant analysis （LDA） approaches, and the computational cost remains the same as that of the PCA, and much less than that of the LDA.

Facial expression recognition based on fuzzy-LDA/CCA

A novel fuzzy linear discriminant analysis method by the canonical correlation analysis （fuzzy-LDA/CCA）is presented and applied to the facial expression recognition. The fuzzy method is used to evaluate the degree of the class membership to which each training sample belongs. CCA is then used to establish the relationship between each facial image and the corresponding class membership vector, and the class membership vector of a test image is estimated using this relationship. Moreover, the fuzzy-LDA/CCA method is also generalized to deal with nonlinear discriminant analysis problems via kernel method. The performance of the proposed method is demonstrated using real data.

DIMENSIONALITY REDUCTION BASED ON SVM AND LDA,AND ITS APPLICATION TO CLASSIFICATION TECHNIQUE

Some dimensionality reduction （DR） approaches based on support vector machine （SVM） are proposed. But the acquirement of the projection matrix in these approaches only considers the between-class margin based on SVM while ignoring the within-class information in data. This paper presents a new DR approach, call- ed the dimensionality reduction based on SVM and LDA （DRSL）. DRSL considers the between-class margins from SVM and LDA, and the within-class compactness from LDA to obtain the projection matrix. As a result, DRSL can realize the combination of the between-class and within-class information and fit the between-class and within-class structures in data. Hence, the obtained projection matrix increases the generalization ability of subsequent classification techniques. Experiments applied to classification techniques show the effectiveness of the proposed method.

Learning compact binary code based on multiple heterogeneous features

A novel hashing method based on multiple heterogeneous features is proposed to improve the accuracy of the image retrieval system. First, it leverages the imbalanced distribution of the similar and dissimilar samples in the feature space to boost the performance of each weak classifier in the asymmetric boosting framework. Then, the weak classifier based on a novel linear discriminate analysis （LDA） algorithm which is learned from the subspace of heterogeneous features is integrated into the framework. Finally, the proposed method deals with each bit of the code sequentially, which utilizes the samples misclassified in each round in order to learn compact and balanced code. The heterogeneous information from different modalities can be effectively complementary to each other, which leads to much higher performance. The experimental results based on the two public benchmarks demonstrate that this method is superior to many of the state- of-the-art methods. In conclusion, the performance of the retrieval system can be improved with the help of multiple heterogeneous features and the compact hash codes which can be learned by the imbalanced learning method.

Acupuncture enhances brain function in patients with mild cognitive impairment: evidence from a functional-near infrared spectroscopy study

Mild cognitive impairment(MCI)is a precursor to Alzheimer’s disease.It is imperative to develop a proper treatment for this neurological disease in the aging society.This observational study investigated the effects of acupuncture therapy on MCI patients.Eleven healthy individuals and eleven MCI patients were recruited for this study.Oxy-and deoxy-hemoglobin signals in the prefrontal cortex during working-memory tasks were monitored using functional near-infrared spectroscopy.Before acupuncture treatment,working-memory experiments were conducted for healthy control(HC)and MCI groups(MCI-0),followed by 24 sessions of acupuncture for the MCI group.The acupuncture sessions were initially carried out for 6 weeks(two sessions per week),after which experiments were performed again on the MCI group(MCI-1).This was followed by another set of acupuncture sessions that also lasted for 6 weeks,after which the experiments were repeated on the MCI group(MCI-2).Statistical analyses of the signals and classifications based on activation maps as well as temporal features were performed.The highest classification accuracies obtained using binary connectivity maps were 85.7%HC vs.MCI-0,69.5%HC vs.MCI-1,and 61.69%HC vs.MCI-2.The classification accuracies using the temporal features mean from 5 seconds to 28 seconds and maximum(i.e,max(5:28 seconds))values were 60.6%HC vs.MCI-0,56.9%HC vs.MCI-1,and 56.4%HC vs.MCI-2.The results reveal that there was a change in the temporal characteristics of the hemodynamic response of MCI patients due to acupuncture.This was reflected by a reduction in the classification accuracy after the therapy,indicating that the patients’brain responses improved and became comparable to those of healthy subjects.A similar trend was reflected in the classification using the image feature.These results indicate that acupuncture can be used for the treatment of MCI patients.

Soft measurement of wood defects based on LDA feature fusion and compressed sensor images

We proposed a detection method for wood defects based on linear discriminant analysis (LDA) and the use of compressed sensor images. Wood surface images were captured, using a camera Oscar F810C IRF camera, and then the image segmentation was performed, and the defect features were extracted from wood board images. To reduce the processing time, LDA algorithm was used to integrate these features and reduce their dimensions. Features after fusion were used to construct a data dictionary and a compressed sensor was designed to recognize the wood defects types. Of the three major defect types, 50 images live knots, dead knots, and cracks were used to test the effects of this method. The average time for feature fusion and classification was 0.446 ms with the classification accuracy of 94%.

Gait Recognition by Cross Wavelet Transform and Graph Model

In this paper, a multi-view gait based human recognition system using the fusion of two kinds of features is proposed.We use cross wavelet transform to extract dynamic feature and bipartite graph model to extract static feature which are coefficients of quadrature mirror filter(QMF)-graph wavelet filter bank. Feature fusion is done after normalization. For normalization of features, min-max rule is used and mean-variance method is used to find weights for normalized features. Euclidean distance between each feature vector and center of the cluster which is obtained by k-means clustering is used as similarity measure in Bayesian framework. Experiments performed on widely used CASIA B gait database show that, the fusion of these two feature sets preserve discriminant information. We report 99.90 % average recognition rate.

Efficient face recognition method based on DCT and LDA

It has been demonstrated that the linear discriminant analysis (LDA) is an effective approach in face recognition tasks. However, due to the high dimensionality of an image space, many LDA based approaches first use the principal component analysis (PCA) to project an image into a lower dimensional space, then perform the LDA transform to extract discriminant feature. But some useful discriminant information to the following LDA transform will be lost in the PCA step. To overcome these defects, a face recognition method based on the discrete cosine transform (DCT) and the LDA is proposed. First the DCT is used to achieve dimension reduction, then LDA transform is performed on the lower space to extract features. Two face databases are used to test our method and the correct recognition rates of 97.5% and 96.0% are obtained respectively. The performance of the proposed method is compared with that of the PCA+ LDA method and the results show that the method proposed outperforms the PCA+ LDA method.

Fault detection method with PCA and LDA and its application to induction motor

A feature extraction and fusion algorithm was constructed by combining principal component analysis(PCA) and linear discriminant analysis(LDA) to detect a fault state of the induction motor.After yielding a feature vector with PCA and LDA from current signal that was measured by an experiment,the reference data were used to produce matching values.In a diagnostic step,two matching values that were obtained by PCA and LDA,respectively,were combined by probability model,and a faulted signal was finally diagnosed.As the proposed diagnosis algorithm brings only merits of PCA and LDA into relief,it shows excellent performance under the noisy environment.The simulation was executed under various noisy conditions in order to demonstrate the suitability of the proposed algorithm and showed more excellent performance than the case just using conventional PCA or LDA.

A novel face recognition method with feature combination

A novel combined personalized feature framework is proposed for face recognition (FR). In the framework, the proposed linear discriminant analysis (LDA) makes use of the null space of the within-class scatter matrix effectively, and Global feature vectors (PCA-transformed) and local feature vectors (Gabor wavelet-transformed) are integrated by complex vectors as input feature of improved LDA. The proposed method is compared to other commonly used FR methods on two face databases (ORL and UMIST). Results demonstrated that the performance of the proposed method is superior to that of traditional FR ap- proaches

Sedimentary environment of vermicular red clay in South China

Increasing interest in recent years has focused on vermicular red clay(VRC) in southern China due to its controversial sedimentary environment and provenance. Grain size is a useful way to determine sedimentary environment and provenance. Fisher Linear Discriminant Analysis(LDA) is a common and widely used method for multivariate statistical analysis. Based on a proper training sample set, the LDA can be used to discuss the sediment provenance. In this study, grain size data for 77 Malan loess samples and 41 floodplain deposit samples were used as a training sample set to deduce a Fisher linear discriminant function. Then, 299 VRC samples from 6 Quaternary red clay profiles were analyzed using the discriminant function. Grain size parameters and microscopic images of quartz grains separated from the VRC were evaluated in detail to determine the VRC sedimentary environment in south China. The results show that VRC profiles can be classified into two regions: the Chiang-nan Hilly Region and Wuyi Mountains Region. The VRC samples in the Chiang-nan Hilly Region originated from eolian dust deposits. This VRC is characterized by a higher content of fine particles(<20 μm) and lower average transport kinetic energy than loess in a C-M plot. The quartz grain sizes and microscope images of this VRC suggest that it could be a polyphyletic mixture of far-sourced and nearsourced eolian deposits. The far-sourced eolian deposits share similar provenance with Xiashu loess and were transported by the East Asian winter monsoon. The near-sourced eolian deposits were dust emitted from the adjacent floodplain. In the Wuyi Mountains Region, the rugged topography weakened the dustfall and strengthened the reconstructive effect of hydrodynamic forces during the Quaternary glacial periods. The VRC in this region was reworked strongly by water and retained typical hydraulic characteristics no matter the source.