SELF-DEPENDENT LOCALITY PRESERVING PROJECTION WITH TRANSFORMED SPACE-ORIENTED NEIGHBORHOOD GRAPH

Locality preserving projection （LPP） is a typical and popular dimensionality reduction （DR） method,and it can potentially find discriminative projection directions by preserving the local geometric structure in data. However,LPP is based on the neighborhood graph artificially constructed from the original data,and the performance of LPP relies on how well the nearest neighbor criterion work in the original space. To address this issue,a novel DR algorithm,called the self-dependent LPP （sdLPP） is proposed. And it is based on the fact that the nearest neighbor criterion usually achieves better performance in LPP transformed space than that in the original space. Firstly,LPP is performed based on the typical neighborhood graph; then,a new neighborhood graph is constructed in LPP transformed space and repeats LPP. Furthermore,a new criterion,called the improved Laplacian score,is developed as an empirical reference for the discriminative power and the iterative termination. Finally,the feasibility and the effectiveness of the method are verified by several publicly available UCI and face data sets with promising results.

Sparse Kernel Locality Preserving Projection and Its Application in Nonlinear Process Fault Detection

Locality preserving projection (LPP) is a newly emerging fault detection method which can discover local manifold structure of a data set to be analyzed, but its linear assumption may lead to monitoring performance degradation for complicated nonlinear industrial processes. In this paper, an improved LPP method, referred to as sparse kernel locality preserving projection (SKLPP) is proposed for nonlinear process fault detection. Based on the LPP model, kernel trick is applied to construct nonlinear kernel model. Furthermore, for reducing the computational complexity of kernel model, feature samples selection technique is adopted to make the kernel LPP model sparse. Lastly, two monitoring statistics of SKLPP model are built to detect process faults. Simulations on a continuous stirred tank reactor (CSTR) system show that SKLPP is more effective than LPP in terms of fault detection performance.

Fault Diagnosis Model Based on Feature Compression with Orthogonal Locality Preserving Projection

Based on feature compression with orthogonal locality preserving projection（OLPP）,a novel fault diagnosis model is proposed in this paper to achieve automation and high-precision of fault diagnosis of rotating machinery.With this model,the original vibration signals of training and test samples are first decomposed through the empirical mode decomposition（EMD）,and Shannon entropy is constructed to achieve high-dimensional eigenvectors.In order to replace the traditional feature extraction way which does the selection manually,OLPP is introduced to automatically compress the high-dimensional eigenvectors of training and test samples into the low-dimensional eigenvectors which have better discrimination.After that,the low-dimensional eigenvectors of training samples are input into Morlet wavelet support vector machine（MWSVM） and a trained MWSVM is obtained.Finally,the low-dimensional eigenvectors of test samples are input into the trained MWSVM to carry out fault diagnosis.To evaluate our proposed model,the experiment of fault diagnosis of deep groove ball bearings is made,and the experiment results indicate that the recognition accuracy rate of the proposed diagnosis model for outer race crack、inner race crack and ball crack is more than 90%.Compared to the existing approaches,the proposed diagnosis model combines the strengths of EMD in fault feature extraction,OLPP in feature compression and MWSVM in pattern recognition,and realizes the automation and high-precision of fault diagnosis.

Multimode Process Monitoring Based on Fuzzy C-means in Locality Preserving Projection Subspace

For complex industrial processes with multiple operational conditions, it is important to develop effective monitoring algorithms to ensure the safety of production processes. This paper proposes a novel monitoring strategy based on fuzzy C-means. The high dimensional historical data are transferred to a low dimensional subspace spanned by locality preserving projection. Then the scores in the novel subspace are classified into several overlapped clusters, each representing an operational mode. The distance statistics of each cluster are integrated though the membership values into a novel BID (Bayesian inference distance) monitoring index. The efficiency and effectiveness of the proposed method are validated though the Tennessee Eastman benchmark process.

Supervised local and non-local structure preserving projections with application to just-in-time learning for adaptive soft sensor

In soft sensor field, just-in-time learning(JITL) is an effective approach to model nonlinear and time varying processes. However, most similarity criterions in JITL are computed in the input space only while ignoring important output information, which may lead to inaccurate construction of relevant sample set. To solve this problem, we propose a novel supervised feature extraction method suitable for the regression problem called supervised local and non-local structure preserving projections(SLNSPP), in which both input and output information can be easily and effectively incorporated through a newly defined similarity index. The SLNSPP can not only retain the virtue of locality preserving projections but also prevent faraway points from nearing after projection,which endues SLNSPP with powerful discriminating ability. Such two good properties of SLNSPP are desirable for JITL as they are expected to enhance the accuracy of similar sample selection. Consequently, we present a SLNSPP-JITL framework for developing adaptive soft sensor, including a sparse learning strategy to limit the scale and update the frequency of database. Finally, two case studies are conducted with benchmark datasets to evaluate the performance of the proposed schemes. The results demonstrate the effectiveness of LNSPP and SLNSPP.

Locality Preserving Discriminant Projection for Speaker Verification

In this paper, a manifold subspace learning algorithm based on locality preserving discriminant projection (LPDP) is used for speaker verification. LPDP can overcome the deficiency of the total variability factor analysis and locality preserving projection (LPP). LPDP can effectively use the speaker label information of speech data. Through optimization, LPDP can maintain the inherent manifold local structure of the speech data samples of the same speaker by reducing the distance between them. At the same time, LPDP can enhance the discriminability of the embedding space by expanding the distance between the speech data samples of different speakers. The proposed method is compared with LPP and total variability factor analysis on the NIST SRE 2010 telephone-telephone core condition. The experimental results indicate that the proposed LPDP can overcome the deficiency of LPP and total variability factor analysis and can further improve the system performance.

Face recognition using illuminant locality preserving projections

A novel supervised manifold learning method was proposed to realize high accuracy face recognition under varying illuminant conditions. The proposed method, named illuminant locality preserving projections （ILPP）, exploited illuminant directions to alleviate the effect of illumination variations on face recognition. The face images were first projected into low dimensional subspace, Then the ILPP translated the face images along specific direction to reduce lighting variations in the face. The ILPP reduced the distance between face images of the same class, while increase the dis tance between face images of different classes. This proposed method was derived from the locality preserving projections （LPP） methods, and was designed to handle face images with various illumi nations. It preserved the face image＇ s local structure in low dimensional subspace. The ILPP meth od was compared with LPP and discriminant locality preserving projections （DLPP）, based on the YaleB face database. Experimental results showed the effectiveness of the proposed algorithm on the face recognition with various illuminations.

A Comparative Study of Locality Preserving Projection and Principle Component Analysis on Classification Performance Using Logistic Regression

There are a variety of classification techniques such as neural network, decision tree, support vector machine and logistic regression. The problem of dimensionality is pertinent to many learning algorithms, and it denotes the drastic raise of computational complexity, however, we need to use dimensionality reduction methods. These methods include principal component analysis (PCA) and locality preserving projection (LPP). In many real-world classification problems, the local structure is more important than the global structure and dimensionality reduction techniques ignore the local structure and preserve the global structure. The objectives is to compare PCA and LPP in terms of accuracy, to develop appropriate representations of complex data by reducing the dimensions of the data and to explain the importance of using LPP with logistic regression. The results of this paper find that the proposed LPP approach provides a better representation and high accuracy than the PCA approach.

Energy Efficient Access Point Selection and Signal Projection for Accurate Indoor Positioning

We propose a method to improve positioning accuracy while reducing energy consumption in an indoor Wireless Local Area Network(WLAN) environment.First,we intelligently and jointly select the subset of Access Points(APs) used in positioning via Maximum Mutual Information(MMI) criterion.Second,we propose Orthogonal Locality Preserving Projection(OLPP) to reduce the redundancy among selected APs.OLPP effectively extracts the intrinsic location features in situations where previous linear signal projection techniques failed to do,while maintaining computational efficiency.Third,we show that the combination of AP selection and OLPP simultaneously exploits their complementary advantages while avoiding the drawbacks.Experimental results indicate that,compared with the widely used weighted K-nearest neighbor and maximum likelihood estimation method,the proposed method leads to 21.8%(0.49 m) positioning accuracy improvement,while decreasing the computation cost by 65.4%.

基于KLPP-K-means-BiLSTM的台区短期电力负荷预测

随着智能电网的发展,各场景的用电更加多元化,而准确的台区负荷预测是确保相关电力部门制定合适检修任务的关键,同时为有序用电、电网经济运行提供重要参考。为了挖掘台区负荷的特征以提高台区负荷预测的精度,提出了一种基于核主元分析与局部保持投影降维、K均值聚类算法(K-means)以及双向长短时记忆网络(BiLSTM)的台区电力负荷预测方法。首先利用核局部保持投影(KLPP)对台区多特征负荷数据进行降维以提取主要特征信息;然后采取K-means聚类算法将相似特征的数据归类成各自的簇集;最后针对聚类后的各典型类型,有针对性地训练BiLSTM,并选取中国某高校低压台区负荷作为算例与其他经典预测方法进行对比分析,结果表明所提方法更拟合实际负荷走向,有效提升了预测效果。

基于自适应LPP特征降维和改进VPMCD的滚动轴承故障诊断

针对机械系统状态监测与故障诊断中存在的故障特征维数较高及模式识别导致的耗时较高问题,提出了一种基于自适应局部保持投影(Locality Preserving Projection,LPP)特征降维和改进多变量预测模型(Variable Predictive Model based Class Discriminate,VPMCD)的故障诊断方法。首先,从滚动轴承振动信号中提取时频域特征、能量特征,以及复杂度特征组成高维故障特征数据集;其次,利用自适应LPP方法对高维故障特征数据集进行降维处理,得到低维敏感故障特征;最后,采用改进VPMCD方法对低维敏感故障特征进行分类识别,进而判断故障类型。通过滚动轴承故障诊断试验分析表明,自适应LPP方法克服了传统LPP方法需要人工选取参数的缺陷,在获得低维敏感故障特征的基础上具有较少计算时间,相比主成分分析(Principal Component Analysis,PCA)、局部切空间排列(Local Tangent Space Alignment,LTSA)、线性局部切空间排列(Linear Local Tangent Space Alignment,LLTSA)、等距特征映射(Isometric Mapping,Isomap),以及局部线性嵌入(Locally Linear Embedding,LLE)等算法具有明显的优势;改进VPMCD方法可克服人工选择模型的偶然性和片面性,在滚动轴承10种故障状态的识别中获得了99.4%的诊断精度,相比优化参数支持向量机方法提高了故障诊断效率,大大降低了识别时间,具有一定的优越性。

基于RMDLPP的雷达空中目标分类

针对鉴别局部保持投影(discriminant locality preserving projections, DLPP)在窄带雷达目标数据降维时出现的类内离散度矩阵奇异和对孤立点敏感进而导致类别之间可分性弱的问题,提出了基于鲁棒性边界DLPP(robust margin DLPP, RMDLPP)的窄带雷达空中目标分类方法。首先,在计算样本之间距离时将两样本点的欧氏距离与同类样本均值相关联。然后,挑选一定数量的边界样本点进行处理并对优化DLPP目标函数进行降维。最后,使用高性能分类器对降维后的数据进行区分,实现对空中目标的分类。通过对X波段对空警戒雷达实测数据的对比实验表明,所提方法具有更好的分类准确率和对孤立点的鲁棒性。

Surface Detection of Continuous Casting Slabs Based on Curvelet Transform and Kernel Locality Preserving Projections

Longitudinal cracks are common defects of continuous casting slabs and may lead to serious quality accidents. Image capturing and recognition of hot slabs is an effective way for on-line detection of cracks, and recognition of cracks is essential because the surface of hot slabs is very complicated. In order to detect the surface longitudinal cracks of the slabs, a new feature extraction method based on Curvelet transform and kernel locality preserving projections （KLPP） is proposed. First, sample images are decomposed into three levels by Curvelet transform. Second, Fourier transform is applied to all sub-band images and the Fourier amplitude spectrum of each sub-band is computed to get features with translational invariance. Third, five kinds of statistical features of the Fourier amplitude spectrum are computed and combined in different forms. Then, KLPP is employed for dimensionality reduction of the obtained 62 types of high-dimensional combined features. Finally, a support vector machine （SVM） is used for sample set classification. Experiments with samples from a real production line of continuous casting slabs show that the algorithm is effective to detect longitudinal cracks, and the classification rate is 91.89%.

Full-viewpoint 3D Space Object Recognition Based on Kernel Locality Preserving Projections

Space object recognition plays an important role in spatial exploitation and surveillance, followed by two main problems： lacking of data and drastic changes in viewpoints. In this article, firstly, we build a three-dimensional （3D） satellites dataset named BUAA Satellite Image Dataset （BUAA-SID 1.0） to supply data for 3D space object research. Then, based on the dataset, we propose to recognize full-viewpoint 3D space objects based on kernel locality preserving projections （KLPP）. To obtain more accurate and separable description of the objects, firstly, we build feature vectors employing moment invariants, Fourier descriptors, region covariance and histogram of oriented gradients. Then, we map the features into kernel space followed by dimensionality reduction using KLPP to obtain the submanifold of the features. At last, k-nearest neighbor （kNN） is used to accomplish the classification. Experimental results show that the proposed approach is more appropriate for space object recognition mainly considering changes of viewpoints. Encouraging recognition rate could be obtained based on images in BUAA-SID 1.0, and the highest recognition result could achieve 95.87%.

Performance monitoring of non-gaussian chemical processes with modes-switching using globality-locality preserving projection

In this paper, we propose a novel performance monitoring and fault detection method, which is based on modified structure analysis and globality and locality preserving （MSAGL） projection, for non-Gaussian processes with multiple operation conditions. By using locality preserving projection to analyze the embedding geometrical manifold and extracting the non-Gaussian features by independent component analysis, MSAGL preserves both the global and local structures of the data simultaneously. Furthermore, the tradeoff parameter of MSAGL is tuned adaptively in order to find the projection direction optimal for revealing the hidden structural information. The validity and effectiveness of this approach are illustrated by applying the proposed technique to the Tennessee Eastman process simulation under multiple operation conditions. The results demonstrate the advantages of the proposed method over conventional eigendecomposition-based monitoring methotis.

一种有监督的LPP算法及其在人脸识别中的应用

为了提高局部保持投影算法(Locality Preserving Projections,LPP)对光照、姿态等外部因素的鲁棒性,该文对传统的LPP算法进行改进,提出了一种有监督的LPP(SLPP)方法。首先对LPP子空间进行判别分析,然后选择主要反应类内差异的基向量来构造子空间,最后在子空间上进行识别。通过Havard人脸库和Umist人脸库上的实验,结果表明该方法能够对光照和姿态的变化具有一定的鲁棒性和较高的识别率,比传统的LPP方法和其它子空间分析法识别率提高了10%以上。

基于Gabor小波和LPP的浮选过程泡沫纹理特征提取及应用

针对Gabor小波进行特征提取时易造成维数灾难和识别效率不高的问题,提出一种基于Gabor小波滤波和局部保持投影(LPP)降维算法相结合的泡沫纹理特征提取方法.首先,利用Gabor滤波器获得原始泡沫图像5个尺度和8个方向的高维特征描述向量;然后,利用LPP算法得到降维特征向量;最后,利用此降维特征向量通过反向传播(BP)神经网络进行不同工况下泡沫类别的识别,进而指导实际矿物浮选生产.实验结果表明,相对于传统的GLCM方法和Gabor小波纹理特征提取方法,该方法可有效降低泡沫纹理特征向量维数并具有更高的识别效率.

基于鉴别能力分析和LDA-LPP算法的人脸识别

针对人脸识别中的DCT系数选择问题和如何从全局和局部同时提取识别特征的问题,提出了一种基于鉴别能力分析和LDA-LPP的人脸识别算法。即先对人脸图像进行DCT变换,利用鉴别能力分析方法进行DCT系数的选择,融合LDA和LPP降维技术进行降维处理,不仅可以保持数据的全局性,同时也能够保持数据的局部性。在ORL人脸库和Yale人脸库上的实验表明,本文方法可以选择有效的DCT系数,明显提高了识别精度和鲁棒性。

KSLPP:新的人脸识别算法

针对人脸识别中的特征提取问题,提出了一种新的核有监督保局投影人脸识别算法,即KSLPP.该算法通过非线性映射将人脸样本投影到高维空间,通过可调因子有效地结合人脸局部流形的结构信息和样本的类别信息,提取人脸的非线性特征.采用最小近邻分类器估算识别率.采用AT&T人脸库以及Yale人脸库,对该方法进行了测试.结果表明,与Eigenface、Fisherface以及Laplacianface等方法相比,该方法具有较好的识别率.

融合相关系数LPP算法的人耳识别

针对局部保持投影(LPP)在构造邻接图时,基于欧氏距离的近邻选取方式往往不能很好地反映数据间的几何结构关系问题,提出一种融合相关系数的LPP人耳识别算法。该算法通过融合图像相关系数和欧氏距离来构建邻接图,能更好地揭示出数据间的几何结构关系。同时,在设定权值时,融入了图像间的相关系数,能更好地体现高维数据间的相似关系,提取出更有效的鉴别特征。在USTB3和西班牙人耳库上的实验结果表明,本文算法比传统LPP算法识别率提高了10%以上,验证了本文算法的有效性。