Locality preserving projection （LPP） is a typical and popular dimensionality reduction （DR） method,and it can potentially find discriminative projection directions by preserving the local geometric structure in da...Locality preserving projection （LPP） is a typical and popular dimensionality reduction （DR） method,and it can potentially find discriminative projection directions by preserving the local geometric structure in data. However,LPP is based on the neighborhood graph artificially constructed from the original data,and the performance of LPP relies on how well the nearest neighbor criterion work in the original space. To address this issue,a novel DR algorithm,called the self-dependent LPP （sdLPP） is proposed. And it is based on the fact that the nearest neighbor criterion usually achieves better performance in LPP transformed space than that in the original space. Firstly,LPP is performed based on the typical neighborhood graph; then,a new neighborhood graph is constructed in LPP transformed space and repeats LPP. Furthermore,a new criterion,called the improved Laplacian score,is developed as an empirical reference for the discriminative power and the iterative termination. Finally,the feasibility and the effectiveness of the method are verified by several publicly available UCI and face data sets with promising results.展开更多
Locality preserving projection (LPP) is a newly emerging fault detection method which can discover local manifold structure of a data set to be analyzed, but its linear assumption may lead to monitoring performance de...Locality preserving projection (LPP) is a newly emerging fault detection method which can discover local manifold structure of a data set to be analyzed, but its linear assumption may lead to monitoring performance degradation for complicated nonlinear industrial processes. In this paper, an improved LPP method, referred to as sparse kernel locality preserving projection (SKLPP) is proposed for nonlinear process fault detection. Based on the LPP model, kernel trick is applied to construct nonlinear kernel model. Furthermore, for reducing the computational complexity of kernel model, feature samples selection technique is adopted to make the kernel LPP model sparse. Lastly, two monitoring statistics of SKLPP model are built to detect process faults. Simulations on a continuous stirred tank reactor (CSTR) system show that SKLPP is more effective than LPP in terms of fault detection performance.展开更多
Based on feature compression with orthogonal locality preserving projection（OLPP）,a novel fault diagnosis model is proposed in this paper to achieve automation and high-precision of fault diagnosis of rotating machi...Based on feature compression with orthogonal locality preserving projection（OLPP）,a novel fault diagnosis model is proposed in this paper to achieve automation and high-precision of fault diagnosis of rotating machinery.With this model,the original vibration signals of training and test samples are first decomposed through the empirical mode decomposition（EMD）,and Shannon entropy is constructed to achieve high-dimensional eigenvectors.In order to replace the traditional feature extraction way which does the selection manually,OLPP is introduced to automatically compress the high-dimensional eigenvectors of training and test samples into the low-dimensional eigenvectors which have better discrimination.After that,the low-dimensional eigenvectors of training samples are input into Morlet wavelet support vector machine（MWSVM） and a trained MWSVM is obtained.Finally,the low-dimensional eigenvectors of test samples are input into the trained MWSVM to carry out fault diagnosis.To evaluate our proposed model,the experiment of fault diagnosis of deep groove ball bearings is made,and the experiment results indicate that the recognition accuracy rate of the proposed diagnosis model for outer race crack、inner race crack and ball crack is more than 90%.Compared to the existing approaches,the proposed diagnosis model combines the strengths of EMD in fault feature extraction,OLPP in feature compression and MWSVM in pattern recognition,and realizes the automation and high-precision of fault diagnosis.展开更多
For complex industrial processes with multiple operational conditions, it is important to develop effective monitoring algorithms to ensure the safety of production processes. This paper proposes a novel monitoring st...For complex industrial processes with multiple operational conditions, it is important to develop effective monitoring algorithms to ensure the safety of production processes. This paper proposes a novel monitoring strategy based on fuzzy C-means. The high dimensional historical data are transferred to a low dimensional subspace spanned by locality preserving projection. Then the scores in the novel subspace are classified into several overlapped clusters, each representing an operational mode. The distance statistics of each cluster are integrated though the membership values into a novel BID (Bayesian inference distance) monitoring index. The efficiency and effectiveness of the proposed method are validated though the Tennessee Eastman benchmark process.展开更多
In soft sensor field, just-in-time learning(JITL) is an effective approach to model nonlinear and time varying processes. However, most similarity criterions in JITL are computed in the input space only while ignoring...In soft sensor field, just-in-time learning(JITL) is an effective approach to model nonlinear and time varying processes. However, most similarity criterions in JITL are computed in the input space only while ignoring important output information, which may lead to inaccurate construction of relevant sample set. To solve this problem, we propose a novel supervised feature extraction method suitable for the regression problem called supervised local and non-local structure preserving projections(SLNSPP), in which both input and output information can be easily and effectively incorporated through a newly defined similarity index. The SLNSPP can not only retain the virtue of locality preserving projections but also prevent faraway points from nearing after projection,which endues SLNSPP with powerful discriminating ability. Such two good properties of SLNSPP are desirable for JITL as they are expected to enhance the accuracy of similar sample selection. Consequently, we present a SLNSPP-JITL framework for developing adaptive soft sensor, including a sparse learning strategy to limit the scale and update the frequency of database. Finally, two case studies are conducted with benchmark datasets to evaluate the performance of the proposed schemes. The results demonstrate the effectiveness of LNSPP and SLNSPP.展开更多
In this paper, a manifold subspace learning algorithm based on locality preserving discriminant projection (LPDP) is used for speaker verification. LPDP can overcome the deficiency of the total variability factor anal...In this paper, a manifold subspace learning algorithm based on locality preserving discriminant projection (LPDP) is used for speaker verification. LPDP can overcome the deficiency of the total variability factor analysis and locality preserving projection (LPP). LPDP can effectively use the speaker label information of speech data. Through optimization, LPDP can maintain the inherent manifold local structure of the speech data samples of the same speaker by reducing the distance between them. At the same time, LPDP can enhance the discriminability of the embedding space by expanding the distance between the speech data samples of different speakers. The proposed method is compared with LPP and total variability factor analysis on the NIST SRE 2010 telephone-telephone core condition. The experimental results indicate that the proposed LPDP can overcome the deficiency of LPP and total variability factor analysis and can further improve the system performance.展开更多
A novel supervised manifold learning method was proposed to realize high accuracy face recognition under varying illuminant conditions. The proposed method, named illuminant locality preserving projections （ILPP）, e...A novel supervised manifold learning method was proposed to realize high accuracy face recognition under varying illuminant conditions. The proposed method, named illuminant locality preserving projections （ILPP）, exploited illuminant directions to alleviate the effect of illumination variations on face recognition. The face images were first projected into low dimensional subspace, Then the ILPP translated the face images along specific direction to reduce lighting variations in the face. The ILPP reduced the distance between face images of the same class, while increase the dis tance between face images of different classes. This proposed method was derived from the locality preserving projections （LPP） methods, and was designed to handle face images with various illumi nations. It preserved the face image＇ s local structure in low dimensional subspace. The ILPP meth od was compared with LPP and discriminant locality preserving projections （DLPP）, based on the YaleB face database. Experimental results showed the effectiveness of the proposed algorithm on the face recognition with various illuminations.展开更多
针对机械系统状态监测与故障诊断中存在的故障特征维数较高及模式识别导致的耗时较高问题,提出了一种基于自适应局部保持投影(Locality Preserving Projection,LPP)特征降维和改进多变量预测模型(Variable Predictive Model based Class...针对机械系统状态监测与故障诊断中存在的故障特征维数较高及模式识别导致的耗时较高问题,提出了一种基于自适应局部保持投影(Locality Preserving Projection,LPP)特征降维和改进多变量预测模型(Variable Predictive Model based Class Discriminate,VPMCD)的故障诊断方法。首先,从滚动轴承振动信号中提取时频域特征、能量特征,以及复杂度特征组成高维故障特征数据集;其次,利用自适应LPP方法对高维故障特征数据集进行降维处理,得到低维敏感故障特征;最后,采用改进VPMCD方法对低维敏感故障特征进行分类识别,进而判断故障类型。通过滚动轴承故障诊断试验分析表明,自适应LPP方法克服了传统LPP方法需要人工选取参数的缺陷,在获得低维敏感故障特征的基础上具有较少计算时间,相比主成分分析(Principal Component Analysis,PCA)、局部切空间排列(Local Tangent Space Alignment,LTSA)、线性局部切空间排列(Linear Local Tangent Space Alignment,LLTSA)、等距特征映射(Isometric Mapping,Isomap),以及局部线性嵌入(Locally Linear Embedding,LLE)等算法具有明显的优势;改进VPMCD方法可克服人工选择模型的偶然性和片面性,在滚动轴承10种故障状态的识别中获得了99.4%的诊断精度,相比优化参数支持向量机方法提高了故障诊断效率,大大降低了识别时间,具有一定的优越性。展开更多
There are a variety of classification techniques such as neural network, decision tree, support vector machine and logistic regression. The problem of dimensionality is pertinent to many learning algorithms, and it de...There are a variety of classification techniques such as neural network, decision tree, support vector machine and logistic regression. The problem of dimensionality is pertinent to many learning algorithms, and it denotes the drastic raise of computational complexity, however, we need to use dimensionality reduction methods. These methods include principal component analysis (PCA) and locality preserving projection (LPP). In many real-world classification problems, the local structure is more important than the global structure and dimensionality reduction techniques ignore the local structure and preserve the global structure. The objectives is to compare PCA and LPP in terms of accuracy, to develop appropriate representations of complex data by reducing the dimensions of the data and to explain the importance of using LPP with logistic regression. The results of this paper find that the proposed LPP approach provides a better representation and high accuracy than the PCA approach.展开更多
In this paper, we proposed a combined PCA-LPP algorithm toimprove 3D face reconstruction performance. Principal component analysis(PCA) is commonly used to compress images and extract features. Onedisadvantage of PCA ...In this paper, we proposed a combined PCA-LPP algorithm toimprove 3D face reconstruction performance. Principal component analysis(PCA) is commonly used to compress images and extract features. Onedisadvantage of PCA is local feature loss. To address this, various studies haveproposed combining a PCA-LPP-based algorithm with a locality preservingprojection (LPP). However, the existing PCA-LPP method is unsuitable for3D face reconstruction because it focuses on data classification and clustering.In the existing PCA-LPP, the adjacency graph, which primarily shows the connectionrelationships between data, is composed of the e-or k-nearest neighbortechniques. By contrast, in this study, complex and detailed parts, such aswrinkles around the eyes and mouth, can be reconstructed by composing thetopology of the 3D face model as an adjacency graph and extracting localfeatures from the connection relationship between the 3D model vertices.Experiments verified the effectiveness of the proposed method. When theproposed method was applied to the 3D face reconstruction evaluation set,a performance improvement of 10% to 20% was observed compared with theexisting PCA-based method.展开更多
基金Supported by the National Natural Science Foundation of China (60973097)the Scientific Research Foundation of Liaocheng University(X0810029)~~
文摘Locality preserving projection （LPP） is a typical and popular dimensionality reduction （DR） method,and it can potentially find discriminative projection directions by preserving the local geometric structure in data. However,LPP is based on the neighborhood graph artificially constructed from the original data,and the performance of LPP relies on how well the nearest neighbor criterion work in the original space. To address this issue,a novel DR algorithm,called the self-dependent LPP （sdLPP） is proposed. And it is based on the fact that the nearest neighbor criterion usually achieves better performance in LPP transformed space than that in the original space. Firstly,LPP is performed based on the typical neighborhood graph; then,a new neighborhood graph is constructed in LPP transformed space and repeats LPP. Furthermore,a new criterion,called the improved Laplacian score,is developed as an empirical reference for the discriminative power and the iterative termination. Finally,the feasibility and the effectiveness of the method are verified by several publicly available UCI and face data sets with promising results.
基金Supported by the National Natural Science Foundation of China （61273160）, the Natural Science Foundation of Shandong Province of China （ZR2011FM014） and the Fundamental Research Funds for the Central Universities （10CX04046A）.
文摘Locality preserving projection (LPP) is a newly emerging fault detection method which can discover local manifold structure of a data set to be analyzed, but its linear assumption may lead to monitoring performance degradation for complicated nonlinear industrial processes. In this paper, an improved LPP method, referred to as sparse kernel locality preserving projection (SKLPP) is proposed for nonlinear process fault detection. Based on the LPP model, kernel trick is applied to construct nonlinear kernel model. Furthermore, for reducing the computational complexity of kernel model, feature samples selection technique is adopted to make the kernel LPP model sparse. Lastly, two monitoring statistics of SKLPP model are built to detect process faults. Simulations on a continuous stirred tank reactor (CSTR) system show that SKLPP is more effective than LPP in terms of fault detection performance.
基金supported by Fundamental Research Funds for the Central Universities of China (Grant No. CDJZR10118801)
文摘Based on feature compression with orthogonal locality preserving projection（OLPP）,a novel fault diagnosis model is proposed in this paper to achieve automation and high-precision of fault diagnosis of rotating machinery.With this model,the original vibration signals of training and test samples are first decomposed through the empirical mode decomposition（EMD）,and Shannon entropy is constructed to achieve high-dimensional eigenvectors.In order to replace the traditional feature extraction way which does the selection manually,OLPP is introduced to automatically compress the high-dimensional eigenvectors of training and test samples into the low-dimensional eigenvectors which have better discrimination.After that,the low-dimensional eigenvectors of training samples are input into Morlet wavelet support vector machine（MWSVM） and a trained MWSVM is obtained.Finally,the low-dimensional eigenvectors of test samples are input into the trained MWSVM to carry out fault diagnosis.To evaluate our proposed model,the experiment of fault diagnosis of deep groove ball bearings is made,and the experiment results indicate that the recognition accuracy rate of the proposed diagnosis model for outer race crack、inner race crack and ball crack is more than 90%.Compared to the existing approaches,the proposed diagnosis model combines the strengths of EMD in fault feature extraction,OLPP in feature compression and MWSVM in pattern recognition,and realizes the automation and high-precision of fault diagnosis.
基金Supported by the National Natural Science Foundation of China (61074079)Shanghai Leading Academic Discipline Project (B054)
文摘For complex industrial processes with multiple operational conditions, it is important to develop effective monitoring algorithms to ensure the safety of production processes. This paper proposes a novel monitoring strategy based on fuzzy C-means. The high dimensional historical data are transferred to a low dimensional subspace spanned by locality preserving projection. Then the scores in the novel subspace are classified into several overlapped clusters, each representing an operational mode. The distance statistics of each cluster are integrated though the membership values into a novel BID (Bayesian inference distance) monitoring index. The efficiency and effectiveness of the proposed method are validated though the Tennessee Eastman benchmark process.
基金Supported by the National Natural Science Foundation of China(61273160)the Fundamental Research Funds for the Central Universities(14CX06067A,13CX05021A)
文摘In soft sensor field, just-in-time learning(JITL) is an effective approach to model nonlinear and time varying processes. However, most similarity criterions in JITL are computed in the input space only while ignoring important output information, which may lead to inaccurate construction of relevant sample set. To solve this problem, we propose a novel supervised feature extraction method suitable for the regression problem called supervised local and non-local structure preserving projections(SLNSPP), in which both input and output information can be easily and effectively incorporated through a newly defined similarity index. The SLNSPP can not only retain the virtue of locality preserving projections but also prevent faraway points from nearing after projection,which endues SLNSPP with powerful discriminating ability. Such two good properties of SLNSPP are desirable for JITL as they are expected to enhance the accuracy of similar sample selection. Consequently, we present a SLNSPP-JITL framework for developing adaptive soft sensor, including a sparse learning strategy to limit the scale and update the frequency of database. Finally, two case studies are conducted with benchmark datasets to evaluate the performance of the proposed schemes. The results demonstrate the effectiveness of LNSPP and SLNSPP.
文摘In this paper, a manifold subspace learning algorithm based on locality preserving discriminant projection (LPDP) is used for speaker verification. LPDP can overcome the deficiency of the total variability factor analysis and locality preserving projection (LPP). LPDP can effectively use the speaker label information of speech data. Through optimization, LPDP can maintain the inherent manifold local structure of the speech data samples of the same speaker by reducing the distance between them. At the same time, LPDP can enhance the discriminability of the embedding space by expanding the distance between the speech data samples of different speakers. The proposed method is compared with LPP and total variability factor analysis on the NIST SRE 2010 telephone-telephone core condition. The experimental results indicate that the proposed LPDP can overcome the deficiency of LPP and total variability factor analysis and can further improve the system performance.
基金Supported by the National Natural Science Foundation of China(60772066)
文摘A novel supervised manifold learning method was proposed to realize high accuracy face recognition under varying illuminant conditions. The proposed method, named illuminant locality preserving projections （ILPP）, exploited illuminant directions to alleviate the effect of illumination variations on face recognition. The face images were first projected into low dimensional subspace, Then the ILPP translated the face images along specific direction to reduce lighting variations in the face. The ILPP reduced the distance between face images of the same class, while increase the dis tance between face images of different classes. This proposed method was derived from the locality preserving projections （LPP） methods, and was designed to handle face images with various illumi nations. It preserved the face image＇ s local structure in low dimensional subspace. The ILPP meth od was compared with LPP and discriminant locality preserving projections （DLPP）, based on the YaleB face database. Experimental results showed the effectiveness of the proposed algorithm on the face recognition with various illuminations.
文摘针对机械系统状态监测与故障诊断中存在的故障特征维数较高及模式识别导致的耗时较高问题,提出了一种基于自适应局部保持投影(Locality Preserving Projection,LPP)特征降维和改进多变量预测模型(Variable Predictive Model based Class Discriminate,VPMCD)的故障诊断方法。首先,从滚动轴承振动信号中提取时频域特征、能量特征,以及复杂度特征组成高维故障特征数据集;其次,利用自适应LPP方法对高维故障特征数据集进行降维处理,得到低维敏感故障特征;最后,采用改进VPMCD方法对低维敏感故障特征进行分类识别,进而判断故障类型。通过滚动轴承故障诊断试验分析表明,自适应LPP方法克服了传统LPP方法需要人工选取参数的缺陷,在获得低维敏感故障特征的基础上具有较少计算时间,相比主成分分析(Principal Component Analysis,PCA)、局部切空间排列(Local Tangent Space Alignment,LTSA)、线性局部切空间排列(Linear Local Tangent Space Alignment,LLTSA)、等距特征映射(Isometric Mapping,Isomap),以及局部线性嵌入(Locally Linear Embedding,LLE)等算法具有明显的优势;改进VPMCD方法可克服人工选择模型的偶然性和片面性,在滚动轴承10种故障状态的识别中获得了99.4%的诊断精度,相比优化参数支持向量机方法提高了故障诊断效率,大大降低了识别时间,具有一定的优越性。
文摘There are a variety of classification techniques such as neural network, decision tree, support vector machine and logistic regression. The problem of dimensionality is pertinent to many learning algorithms, and it denotes the drastic raise of computational complexity, however, we need to use dimensionality reduction methods. These methods include principal component analysis (PCA) and locality preserving projection (LPP). In many real-world classification problems, the local structure is more important than the global structure and dimensionality reduction techniques ignore the local structure and preserve the global structure. The objectives is to compare PCA and LPP in terms of accuracy, to develop appropriate representations of complex data by reducing the dimensions of the data and to explain the importance of using LPP with logistic regression. The results of this paper find that the proposed LPP approach provides a better representation and high accuracy than the PCA approach.
文摘针对原始局部保持投影(LPP:Local Preserving Projection)算法难以准确获取非均匀高维数据的局部流形结构且未利用样本类别信息的缺陷,提出一种多信息融合的局部保持投影算法(MIF-LPP:Multi-Information Fusion Local Preserving Projection)。该算法使用改进后的标准欧氏距离获取样本的近邻和互邻信息,降低了样本点分布不均和不同维度数据量纲差异的影响。通过融合样本的类别信息构造权值矩阵,进而获得数据的低维本质流形。最后,分别在CWRU(Case Western Reserve University)数据集和本实验室轴承数据集上验证该算法的有效性。实验结果表明,MIF-LPP算法的特征提取性能明显优于其他算法,并且对邻域值具有鲁棒性。
基金This research was supported by the Basic Science Research Program through the National Research Foundation of Korea(NRF),funded by the Ministry of Education(2021R1I1A3058103).
文摘In this paper, we proposed a combined PCA-LPP algorithm toimprove 3D face reconstruction performance. Principal component analysis(PCA) is commonly used to compress images and extract features. Onedisadvantage of PCA is local feature loss. To address this, various studies haveproposed combining a PCA-LPP-based algorithm with a locality preservingprojection (LPP). However, the existing PCA-LPP method is unsuitable for3D face reconstruction because it focuses on data classification and clustering.In the existing PCA-LPP, the adjacency graph, which primarily shows the connectionrelationships between data, is composed of the e-or k-nearest neighbortechniques. By contrast, in this study, complex and detailed parts, such aswrinkles around the eyes and mouth, can be reconstructed by composing thetopology of the 3D face model as an adjacency graph and extracting localfeatures from the connection relationship between the 3D model vertices.Experiments verified the effectiveness of the proposed method. When theproposed method was applied to the 3D face reconstruction evaluation set,a performance improvement of 10% to 20% was observed compared with theexisting PCA-based method.
