The purpose of this study is to apply some statistical and soft computing methods such as Fisher discriminant analysis (FDA) and support vector machines (SVMs) methodology to the determination of pillar stability ...The purpose of this study is to apply some statistical and soft computing methods such as Fisher discriminant analysis (FDA) and support vector machines (SVMs) methodology to the determination of pillar stability for underground mines selected from various coal and stone mines by using some index and mechanical properties, including the width, the height, the ratio of the pillar width to its height, the uniaxial compressive strength of the rock and pillar stress. The study includes four main stages: sampling, testing, modeling and assessment of the model performances. During the modeling stage, two pillar stability prediction models were investigated with FDA and SVMs methodology based on the statistical learning theory. After using 40 sets of measured data in various mines in the world for training and testing, the model was applied to other 6 data for validating the trained proposed models. The prediction results of SVMs were compared with those of FDA as well as the measured field values. The general performance of models developed in this study is close; however, the SVMs exhibit the best performance considering the performance index with the correct classification rate Prs by re-substitution method and Pcv by cross validation method. The results show that the SVMs approach has the potential to be a reliable and practical tool for determination of pillar stability for underground mines.展开更多
A new on-line batch process monitoring and diagnosing approach based on Fisher discriminant analysis (FDA) was proposed. This method does not need to predict the future observations of variables, so it is more sensi...A new on-line batch process monitoring and diagnosing approach based on Fisher discriminant analysis (FDA) was proposed. This method does not need to predict the future observations of variables, so it is more sensitive to fault detection and stronger implement for monitoring. In order to improve the monitoring performance, the variables trajectories of batch process are separated into several blocks. The key to the proposed approach for on-line monitoring is to calculate the distance of block data that project to low-dimension Fisher space between new batch and reference batch. Comparing the distance with the predefine threshold, it can be considered whether the batch process is normal or abnormal. Fault diagnosis is performed based on the weights in fault direction calculated by FDA. The proposed method was applied to the simulation model of fed-batch penicillin fermentation and the resuits were compared with those obtained using MPCA. The simulation results clearly show that the on-line monitoring method based on FDA is more efficient than the MPCA.展开更多
Foley-Sammon linear discriminant analysis (FSLDA) and uncorrelated linear discriminant analysis (ULDA) are two well-known kinds of linear discriminant analysis. Both ULDA and FSLDA search the kth discriminant vector i...Foley-Sammon linear discriminant analysis (FSLDA) and uncorrelated linear discriminant analysis (ULDA) are two well-known kinds of linear discriminant analysis. Both ULDA and FSLDA search the kth discriminant vector in an n-k+1 dimensional subspace, while they are subject to their respective constraints. Evidenced by strict demonstration, it is clear that in essence ULDA vectors are the covariance-orthogonal vectors of the corresponding eigen-equation. So, the algorithms for the covariance-orthogonal vectors are equivalent to the original algorithm of ULDA, which is time-consuming. Also, it is first revealed that the Fisher criterion value of each FSLDA vector must be not less than that of the corresponding ULDA vector by theory analysis. For a discriminant vector, the larger its Fisher criterion value is, the more powerful in discriminability it is. So, for FSLDA vectors, corresponding to larger Fisher criterion values is an advantage. On the other hand, in general any two feature components extracted by FSLDA vectors are statistically correlated with each other, which may make the discriminant vectors set at a disadvantageous position. In contrast to FSLDA vectors, any two feature components extracted by ULDA vectors are statistically uncorrelated with each other. Two experiments on CENPARMI handwritten numeral database and ORL database are performed. The experimental results are consistent with the theory analysis on Fisher criterion values of ULDA vectors and FSLDA vectors. The experiments also show that the equivalent algorithm of ULDA, presented in this paper, is much more efficient than the original algorithm of ULDA, as the theory analysis expects. Moreover, it appears that if there is high statistical correlation between feature components extracted by FSLDA vectors, FSLDA will not perform well, in spite of larger Fisher criterion value owned by every FSLDA vector. However, when the average correlation coefficient of feature components extracted by FSLDA vectors is at a low level, the performance of FSLDA are comparable with ULDA.展开更多
Today, mammography is the best method for early detection of breast cancer. Radiologists failed to detect evident cancerous signs in approximately 20% of false negative mammograms. False negatives have been identified...Today, mammography is the best method for early detection of breast cancer. Radiologists failed to detect evident cancerous signs in approximately 20% of false negative mammograms. False negatives have been identified as the inability of the radiologist to detect the abnormalities due to several reasons such as poor image quality, image noise, or eye fatigue. This paper presents a framework for a computer aided detection system that integrates Principal Component Analysis (PCA), Fisher Linear Discriminant (FLD), and Nearest Neighbor Classifier (KNN) algorithms for the detection of abnormalities in mammograms. Using normal and abnormal mammograms from the MIAS database, the integrated algorithm achieved 93.06% classification accuracy. Also in this paper, we present an analysis of the integrated algorithm’s parameters and suggest selection criteria.展开更多
Marginal Fisher analysis (MFA) not only aims to maintain the original relations of neighboring data points of the same class but also wants to keep away neighboring data points of the different classes.MFA can effec...Marginal Fisher analysis (MFA) not only aims to maintain the original relations of neighboring data points of the same class but also wants to keep away neighboring data points of the different classes.MFA can effectively overcome the limitation of linear discriminant analysis (LDA) due to data distribution assumption and available projection directions.However,MFA confronts the undersampled problems.Generalized marginal Fisher analysis (GMFA) based on a new optimization criterion is presented,which is applicable to the undersampled problems.The solutions to the proposed criterion for GMFA are derived,which can be characterized in a closed form.Among the solutions,two specific algorithms,namely,normal MFA (NMFA) and orthogonal MFA (OMFA),are studied,and the methods to implement NMFA and OMFA are proposed.A comparative study on the undersampled problem of face recognition is conducted to evaluate NMFA and OMFA in terms of classification accuracy,which demonstrates the effectiveness of the proposed algorithms.展开更多
Cataracts are the leading cause of blindness worldwide. Current methods for discriminating cataractous lenses from healthy lenses of Sprague-Dawley rats during preclinical studies are based on either histopathological...Cataracts are the leading cause of blindness worldwide. Current methods for discriminating cataractous lenses from healthy lenses of Sprague-Dawley rats during preclinical studies are based on either histopathological or clinical assessments which are weakened by subjectivity. In this work, both cataractous and healthy lens tissues of Sprague-Dawley rats were studied using multispectral imaging technique in combination with multivariate analysis. Multispectral images were captured in transmission, reflection and scattering modes. In all, five spectral bands were found to be markers for discriminating cataractous lenses from healthy lenses;470 nm and 625 nm discriminated in reflection mode whereas 435 nm, 590 nm and 700 nm discriminated in transmission mode. With Fisher’s Linear discriminant analysis, the midpoints for classifying cataractous from healthy lenses were found to be 14.718 × 10−14 and 3.2374 × 10−14 for the two spectra bands in the reflection mode and the three spectral bands in the transmission mode respectively. Images in scattering mode did not show significant discrimination. These spectral bands in reflection and transmission modes may offer potential diagnostic markers for discriminating cataractous lenses from healthy lenses thereby promising multispectral imaging applications for characterizing cataractous and healthy lenses.展开更多
Functional near-infrared spectroscopy(fNIRS)is a neuroimaging technology which is suitable for psychiatric patients.Several fNIRS studies have found abnormal brain activations during cognitive tasks in elderly depress...Functional near-infrared spectroscopy(fNIRS)is a neuroimaging technology which is suitable for psychiatric patients.Several fNIRS studies have found abnormal brain activations during cognitive tasks in elderly depression.In this paper,we proposed a discriminative model of multivariate pattern classification based on fNIRS signals to distinguish elderly depressed patients from healthy controls.This model used the brain activation patterns during a verbal fluency task as features of classification.Then Pseudo-Fisher Linear Discriminant Analysis was performed on the feature space to generate discriminative model.Using leave-one-out(LOO)cross-validation,our results showed a correct classification rate of 88%.The discriminative model showed its ability to identify people with elderly depression and suggested that fNIRS may be an efficient clinical tool for diagnosis of depression.This study may provide the first step for the development of neuroimaging biomarkers based on fNIRS in psychiatric disorders.展开更多
This paper presents a novel bootstrap based method for Receiver Operating Characteristic (ROC) analysis of Fisher classifier. By defining Fisher classifier’s output as a statistic, the bootstrap technique is used to ...This paper presents a novel bootstrap based method for Receiver Operating Characteristic (ROC) analysis of Fisher classifier. By defining Fisher classifier’s output as a statistic, the bootstrap technique is used to obtain the sampling distributions of the outputs for the positive class and the negative class respectively. As a result, the ROC curve is a plot of all the (False Positive Rate (FPR), True Positive Rate (TPR)) pairs by varying the decision threshold over the whole range of the boot- strap sampling distributions. The advantage of this method is, the bootstrap based ROC curves are much stable than those of the holdout or cross-validation, indicating a more stable ROC analysis of Fisher classifier. Experiments on five data sets publicly available demonstrate the effectiveness of the proposed method.展开更多
Intravascular ultrasound can provide clear real-time cross-sectional images,including lumen and plaque.In practice,to identify the plaques tissues in different pathological changes is very important.However,the graysc...Intravascular ultrasound can provide clear real-time cross-sectional images,including lumen and plaque.In practice,to identify the plaques tissues in different pathological changes is very important.However,the grayscale differences of them are not so apparent.In this paper a new textural characteristic space vector was formed by the combination of Co-occurrence Matrix and fraction methods.The vector was projected to the new characteristic space after multiplied by a projective matrix which can best classify those plaques according to the Fisher linear discriminant.Then the classification was completed in the new vector space.Experimental results found that the veracity of this classification could reach up to 88%,which would be an accessorial tool for doctors to identify each plaque.展开更多
基金Project (50934006) supported by the National Natural Science Foundation of ChinaProject (2010CB732004) supported by the National Basic Research Program of ChinaProject (CX2011B119) supported by the Graduated Students’ Research and Innovation Fund Project of Hunan Province of China
文摘The purpose of this study is to apply some statistical and soft computing methods such as Fisher discriminant analysis (FDA) and support vector machines (SVMs) methodology to the determination of pillar stability for underground mines selected from various coal and stone mines by using some index and mechanical properties, including the width, the height, the ratio of the pillar width to its height, the uniaxial compressive strength of the rock and pillar stress. The study includes four main stages: sampling, testing, modeling and assessment of the model performances. During the modeling stage, two pillar stability prediction models were investigated with FDA and SVMs methodology based on the statistical learning theory. After using 40 sets of measured data in various mines in the world for training and testing, the model was applied to other 6 data for validating the trained proposed models. The prediction results of SVMs were compared with those of FDA as well as the measured field values. The general performance of models developed in this study is close; however, the SVMs exhibit the best performance considering the performance index with the correct classification rate Prs by re-substitution method and Pcv by cross validation method. The results show that the SVMs approach has the potential to be a reliable and practical tool for determination of pillar stability for underground mines.
文摘A new on-line batch process monitoring and diagnosing approach based on Fisher discriminant analysis (FDA) was proposed. This method does not need to predict the future observations of variables, so it is more sensitive to fault detection and stronger implement for monitoring. In order to improve the monitoring performance, the variables trajectories of batch process are separated into several blocks. The key to the proposed approach for on-line monitoring is to calculate the distance of block data that project to low-dimension Fisher space between new batch and reference batch. Comparing the distance with the predefine threshold, it can be considered whether the batch process is normal or abnormal. Fault diagnosis is performed based on the weights in fault direction calculated by FDA. The proposed method was applied to the simulation model of fed-batch penicillin fermentation and the resuits were compared with those obtained using MPCA. The simulation results clearly show that the on-line monitoring method based on FDA is more efficient than the MPCA.
基金The National Natural Science Foundation of China (Grant No.60472060 ,60473039 and 60472061)
文摘Foley-Sammon linear discriminant analysis (FSLDA) and uncorrelated linear discriminant analysis (ULDA) are two well-known kinds of linear discriminant analysis. Both ULDA and FSLDA search the kth discriminant vector in an n-k+1 dimensional subspace, while they are subject to their respective constraints. Evidenced by strict demonstration, it is clear that in essence ULDA vectors are the covariance-orthogonal vectors of the corresponding eigen-equation. So, the algorithms for the covariance-orthogonal vectors are equivalent to the original algorithm of ULDA, which is time-consuming. Also, it is first revealed that the Fisher criterion value of each FSLDA vector must be not less than that of the corresponding ULDA vector by theory analysis. For a discriminant vector, the larger its Fisher criterion value is, the more powerful in discriminability it is. So, for FSLDA vectors, corresponding to larger Fisher criterion values is an advantage. On the other hand, in general any two feature components extracted by FSLDA vectors are statistically correlated with each other, which may make the discriminant vectors set at a disadvantageous position. In contrast to FSLDA vectors, any two feature components extracted by ULDA vectors are statistically uncorrelated with each other. Two experiments on CENPARMI handwritten numeral database and ORL database are performed. The experimental results are consistent with the theory analysis on Fisher criterion values of ULDA vectors and FSLDA vectors. The experiments also show that the equivalent algorithm of ULDA, presented in this paper, is much more efficient than the original algorithm of ULDA, as the theory analysis expects. Moreover, it appears that if there is high statistical correlation between feature components extracted by FSLDA vectors, FSLDA will not perform well, in spite of larger Fisher criterion value owned by every FSLDA vector. However, when the average correlation coefficient of feature components extracted by FSLDA vectors is at a low level, the performance of FSLDA are comparable with ULDA.
文摘Today, mammography is the best method for early detection of breast cancer. Radiologists failed to detect evident cancerous signs in approximately 20% of false negative mammograms. False negatives have been identified as the inability of the radiologist to detect the abnormalities due to several reasons such as poor image quality, image noise, or eye fatigue. This paper presents a framework for a computer aided detection system that integrates Principal Component Analysis (PCA), Fisher Linear Discriminant (FLD), and Nearest Neighbor Classifier (KNN) algorithms for the detection of abnormalities in mammograms. Using normal and abnormal mammograms from the MIAS database, the integrated algorithm achieved 93.06% classification accuracy. Also in this paper, we present an analysis of the integrated algorithm’s parameters and suggest selection criteria.
基金supported by Science Foundation of the Fujian Province of China (No. 2010J05099)
文摘Marginal Fisher analysis (MFA) not only aims to maintain the original relations of neighboring data points of the same class but also wants to keep away neighboring data points of the different classes.MFA can effectively overcome the limitation of linear discriminant analysis (LDA) due to data distribution assumption and available projection directions.However,MFA confronts the undersampled problems.Generalized marginal Fisher analysis (GMFA) based on a new optimization criterion is presented,which is applicable to the undersampled problems.The solutions to the proposed criterion for GMFA are derived,which can be characterized in a closed form.Among the solutions,two specific algorithms,namely,normal MFA (NMFA) and orthogonal MFA (OMFA),are studied,and the methods to implement NMFA and OMFA are proposed.A comparative study on the undersampled problem of face recognition is conducted to evaluate NMFA and OMFA in terms of classification accuracy,which demonstrates the effectiveness of the proposed algorithms.
文摘Cataracts are the leading cause of blindness worldwide. Current methods for discriminating cataractous lenses from healthy lenses of Sprague-Dawley rats during preclinical studies are based on either histopathological or clinical assessments which are weakened by subjectivity. In this work, both cataractous and healthy lens tissues of Sprague-Dawley rats were studied using multispectral imaging technique in combination with multivariate analysis. Multispectral images were captured in transmission, reflection and scattering modes. In all, five spectral bands were found to be markers for discriminating cataractous lenses from healthy lenses;470 nm and 625 nm discriminated in reflection mode whereas 435 nm, 590 nm and 700 nm discriminated in transmission mode. With Fisher’s Linear discriminant analysis, the midpoints for classifying cataractous from healthy lenses were found to be 14.718 × 10−14 and 3.2374 × 10−14 for the two spectra bands in the reflection mode and the three spectral bands in the transmission mode respectively. Images in scattering mode did not show significant discrimination. These spectral bands in reflection and transmission modes may offer potential diagnostic markers for discriminating cataractous lenses from healthy lenses thereby promising multispectral imaging applications for characterizing cataractous and healthy lenses.
文摘Functional near-infrared spectroscopy(fNIRS)is a neuroimaging technology which is suitable for psychiatric patients.Several fNIRS studies have found abnormal brain activations during cognitive tasks in elderly depression.In this paper,we proposed a discriminative model of multivariate pattern classification based on fNIRS signals to distinguish elderly depressed patients from healthy controls.This model used the brain activation patterns during a verbal fluency task as features of classification.Then Pseudo-Fisher Linear Discriminant Analysis was performed on the feature space to generate discriminative model.Using leave-one-out(LOO)cross-validation,our results showed a correct classification rate of 88%.The discriminative model showed its ability to identify people with elderly depression and suggested that fNIRS may be an efficient clinical tool for diagnosis of depression.This study may provide the first step for the development of neuroimaging biomarkers based on fNIRS in psychiatric disorders.
基金the Natural Science Foundation of Zhejiang Province of China (No. Y104540)the Foundation of the Key Laboratory of Advanced Information Science and Network Technology of Beijing, China (No.TDXX0509).
文摘This paper presents a novel bootstrap based method for Receiver Operating Characteristic (ROC) analysis of Fisher classifier. By defining Fisher classifier’s output as a statistic, the bootstrap technique is used to obtain the sampling distributions of the outputs for the positive class and the negative class respectively. As a result, the ROC curve is a plot of all the (False Positive Rate (FPR), True Positive Rate (TPR)) pairs by varying the decision threshold over the whole range of the boot- strap sampling distributions. The advantage of this method is, the bootstrap based ROC curves are much stable than those of the holdout or cross-validation, indicating a more stable ROC analysis of Fisher classifier. Experiments on five data sets publicly available demonstrate the effectiveness of the proposed method.
文摘Intravascular ultrasound can provide clear real-time cross-sectional images,including lumen and plaque.In practice,to identify the plaques tissues in different pathological changes is very important.However,the grayscale differences of them are not so apparent.In this paper a new textural characteristic space vector was formed by the combination of Co-occurrence Matrix and fraction methods.The vector was projected to the new characteristic space after multiplied by a projective matrix which can best classify those plaques according to the Fisher linear discriminant.Then the classification was completed in the new vector space.Experimental results found that the veracity of this classification could reach up to 88%,which would be an accessorial tool for doctors to identify each plaque.