Predicting pillar stability for underground mine using Fisher discriminant analysis and SVM methods

The purpose of this study is to apply some statistical and soft computing methods such as Fisher discriminant analysis （FDA） and support vector machines （SVMs） methodology to the determination of pillar stability for underground mines selected from various coal and stone mines by using some index and mechanical properties, including the width, the height, the ratio of the pillar width to its height, the uniaxial compressive strength of the rock and pillar stress. The study includes four main stages： sampling, testing, modeling and assessment of the model performances. During the modeling stage, two pillar stability prediction models were investigated with FDA and SVMs methodology based on the statistical learning theory. After using 40 sets of measured data in various mines in the world for training and testing, the model was applied to other 6 data for validating the trained proposed models. The prediction results of SVMs were compared with those of FDA as well as the measured field values. The general performance of models developed in this study is close; however, the SVMs exhibit the best performance considering the performance index with the correct classification rate Prs by re-substitution method and Pcv by cross validation method. The results show that the SVMs approach has the potential to be a reliable and practical tool for determination of pillar stability for underground mines.

Fault Diagnosis in Chemical Process Based on Self-organizing Map Integrated with Fisher Discriminant Analysis

Fault diagnosis and monitoring are very important for complex chemical process. There are numerous methods that have been studied in this field, in which the effective visualization method is still challenging. In order to get a better visualization effect, a novel fault diagnosis method which combines self-organizing map (SOM) with Fisher discriminant analysis (FDA) is proposed. FDA can reduce the dimension of the data in terms of maximizing the separability of the classes. After feature extraction by FDA, SOM can distinguish the different states on the output map clearly and it can also be employed to monitor abnormal states. Tennessee Eastman (TE) process is employed to illustrate the fault diagnosis and monitoring performance of the proposed method. The result shows that the SOM integrated with FDA method is efficient and capable for real-time monitoring and fault diagnosis in complex chemical process.

Fault Diagnosis for Batch Processes by Improved Multi-model Fisher Discriminant Analysis

Since there are not enough fault data in historical data sets, it is very difficult to diagnose faults for batch processes. In addition, a complete batch trajectory can be obtained till the end of its operation. In order to overcome the need for estimated or filled up future unmeasured values in the online fault diagnosis, sufficiently utilize the finite information of faults, and enhance the diagnostic performance, an improved multi-model Fisher discriminant analysis is represented. The trait of the proposed method is that the training data sets are made of the current measured information and the past major discriminant information, and not only the current information or the whole batch data. An industrial typical multi-stage streptomycin fermentation process is used to test the performance of fault diagnosis of the proposed method.

Fisher discriminant analysis model and its application for prediction of classification of rockburst in deep-buried long tunnel

A Fisher discriminant analysis （FDA） model for the prediction of classification of rockburst in deep-buried long tunnel was established based on the Fisher discriminant theory and the actual characteristics of the project. First, the major factors of rockburst, such as the maximum tangential stress of the cavern wall σθ, uniaxial compressive strength σc, uniaxial tensile strength or, and the elastic energy index of rock Wet, were taken into account in the analysis. Three factors, Stress coefficient σθ/σc, rock brittleness coefficient σc/σt, and elastic energy index Wet, were defined as the criterion indices for rockburst prediction in the proposed model. After training and testing of 12 sets of measured data, the discriminant functions of FDA were solved, and the ratio of misdiscrimina- tion is zero. Moreover, the proposed model was used to predict rockbursts of Qinling tunnel along Xi＇an-Ankang railway. The results show that three forecast results are identical with the actual situation. Therefore, the prediction accuracy of the FDA model is acceptable.

Cobalt crust recognition based on kernel Fisher discriminant analysis and genetic algorithm in reverberation environment

Recognition of substrates in cobalt crust mining areas can improve mining efficiency.Aiming at the problem of unsatisfactory performance of using single feature to recognize the seabed material of the cobalt crust mining area,a method based on multiple-feature sets is proposed.Features of the target echoes are extracted by linear prediction method and wavelet analysis methods,and the linear prediction coefficient and linear prediction cepstrum coefficient are also extracted.Meanwhile,the characteristic matrices of modulus maxima,sub-band energy and multi-resolution singular spectrum entropy are obtained,respectively.The resulting features are subsequently compressed by kernel Fisher discriminant analysis(KFDA),the output features are selected using genetic algorithm(GA)to obtain optimal feature subsets,and recognition results of classifier are chosen as genetic fitness function.The advantages of this method are that it can describe the signal features more comprehensively and select the favorable features and remove the redundant features to the greatest extent.The experimental results show the better performance of the proposed method in comparison with only using KFDA or GA.

On-line Batch Process Monitoring and Diagnosing Based on Fisher Discriminant Analysis

A new on-line batch process monitoring and diagnosing approach based on Fisher discriminant analysis （FDA） was proposed. This method does not need to predict the future observations of variables, so it is more sensitive to fault detection and stronger implement for monitoring. In order to improve the monitoring performance, the variables trajectories of batch process are separated into several blocks. The key to the proposed approach for on-line monitoring is to calculate the distance of block data that project to low-dimension Fisher space between new batch and reference batch. Comparing the distance with the predefine threshold, it can be considered whether the batch process is normal or abnormal. Fault diagnosis is performed based on the weights in fault direction calculated by FDA. The proposed method was applied to the simulation model of fed-batch penicillin fermentation and the resuits were compared with those obtained using MPCA. The simulation results clearly show that the on-line monitoring method based on FDA is more efficient than the MPCA.

Threshold Selection Study on Fisher Discriminant Analysis Used in Exon Prediction for Unbalanced Data Sets

In gene prediction, the Fisher discriminant analysis (FDA) is used to separate protein coding region (exon) from non-coding regions (intron). Usually, the positive data set and the negative data set are of the same size if the number of the data is big enough. But for some situations the data are not sufficient or not equal, the threshold used in FDA may have important influence on prediction results. This paper presents a study on the selection of the threshold. The eigen value of each exon/intron sequence is computed using the Z-curve method with 69 variables. The experiments results suggest that the size and the standard deviation of the data sets and the threshold are the three key elements to be taken into consideration to improve the prediction results.

Kernel-based fisher discriminant analysis for hyperspectral target detection

A new method based on kernel Fisher discriminant analysis （KFDA） is proposed for target detection of hyperspectral images. The KFDA combines kernel mapping derived from support vector machine and the classical linear Fisher discriminant analysis （LFDA）, and it possesses good ability to process nonlinear data such as hyperspectral images. According to the Fisher rule that the ratio of the between-class and within-class scatters is maximized, the KFDA is used to obtain a set of optimal discriminant basis vectors in high dimensional feature space, All pixels in the hyperspectral images are projected onto the discriminant basis vectors and the target detection is performed according to the projection result. The numerical experiments are performed on hyperspectral data with 126 bands collected by Airborne Visible/Infrared Imaging Spectrometer （AVIRIS）, Tbe experimental results show the effectiveness of the proposed detection method and prove that this method has good ability to overcome small sample size and spectral variability in the hyperspectral target detection.

基于Fisher判别分析可分性信息融合的马铃薯VC含量高光谱检测方法

为提高马铃薯VC含量检测结果的准确性和可靠性,提出一种基于Fisher判别分析(Fisher discriminant analysis,FDA)可分性数据融合的检测模型输入变量构建方法。首先,利用高光谱成像技术采集200个马铃薯的高光谱信息,通过对比6种预处理方法和原始数据的建模结果,确定多元散射校正为光谱数据的预处理方法;其次,采用竞争性自适应重加权采样(competitive adaptive reweighted sampling,CARS)、连续投影算法(successive projections algorithm,SPA)及CARS-SPA组合算法3种方法提取相应特征波长,通过对比分析最终确定34个有效特征波长;然后,将有效特征波长进行FDA可分性数据融合,根据融合的新变量对样本间差异性判别能力的大小进行筛选,确定构建检测模型的输入变量;最后,分别对FDA融合前后筛选的变量建立偏最小二乘模型和反向传播神经网络(back propagation neural network,BPNN)模型,并对检测结果进行对比分析。结果表明,将CARS算法提取的34个特征波长进行FDA融合,采用前3个融合变量作为构建检测模型的输入变量时,其所建BPNN模型的相关系数由0.9726提高至0.9990,均方根误差由0.7723降低至0.1727,不仅能够极大地降低数据分析维度,而且能够提高检测结果的准确性。因此,基于FDA可分性数据融合构建检测模型输入变量可以提高马铃薯VC含量检测结果的准确性。

Unsupervised Linear Discriminant Analysis

An algorithm for unsupervised linear discriminant analysis was presented. Optimal unsupervised discriminant vectors are obtained through maximizing covariance of all samples and minimizing covariance of local k-nearest neighbor samples. The experimental results show our algorithm is effective.

三维荧光光谱融合小波包分解融合Fisher判别分析及支持向量机识别紫苏

为实现紫苏品种的快速鉴别,避免以次充好,选取4个品种的紫苏采集三维荧光数据,提出了一种基于小波包分解融合Fisher判别分析(Fisher discriminant analysis,FDA)的荧光数据特征选择策略,并实施了4种紫苏的有效鉴别。首先,对三维荧光数据进行预处理,采用Delaunay三角形内插值法去除瑞利散射和拉曼散射,以消除它们的不利影响;运用Savitzky-Golar卷积平滑对数据进行平滑处理,以减少噪声的干扰。同时,对三维荧光数据进行初步筛选,去除了荧光强度小于0.01的发射波长。然后,对各激发波长对应的发射光谱进行3层sym4小波包分解,计算得到最低频段的小波包能量值,作为各激发波长光谱数据表征量。接着,再利用FDA对小波包能量进行判别分析,将其所包含的差异性信息进行融合,得到FDA生成的新变量,并选取累计判别能力达到99%的前3个FD变量作为不同品种差异性信息的表征变量,提出三维荧光数据的表征策略。最后,利用BP神经网络(backpropagation neural network,BPNN)和支持向量机(support vector machine,SVM)两种模式识别算法对表征变量进行分析,得到FDA+BPNN和FDA+SVM两种鉴别结果。FDA+BPNN的训练集正确率为97.5%,测试集正确率为95%;FDA+SVM的训练集和测试集的正确率均达到98.33%。结果表明,三维荧光光谱技术结合小波包分解、FDA和SVM算法基本上能够实现紫苏品种的鉴别。这为后续有关紫苏的进一步检测研究(如某些有效成分的定量检测)提供了研究基础。

A computer aided detection framework for mammographic images using fisher linear discriminant and nearest neighbor classifier

Today, mammography is the best method for early detection of breast cancer. Radiologists failed to detect evident cancerous signs in approximately 20% of false negative mammograms. False negatives have been identified as the inability of the radiologist to detect the abnormalities due to several reasons such as poor image quality, image noise, or eye fatigue. This paper presents a framework for a computer aided detection system that integrates Principal Component Analysis (PCA), Fisher Linear Discriminant (FLD), and Nearest Neighbor Classifier (KNN) algorithms for the detection of abnormalities in mammograms. Using normal and abnormal mammograms from the MIAS database, the integrated algorithm achieved 93.06% classification accuracy. Also in this paper, we present an analysis of the integrated algorithm’s parameters and suggest selection criteria.

Fisher判别函数在足迹分析性别中的应用

结合脚型性别差异研究,为了选取出足迹上与性别显著相关的特征,以便通过Fisher判别法建立函数模型,本研究测量了共7个与性别显著相关的几何特征,通过T检验和Fisher判别法建立了模型;利用Fisher判别分析建立了典则判别函数和Fisher线性判别函数。实验结果显示,选取的特征对模型影响显著,函数模型预测准确率为92.3%。该判别函数模型可以显著提高足迹分析性别的准确率,可为技术侦查提供帮助。

改进Fisher判别法的突水水源快速判别模型

为快速有效地判别矿井突水水源位置,预防水害事故的发生,根据平煤五矿实际水文地质特征,针对砂岩、太灰和寒灰含水层水质差异性,收集34组水样资料,并选取K^(+)+Na^(+)、Ca^(2+)、Mg^(2+)、SO_(4)^(2-)、Cl^(-)、HCO_(3)^(-)六大常规水化学离子作为判别因子,开展水化学特征分析;结合PCA降维统计算法,建立改进的Fisher水源判别模型,并利用待测样本对比改进前后Fisher模型的判别结果,同时将训练样本回代到改进模型中进行验证。结果表明,根据水化学类型无法准确区分寒灰水与太灰水;利用改进Fisher判别模型测试10组待测样本,判别准确率为100%,相较于基础Fisher模型,准确率提高了20%,应用改进Fisher判别模型可大幅提升水源识别准确率;已知训练样本的回代结果显示,改进Fisher判别结果与实际情况基本吻合。通过2种模型的对比分析,采用改进Fisher模型进行矿井水源识别准确率及可靠性高,具有一定研究价值,可为矿井水源识别提供新的思路。

Analysis and Experiments on Two Linear Discriminant Analysis Methods

Foley-Sammon linear discriminant analysis (FSLDA) and uncorrelated linear discriminant analysis (ULDA) are two well-known kinds of linear discriminant analysis. Both ULDA and FSLDA search the kth discriminant vector in an n-k+1 dimensional subspace, while they are subject to their respective constraints. Evidenced by strict demonstration, it is clear that in essence ULDA vectors are the covariance-orthogonal vectors of the corresponding eigen-equation. So, the algorithms for the covariance-orthogonal vectors are equivalent to the original algorithm of ULDA, which is time-consuming. Also, it is first revealed that the Fisher criterion value of each FSLDA vector must be not less than that of the corresponding ULDA vector by theory analysis. For a discriminant vector, the larger its Fisher criterion value is, the more powerful in discriminability it is. So, for FSLDA vectors, corresponding to larger Fisher criterion values is an advantage. On the other hand, in general any two feature components extracted by FSLDA vectors are statistically correlated with each other, which may make the discriminant vectors set at a disadvantageous position. In contrast to FSLDA vectors, any two feature components extracted by ULDA vectors are statistically uncorrelated with each other. Two experiments on CENPARMI handwritten numeral database and ORL database are performed. The experimental results are consistent with the theory analysis on Fisher criterion values of ULDA vectors and FSLDA vectors. The experiments also show that the equivalent algorithm of ULDA, presented in this paper, is much more efficient than the original algorithm of ULDA, as the theory analysis expects. Moreover, it appears that if there is high statistical correlation between feature components extracted by FSLDA vectors, FSLDA will not perform well, in spite of larger Fisher criterion value owned by every FSLDA vector. However, when the average correlation coefficient of feature components extracted by FSLDA vectors is at a low level, the performance of FSLDA are comparable with ULDA.

An Optimization Criterion for Generalized Marginal Fisher Analysis on Undersampled Problems

Marginal Fisher analysis （MFA） not only aims to maintain the original relations of neighboring data points of the same class but also wants to keep away neighboring data points of the different classes.MFA can effectively overcome the limitation of linear discriminant analysis （LDA） due to data distribution assumption and available projection directions.However,MFA confronts the undersampled problems.Generalized marginal Fisher analysis （GMFA） based on a new optimization criterion is presented,which is applicable to the undersampled problems.The solutions to the proposed criterion for GMFA are derived,which can be characterized in a closed form.Among the solutions,two specific algorithms,namely,normal MFA （NMFA） and orthogonal MFA （OMFA）,are studied,and the methods to implement NMFA and OMFA are proposed.A comparative study on the undersampled problem of face recognition is conducted to evaluate NMFA and OMFA in terms of classification accuracy,which demonstrates the effectiveness of the proposed algorithms.

COMBINATION OF PITCH SYNCHRONOUS ANALYSIS AND FISHER CRITERION FOR SPEAKER IDENTIFICATION

A novel text independent speaker identification system is proposed. In the proposed system, the 12-order perceptual linear predictive cepstrum and their delta coefficients in the span of five frames are extracted from the segmented speech based on the method of pitch synchronous analysis. The Fisher ratios of the original coefficients then be calculated, and the coefficients whose Fisher ratios are bigger are selected to form the 13-dimensional feature vectors of speaker. The Gaussian mixture model is used to model the speakers. The experimental results show that the identification accuracy of the proposed system is obviously better than that of the systems based on other conventional coefficients like the linear predictive cepstral coefficients and the Mel-frequency cepstral coefficients.

BOOTSTRAP TECHNIQUE FOR ROC ANALYSIS: A STABLE EVALUATION OF FISHER CLASSIFIER PERFORMANCE

This paper presents a novel bootstrap based method for Receiver Operating Characteristic (ROC) analysis of Fisher classifier. By defining Fisher classifier’s output as a statistic, the bootstrap technique is used to obtain the sampling distributions of the outputs for the positive class and the negative class respectively. As a result, the ROC curve is a plot of all the (False Positive Rate (FPR), True Positive Rate (TPR)) pairs by varying the decision threshold over the whole range of the boot- strap sampling distributions. The advantage of this method is, the bootstrap based ROC curves are much stable than those of the holdout or cross-validation, indicating a more stable ROC analysis of Fisher classifier. Experiments on five data sets publicly available demonstrate the effectiveness of the proposed method.