Improved hidden Markov model for speech recognition and POS tagging

In order to overcome defects of the classical hidden Markov model (HMM), Markov family model (MFM), a new statistical model was proposed. Markov family model was applied to speech recognition and natural language processing. The speaker independently continuous speech recognition experiments and the part-of-speech tagging experiments show that Markov family model has higher performance than hidden Markov model. The precision is enhanced from 94.642% to 96.214% in the part-of-speech tagging experiments, and the work rate is reduced by 11.9% in the speech recognition experiments with respect to HMM baseline system.

Robust Speech Recognition System Using Conventional and Hybrid Features of MFCC,LPCC,PLP,RASTA-PLP and Hidden Markov Model Classifier in Noisy Conditions

In recent years, the accuracy of speech recognition (SR) has been one of the most active areas of research. Despite that SR systems are working reasonably well in quiet conditions, they still suffer severe performance degradation in noisy conditions or distorted channels. It is necessary to search for more robust feature extraction methods to gain better performance in adverse conditions. This paper investigates the performance of conventional and new hybrid speech feature extraction algorithms of Mel Frequency Cepstrum Coefficient (MFCC), Linear Prediction Coding Coefficient (LPCC), perceptual linear production (PLP), and RASTA-PLP in noisy conditions through using multivariate Hidden Markov Model (HMM) classifier. The behavior of the proposal system is evaluated using TIDIGIT human voice dataset corpora, recorded from 208 different adult speakers in both training and testing process. The theoretical basis for speech processing and classifier procedures were presented, and the recognition results were obtained based on word recognition rate.

MANDARIN TONE RECOGNITION BASED ON WAVELET TRANSFORM AND HIDDEN MARKOV MODELING

This paper presents a method of tone recognition for Mandarin speech by using combination of wavelet transform and hidden Markov modeling techniques. A pitch detector based on singularity detection and multi-resolution analysis of wavelet transform is employed for estimation of pitch periods, and hidden Markov modeling with partition Gaussian mixtures probability density function is used for the tone recognition. The algorithm can provide recognition accuracy of 97.22% and 94.47% for speaker-dependent and speaker-independent tone recognition, respectively.

Fault Pattern Recognition Based on Hidden Markov Model

Because performance parameters of gear have degradation,a method is proposed to recognize and analyze its faults using the hidden Markov model( HMM). In this method,firstly,the delayed correlation-envelope method is used to extract features from vibration signals. Then,HMMs are trained respectively using data under normal condition,gear root crack condition and gear root breaking condition. Further,the trained HMMs are used in pattern recognition and model assessment. Finally,the results from standard HMM and the proposed method are compared, which shows that the proposed methodology is feasible and effective.

Heart Murmur Recognition Based on Hidden Markov Model

Heart murmur recognition and classification play an important role in the auscultative diagnosis. The method based on hidden markov model (HMM) was presented to recognize the heart murmur. The murmur was isolated on basis of the principle of wavelet analysis considering the time-frequency characteristics of the heart murmur. This method uses Mel frequency cepstral coefficient (MFCC) to extract representative features and develops hidden Markov model (HMM) for signal classification. The result shows that this method?is able to recognize the murmur efficiently and superior to BP?neural network (94.2% vs 82.8%). And the findings suggest that the method may have the potential to be used to assist doctors for a more objective diagnosis.

Multi-modal Gesture Recognition using Integrated Model of Motion, Audio and Video

Gesture recognition is used in many practical applications such as human-robot interaction, medical rehabilitation and sign language. With increasing motion sensor development, multiple data sources have become available, which leads to the rise of multi-modal gesture recognition. Since our previous approach to gesture recognition depends on a unimodal system, it is difficult to classify similar motion patterns. In order to solve this problem, a novel approach which integrates motion, audio and video models is proposed by using dataset captured by Kinect. The proposed system can recognize observed gestures by using three models. Recognition results of three models are integrated by using the proposed framework and the output becomes the final result. The motion and audio models are learned by using Hidden Markov Model. Random Forest which is the video classifier is used to learn the video model. In the experiments to test the performances of the proposed system, the motion and audio models most suitable for gesture recognition are chosen by varying feature vectors and learning methods. Additionally, the unimodal and multi-modal models are compared with respect to recognition accuracy. All the experiments are conducted on dataset provided by the competition organizer of MMGRC, which is a workshop for Multi-Modal Gesture Recognition Challenge. The comparison results show that the multi-modal model composed of three models scores the highest recognition rate. This improvement of recognition accuracy means that the complementary relationship among three models improves the accuracy of gesture recognition. The proposed system provides the application technology to understand human actions of daily life more precisely.

Compound Hidden Markov Model for Activity Labelling

This research presents a novel way of labelling human activities from the skeleton output computed from RGB-D data from vision-based motion capture systems. The activities are labelled by means of a Compound Hidden Markov Model. The linkage of several Linear Hidden Markov Models to common states, makes a Compound Hidden Markov Model. Each separate Linear Hidden Markov Model has motion information of a human activity. The sequence of most likely states, from a sequence of observations, indicates which activities are performed by a person in an interval of time. The purpose of this research is to provide a service robot with the capability of human activity awareness, which can be used for action planning with implicit and indirect Human-Robot Interaction. The proposed Compound Hidden Markov Model, made of Linear Hidden Markov Models per activity, labels activities from unknown subjects with an average accuracy of 59.37%, which is higher than the average labelling accuracy for activities of unknown subjects of an Ergodic Hidden Markov Model (6.25%), and a Compound Hidden Markov Model with activities modelled by a single state (18.75%).

Driving intention recognition and behaviour prediction based on a double-layer hidden Markov model

We propose a model structure with a double-layer hidden Markov model (HMM) to recognise driving intention and predict driving behaviour. The upper-layer multi-dimensional discrete HMM (MDHMM) in the double-layer HMM represents driving intention in a combined working case, constructed according to the driving behaviours in certain single working cases in the lower-layer multi-dimensional Gaussian HMM (MGHMM). The driving behaviours are recognised by manoeuvring the signals of the driver and vehicle state information, and the recognised results are sent to the upper-layer HMM to recognise driving intentions. Also, driving behaviours in the near future are predicted using the likelihood-maximum method. A real-time driving simulator test on the combined working cases showed that the double-layer HMM can recognise driving intention and predict driving behaviour accurately and efficiently. As a result, the model provides the basis for pre-warning and intervention of danger and improving comfort performance.

Tandem hidden Markov models using deep belief networks for offline handwriting recognition

Unconstrained offiine handwriting recognition is a challenging task in the areas of document analysis and pattern recognition. In recent years, to sufficiently exploit the supervisory information hidden in document images, much effort has been made to integrate multi-layer perceptrons （MLPs） in either a hybrid or a tandem fashion into hidden Markov models （HMMs）. However, due to the weak learnability of MLPs, the learnt features are not necessarily optimal for subsequent recognition tasks. In this paper, we propose a deep architecture-based tandem approach for unconstrained offiine handwriting recognition. In the proposed model, deep belief networks arc adopted to learn the compact representations of sequential data, while HMMs are applied for （sub-）word recognition. We evaluate the proposed model on two publicly available datasets, i.e., RIMES and IFN/ENIT, which are based on Latin and Arabic languages respectively, and one dataset collected by ourselves called Devanagari （all Indian script）. Extensive experiments show the advantage of the proposed model, especially over the MLP-HMMs taudem approaches.

Bi-dimension decomposed hidden Markov models for multi-person activity recognition

We present a novel model for recognizing long-term complex activities involving multiple persons. The proposed model, named ‘decomposed hidden Markov model’ (DHMM), combines spatial decomposition and hierarchical abstraction to capture multi-modal, long-term dependent and multi-scale characteristics of activities. Decomposition in space and time offers conceptual advantages of compaction and clarity, and greatly reduces the size of state space as well as the number of parameters. DHMMs are efficient even when the number of persons is variable. We also introduce an efficient approximation algorithm for inference and parameter estimation. Experiments on multi-person activities and multi-modal individual activities demonstrate that DHMMs are more efficient and reliable than familiar models, such as coupled HMMs, hierarchical HMMs, and multi-observation HMMs.

Hidden Markov Models for Automatic Speech Recognition

In this paper the authors look into the problem of Hidden Markov Models （HMM）： the evaluation, the decoding and the learning problem. The authors have explored an approach to increase the effectiveness of HMM in the speech recognition field. Although hidden Markov modeling has significantly improved the performance of current speech-recognition systems, the general problem of completely fluent speaker-independent speech recognition is still far from being solved. For example, there is no system which is capable of reliably recognizing unconstrained conversational speech. Also, there does not exist a good way to infer the language structure from a limited corpus of spoken sentences statistically. Therefore, the authors want to provide an overview of the theory of HMM, discuss the role of statistical methods, and point out a range of theoretical and practical issues that deserve attention and are necessary to understand so as to further advance research in the field of speech recognition.

Statistical Model-Based Driving Situation Recognition

The authors propose a two-stage method for recognizing driving situations on the basis of driving signals for application to a safe human interface of an in-vehicle information system. In first stage, an unknown driving situation is determined as stopping behavior or non-stopping behavior. In second stage, a Hidden Markov Model （HMM）-based pattern recognition method is used to model and recognize six non-stopping driving situations. The authors attempt to find the optimal HMM configuration to improve the performance of driving situation recognition. Center for Integrated Acoustic Information Research （CLAIR） in-vehicle corpus is used to evaluate the HMM-based recognition method. Driving situation categories are recognized using five driving signals. The proposed method achieves a relative error reduction rate of 30.9% compared to a conventional one-stage based HMMs.

Subspace Distribution Clustering HMM for Chinese Digit Speech Recognition

As a kind of statistical method, the technique of Hidden Markov Model （HMM） is widely used for speech recognition. In order to train the HMM to be more effective with much less amount of data, the Subspace Distribution Clustering Hidden Markov Model （SDCHMM）, derived from the Continuous Density Hidden Markov Model （CDHMM）, is introduced. With parameter tying, a new method to train SDCHMMs is described. Compared with the conventional training method, an SDCHMM recognizer trained by means of the new method achieves higher accuracy and speed. Experiment results show that the SDCHMM recognizer outperforms the CDHMM recognizer on speech recognition of Chinese digits.

基于量子粒子群优化Volterra时域核辨识的隐Markov模型识别方法

将量子粒子群优化算法引入Volterra级数模型的非线性辨识中,并结合隐Markov模型(hidden Markov model,HMM),提出了一种基于量子粒子群优化的Volterra时域核特征提取的HMM识别方法,在提出的方法中,利用量子粒子群优化算法辨识得到的前三阶Volterra时域核作为故障特征,输入到各种状态的HMM中,其中,输出概率最大的HMM对应的状态即为设备的当前运行状态。提出的方法克服了传统的基于Volterra模型系统的机械故障诊断要求目标函数连续可导、容易陷入局部最小以及抗干扰能力差等缺陷。最后,将提出的方法应用到旋转机械故障诊断中。实验结果验证了该方法的有效性。

人脸识别中嵌入式隐Markov模型结构的优化算法研究

提出了一种优化嵌入式隐Markov模型状态数的搜索算法,并且由此算法得到改进的嵌入式隐Markov模型结构。实验证明,这种结构既能提高人脸的识别率,最高可达到100%,又比传统的结构减少30%左右的训练时间和识别时间。

主分量分析和因子隐Markov模型在机械故障诊断中的应用

主分量分析(principalcomponentanalysis,PCA)是统计学中分析数据的一种有效方法,可以将高维数据空间变换到低维特征空间,因而可用于多通道冗余消除和特征提取。因子隐Markov模型是隐Markov模型的扩展,它比隐Mark-ov模型更有优势,适用于动态过程时间序列的建模,并具有强大的时序模型分类能力,特别适合非平稳、信号特征重复再现性不佳的信号分析。文中结合主分量分析与因子隐Markov模型,提出一种新的故障识别方法,即以主分量分析方法进行冗余消除和故障特征提取,因子隐Markov模型作为分类器。并应用到机械故障诊断中,同时与基于主分量分析的隐Markov模型的识别方法相比较,实验结果表明基于PCA的因子隐Markov模型识别法和基于PCA的隐Markov模型识别法在故障识别上都是有效的,但对于相同的状态空间,前者的训练速度快于后者,尤其是状态空间越大,这种优势越明显。

基于非线性时序模型盲辨识的因子隐Markov模型识别方法

基于模型辨识的机械有效故障特征提取方法中输入信号难以确定,以及机械设备运行过程中具有信息量大、非平稳、特征重复再现性差的特点,结合非线性时序模型盲辨识和因子隐Markov模型,提出一种基于非线性时序模型盲辨识的特征提取的因子隐Markov模型识别方法,并应用到旋转机械升降速过程故障诊断中。同时还与基于Fourier变换、小波变换的特征提取的因子隐Markov模型识别方法进行比较,试验结果表明该方法是有效的。

分层隐Markov模型在设备状态识别中的应用研究

与传统的隐Markov模型(HMM)相比较而言,应用分层隐Markov模型(HHMM)对设备进行状态识别有诸多优点,而且能以概率的形式更为精确地计算识别结果。针对模型参数随着设备状态的增加呈指数倍增这一问题,引入动态贝叶斯网络这一新的方法,由于该方法可以有效地降低模型的计算复杂度并缩短推理时间,所以将HHMM表达为动态贝叶斯网络,利用预处理的振动信号对设备的健康状态进行识别;针对现有状态分类方法的局限性,提出了基于K均值算法和交叉验证方法相结合的状态数优化方法;以齿轮箱全寿命实验为依据,对该模型实现状态识别的基本框架和计算过程进行了研究,研究结果为复杂设备的状态识别提供了新的思路。

基于无限因子隐Markov模型的旋转机械故障识别方法

在机械故障识别方面,因子隐Markov模型是目前常用的识别工具。无限因子隐Markov模型(IFHMM)是因子隐Markov模型(FHMM)的一种扩展形式,克服了因子隐Markov模型链条数往往事先假定的缺点。本研究将无限因子隐Markov模型(IFHMM)运用到旋转机械的升降速过程故障的诊断当中,提出了使用IFHMM作为诊断工具的旋转机械故障诊断方法,并与基于因子隐Markov模型的旋转机械故障诊断方法进行了对比,最后将提出的方法成功地应用到旋转机械的故障中。实验结果表明,提出的方法明显优于FHMM识别方法。