A Long Short-Term Memory(LSTM) Recurrent Neural Network(RNN) has driven tremendous improvements on an acoustic model based on Gaussian Mixture Model(GMM). However, these models based on a hybrid method require a force...A Long Short-Term Memory(LSTM) Recurrent Neural Network(RNN) has driven tremendous improvements on an acoustic model based on Gaussian Mixture Model(GMM). However, these models based on a hybrid method require a forced aligned Hidden Markov Model(HMM) state sequence obtained from the GMM-based acoustic model. Therefore, it requires a long computation time for training both the GMM-based acoustic model and a deep learning-based acoustic model. In order to solve this problem, an acoustic model using CTC algorithm is proposed. CTC algorithm does not require the GMM-based acoustic model because it does not use the forced aligned HMM state sequence. However, previous works on a LSTM RNN-based acoustic model using CTC used a small-scale training corpus. In this paper, the LSTM RNN-based acoustic model using CTC is trained on a large-scale training corpus and its performance is evaluated. The implemented acoustic model has a performance of 6.18% and 15.01% in terms of Word Error Rate(WER) for clean speech and noisy speech, respectively. This is similar to a performance of the acoustic model based on the hybrid method.展开更多
This study deals with the neuro-fuzzy (NF) modelling of a real industrial winding process in which the acquired NF model can be exploited to improve control performance and achieve a robust fault-tolerant system. A ne...This study deals with the neuro-fuzzy (NF) modelling of a real industrial winding process in which the acquired NF model can be exploited to improve control performance and achieve a robust fault-tolerant system. A new simulator model is proposed for a winding process using non-linear identification based on a recurrent local linear neuro-fuzzy (RLLNF) network trained by local linear model tree (LOLIMOT), which is an incremental tree-based learning algorithm. The proposed NF models are compared with other known intelligent identifiers, namely multilayer perceptron (MLP) and radial basis function (RBF). Comparison of our proposed non-linear models and associated models obtained through the least square error (LSE) technique (the optimal modelling method for linear systems) confirms that the winding process is a non-linear system. Experimental results show the effectiveness of our proposed NF modelling approach.展开更多
A realistic model of neural networks was proposed in this paper.The dynamicprocess of neural impulse discharging was considered.The equations of the model correspondto postsynaptic potentials,receptor potentials,initi...A realistic model of neural networks was proposed in this paper.The dynamicprocess of neural impulse discharging was considered.The equations of the model correspondto postsynaptic potentials,receptor potentials,initial segment graded potentials and the impulsetrain along the axon respectively.To solve the equations numerically,a recurrent algorithm and itscorresponding flow chart was also developed.The simulation results can imitate adaptation,post-excitation inhibition,and phase locking of sensory receptors;they can also imitate the transientresponses of lateral inhibitory network and Mach band phenomenon when they trended to besteady.The simulation results also showed that the lateral inhibitory network was sensitive tomoving objects.展开更多
This work concerns the study of problems relating to the adaptive internal model control of DC motor in both cases conventional and neural. The most important aspects of design building blocks of adaptive internal mod...This work concerns the study of problems relating to the adaptive internal model control of DC motor in both cases conventional and neural. The most important aspects of design building blocks of adaptive internal model control are the choice of architectures, learning algorithms, and examples of learning. The choice of parametric adaptation algorithm for updating elements of the conventional adaptive internal model control shows limitations. To overcome these limitations, we chose the architectures of neural networks deduced from the conventional models and the Levenberg-marquardt during the adjustment of system parameters of the adaptive neural internal model control. The results of this latest control showed compensation for disturbance, good trajectory tracking performance and system stability.展开更多
基金supported by the Ministry of Trade,Industry & Energy(MOTIE,Korea) under Industrial Technology Innovation Program (No.10063424,'development of distant speech recognition and multi-task dialog processing technologies for in-door conversational robots')
文摘A Long Short-Term Memory(LSTM) Recurrent Neural Network(RNN) has driven tremendous improvements on an acoustic model based on Gaussian Mixture Model(GMM). However, these models based on a hybrid method require a forced aligned Hidden Markov Model(HMM) state sequence obtained from the GMM-based acoustic model. Therefore, it requires a long computation time for training both the GMM-based acoustic model and a deep learning-based acoustic model. In order to solve this problem, an acoustic model using CTC algorithm is proposed. CTC algorithm does not require the GMM-based acoustic model because it does not use the forced aligned HMM state sequence. However, previous works on a LSTM RNN-based acoustic model using CTC used a small-scale training corpus. In this paper, the LSTM RNN-based acoustic model using CTC is trained on a large-scale training corpus and its performance is evaluated. The implemented acoustic model has a performance of 6.18% and 15.01% in terms of Word Error Rate(WER) for clean speech and noisy speech, respectively. This is similar to a performance of the acoustic model based on the hybrid method.
文摘This study deals with the neuro-fuzzy (NF) modelling of a real industrial winding process in which the acquired NF model can be exploited to improve control performance and achieve a robust fault-tolerant system. A new simulator model is proposed for a winding process using non-linear identification based on a recurrent local linear neuro-fuzzy (RLLNF) network trained by local linear model tree (LOLIMOT), which is an incremental tree-based learning algorithm. The proposed NF models are compared with other known intelligent identifiers, namely multilayer perceptron (MLP) and radial basis function (RBF). Comparison of our proposed non-linear models and associated models obtained through the least square error (LSE) technique (the optimal modelling method for linear systems) confirms that the winding process is a non-linear system. Experimental results show the effectiveness of our proposed NF modelling approach.
基金Supported by National Natural Science Foundation of China
文摘A realistic model of neural networks was proposed in this paper.The dynamicprocess of neural impulse discharging was considered.The equations of the model correspondto postsynaptic potentials,receptor potentials,initial segment graded potentials and the impulsetrain along the axon respectively.To solve the equations numerically,a recurrent algorithm and itscorresponding flow chart was also developed.The simulation results can imitate adaptation,post-excitation inhibition,and phase locking of sensory receptors;they can also imitate the transientresponses of lateral inhibitory network and Mach band phenomenon when they trended to besteady.The simulation results also showed that the lateral inhibitory network was sensitive tomoving objects.
文摘This work concerns the study of problems relating to the adaptive internal model control of DC motor in both cases conventional and neural. The most important aspects of design building blocks of adaptive internal model control are the choice of architectures, learning algorithms, and examples of learning. The choice of parametric adaptation algorithm for updating elements of the conventional adaptive internal model control shows limitations. To overcome these limitations, we chose the architectures of neural networks deduced from the conventional models and the Levenberg-marquardt during the adjustment of system parameters of the adaptive neural internal model control. The results of this latest control showed compensation for disturbance, good trajectory tracking performance and system stability.
