基于QRNN-CTC的中文语音识别声学模型

CHINESE SPEECH RECOGNITION ACOUSTIC MODEL BASED ON QRNN-CTC

针对卷积神经网络(CNN)在语音识别中处理时序能力不足和循环神经网络(RNN)在语音识别中模型复杂度较高、训练慢的问题,提出一种新的基于准循环神经网络和连接时序主义(QRNN-CTC)的声学模型。该模型既降低了参数量,又保证了一定的时序间循环能力,利用CTC来实现输入序列和标签自动对齐,在训练时引入dropout防止过拟合。在Thchs-30数据集上的实验结果表明,QRNN-CTC比CNN-CTC相对错误率降低9.8%,最终词错误率为23.8%,训练时间为LSTM-CTC的一半。

Aimed at the problem of insufficient processing time sequence ability of convolutional neural network(CNN)in speech recognition and high model complexity and difficulty of training in recurrent neural network(RNN)in speech recognition,a new kind of quasi-recurrent neural network and connectionist temporal classification(QRNN-CTC)acoustic model is proposed.It not only reduced the numbers of parameters but also ensured a certain cycle capability between time series.CTC was used to realize automatic alignment of input sequence and label,and dropout was introduced to prevent overfitting during training.The experimental results on the Thchs-30 dataset show that QRNN-CTC has a relative error rate of 9.8% lower than that of CNN-CTC,and the final word error rate is 23.8%,and the training time is half of LSTM-CTC.