基于深度学习的对话重叠语音片段检测

Detecting Overlapping Speech Segments in Conversations Using Deep Learning

为改进在真实对话中分割重叠语音的自然事件,训练一个深度卷积神经网络(DCNN),使用来自单声道音频的级别相对较低的对数标度梅尔频谱图进行端到端的学习.使用Fisher英语语料库的真实会话数据正确训练DCNN,同时保持并测试其对普通会话场景的普遍性.为了缓解严重的类失衡,在训练集中采取消除静音,并在训练过程中对占比重较多的类进行统一随机抽样.同时,使用维特比算法执行时间平滑以增强最终分割.在超过91 h的对话中,检测精度超过60%,召回率超过29%,证明了深度学习对于这项任务的适用性.

To improve the segmenting natural occurrences of overlapping speech in real conversations,a ceep convolutional neural network(DCNN)was trained.It used relatively low-level log-scaled Mel-spectrograms from mono-aural audio to end-to-end learning.The DCNN was properly trained by using the real conversational data from the Fisher English Corpus while maintaining and testing its generalizability to real conversational scenarios.To alleviate the imposed challenge of severe class-imbalance,the silence was removed from the training objective and the majority class was randomly sampled during training.Simultaneously,using the Viterbi algorithm to perform temporal smoothing which enhanced the final segmentation.Over 60%precision and over 29%recall rate in over 91 h of conversations demonstrate the applicability of deep learning to this task.