融合多头自注意力机制的语音增强方法

Speech enhancement method based on the multi-head self-attention mechanism

由于人类在听觉感知过程中存在掩蔽效应,因此能量高的信号会屏蔽掉其他能量低的信号。受到这一现象启发,结合自注意力方法和多头注意力方法,提出融合多头自注意力机制的语音增强方法。通过对输入的含噪语音特征施加多头自注意力计算,可以使得输入语音特征的干净语音部分和噪声部分有较为明显的区分,从而使得后续的处理能够更有效地抑制噪声。实验结果表明,这种语音增强方法相较于使用门控循环神经网络的语音增强方法,语音增强性能更好,增强语音的语音质量与可懂度更高。

The human ear can only accept one sound signal at one time,and the signal with the highest energy will shield other signals with low energy.According to the above principle,this paper combines the self-attention and the multi-head attention to propose a speech enhancement method based on the multi-head self-attention mechanism.By applying multi-head self-attention calculation to the input noisy speech features,the clean speech part and the noise part of the input speech feature can be clearly distinguished,thereby enabling subsequent processing to suppress noise more effectively.Experimental results show that the proposed method significantly outperforms the method based on the recurrent neural network in terms of both speech quality and intelligibility.