视觉刺激条件下的听感差别阈限测量

Measurement on just noticeable difference of auditory perception with visual stimuli

视听交互的重要性日益突出,但视觉刺激对听觉感知的影响尚缺乏全面深入的研究。以视觉刺激下人耳对声音的主观听感差别阈限变化为研究对象,在主观听觉实验中施加颜色、质量、亮度、运动状态四个不同属性视觉刺激,同时测量纯音信号的响度、主观音长和音高的听感差别阈限。通过与无视觉刺激下相应差别阈限的比较,分析不同视觉条件对响度感知、主观音长感知、音高感知能力的影响。实验数据显示,施加视觉刺激后主观听觉感知的差别阈限值增大,主观音长、音高和响度的差别阈限值平均分别提高了45.1%,14.8%和12.3%。进一步分析的结果表明,施加视觉刺激后基本的听觉感知能力呈下降趋势。同一视觉属性的不同水平视觉条件对听觉感知的影响程度不同,主观听感的变化呈现出一定的规律性,即视觉刺激越舒适,听感的差别阈限变化越小。

Though the importance of visual-auditory interaction is increasing, the research on the auditory perception in the multisensory mode is not comprehensive enough. This paper addresses the JND（Just Noticeable Difference） change of auditory perception with synchronous visual stimuli. Through psychoacoustics experiments, loudness JND, subjective duration JND and pitch JND of pure tone were measured in auditory-only mode and visual-auditory mode with different visual stimuli which have different attributes such as color, illumination, quality and moving state. Statistical analyses of the experimental data indicate that, comparing with JND in auditory-only mode, the amount of JND with visual stimuli is often larger. The JND＇s average increment of subjective duration, pitch and loudness are severally 45.1%, 14.8% and 12.3%. The conclusion is that the ability of JND-based auditory perception often decreases with visual stimuli. The incremental amount of JND is significantly effected by the attributes of visual stimuli. If the visual stimuli make subjects feel more comfortable, the JND of auditory perception will change smaller.