语前聋成人在不同语言熟悉度下的语音视觉感知策略分析

An Analysis of Visual Attention Allocation Strategies of Prelingually Deaf Adults in Speech Perception with Different Language Familiarities

本文运用眼动跟踪技术,对比了以汉语普通话为第一口语语言的语前聋成人和健听人在不同语言熟悉度(普通话、信阳方言)和任务条件(聆听任务、判断任务)下语音视听感知的视觉注意分配策略。结果发现,两类被试在语音视听感知活动中采用了不同的视觉注意分配模式:健听人将更多视觉注意资源分配到话者眼部信息区,但也会根据对象语言和任务对视觉注意分配策略加以灵活调整;相较之下,语前聋人被试在不同对象语言和任务条件下都将更多注意资源投入到话者嘴部信息区,视觉注意分配策略较为固定。据此结果,本文在前人研究结果的基础上进一步发展了“语前聋人视觉依赖的语音感知假设”,认为语前聋人在口语语音视听感知活动中,以牺牲社交情感信息为代价,将视觉注意集中于嘴部信息区以最大限度地获取语音视觉线索。

Using eye-tracking technology,this study compares the visual attention allocation strategies adopted by hearing and prelingually deaf people who are using Standard Chinese as their first oral language in audiovisual speech perception in different language familiarities(Standard Chinese,Xinyang dialect)and task conditions(listening task,judgment task).The results show that hearing people differ from their prelingually deaf counterparts in the mode of visual attention allocation:the hearing people mainly gaze at the speaker's eyes,and yet they are flexible in adjusting their visual attention resources according to language familiarity and task;in contrast,the prelingually deaf adults dominantly allocate their attention resources to the speaker’s mouth in all conditions.Based on the results in this study as well as in previous studies,we have developed the hypothesis of“visual-dependent speech perception in the prelingually deaf people”,which proposes that,in audiovisual speech perception prelingually deaf people concentrate their visual attention on the speaker’s mouth at the expense of social affective information to maximize the use of voice visual cues.