摘要
McGurk效应(麦格克效应)是典型的视听整合现象,该效应受到刺激的物理特征、注意分配、个体视听信息依赖程度、视听整合能力、语言文化差异的影响。引发McGurk效应的关键视觉信息主要来自说话者的嘴部区域。产生McGurk效应的认知过程包含早期的视听整合(与颞上皮层有关)以及晚期的视听不一致冲突(与额下皮层有关)。未来研究应关注面孔社会信息对McGurk效应的影响,McGurk效应中单通道信息加工与视听整合的关系,结合计算模型探讨其认知神经机制等。
The McGurk effect is a typical audiovisual integration phenomenon,influenced by characteristics of physical stimuli,attentional allocation,the extent that individuals rely on visual or auditory information in processing,the ability of audiovisual integration,and language/culture differences.Key visual information that leads to the McGurk effect is mainly extracted from the mouth area of the talker.The McGurk effect implicates both audiovisual integration(which occurs in the early processing stage and is related to the activation of superior temporal cortex)and the conflict of the incongruent audiovisual stimuli(which occurs in the late processing stage and is related to the activation of inferior frontal cortex).Future studies should further investigate the influence of social factors on the McGurk effect,pay attention to the relationship between unimodal information processing and audiovisual integration in the McGurk effect,and explore the neural mechanisms of McGurk effect with computational modeling.
作者
罗霄骁
康冠兰
周晓林
LUO Xiaoxiao;KANG Guanlan;ZHOU Xiaolin(School of Psychological and Cognitive Sciences,Peking University,Beijing,100871,China;Key Laboratory of Machine Perception(Ministry of Education),Peking University,Beijing 100871,China;PKU-IDG/McGovern Institute for Brain Research,Peking University,Beijing 100871,China;Institute of Psychological and Brain Sciences,Zhejiang Normal University,Jinhua 321004,China)
出处
《心理科学进展》
CSSCI
CSCD
北大核心
2018年第11期1935-1951,共17页
Advances in Psychological Science
基金
国家自然科学基金面上项目(31470976)
科技部973项目(2015CB856400)
机器感知与智能教育部重点实验室开放课题基金项目(K-2017-05)。
关键词
McGurk效应
视听言语感知
视听整合
多感觉整合
McGurk effect
audiovisual speech perception
audiovisual integration
multisensory integration