句子理解中颜色信息的心理表征

The Mental Representation of Color Information in Sentence Comprehension

采用混合实验设计、实时和事后的句子-图片匹配范式,以隐含物体典型颜色和非典型颜色信息的句子为实验材料,以被试对图片的反应时间和阅读时间为因变量指标,通过不同时间间隔的设置以及不同的实验程序,探讨了句子理解中静态和动态颜色信息心理表征的特点。结果表明:(1)在加工时间有限的情况下,两个加工任务是否竞争相同的认知资源是造成句-图范式下匹配易化和不匹配易化的关键因素。(2)对于句子隐含的静态颜色信息,大脑对典型颜色信息的心理表征具有即时性和局部性,而对非典型颜色信息的心理表征还具有非局部性的特点。(3)对于句子隐含的动态颜色信息,大脑不能对其进行即时的心理表征,这种动态颜色信息的心理表征是在句子阅读晚期发生的。

The mental representation of implicit color information during sentence comprehension remained to be answered in embodied cognition. In the current study, we adopted a sentence–picture matching paradigm with different settings of temporal intervals and sentences containing typical and atypical color information to address the question. A hundred and three college students with normal vision participated, with thirty-eight in Experiment 1, twenty-one in Experiment 2 and forty-four in Experiment 3. In Experiment 1, we determined the process of mental representation of color after sentence integration. In each trial, a sentence that implied a particular color for a given object was first presented, followed by an interval （0 ms or 1500 ms）, then an object either matched or mismatched to the implied color appeared. Participants were required to judge whether the pictured object was mentioned in the preceding sentence or not and reaction time was registered. In Experiment 2, online measure was adopted to explore whether the mental representation of static color occurs immediately and locally during sentence processing. Subjects were required to self-regulate their readings by pressing the Space key if they finish one word, which will also terminate the presentation of the current word and initiate next word. The object words were replaced by a picture. After finishing one sentence, subjects should make a sensibility judgment on it. In Experiment 3, offline measure （identical to Experiment 1） was adopted to explore the mental representation of dynamic color information. The sentences included two types： one changes typical color to atypical and the other reversed. Participants were required to judge whether the pictured object was mentioned in the preceding sentence. Experiment 1 is a 2 colors × 2 intervals × 2 picture condition mixed design; Experiment 2 is a 2 colors × 2 picture condition within-subjects design; Experiment 3 is a 2 colors × 2 intervals × 2 picture condition mixed design. All the data were analyzed with repeated-measure MANOVA. In Experiment 1, response time was shorter in the mismatched condition than that in the matched condition, at the earlier period of sentence comprehension （interval of 0 ms）; the result was reversed at the later period （interval of 1500 ms）. In Experiment 2, the reading time was shorter for the picture in the mismatched condition. For the first word following the picture object, there was a mis-match facilitation in the atypical color condition. In Experiment 3, when the sentence implied typical color, response time was shorter in the matched condition as opposed to that in the mismatched condition at the later period of sentence comprehension. Our findings provide abundant evidence for how the implicit perceptual information on object color is represented during sentence comprehension. Together with other empirical findings, the current study indicates： （1） Under time-limited condition, the appearance of matched or mismatched facilitation depends on whether the two tasks compete for common cognitive resource; （2） The representation of implicit static typical color information is an immediate and local phenomenon. On the contrary, the representation of implicit static atypical color information is an immediate but non-local phenomenon; （3） The dynamic color information could not be immediately represented at the early period of sentence comprehension, only the dynamic typical color information could be represented at the later period of sentence comprehension.