基于ELAN的多模态隐喻中各种模态的耦合分析——以口语诗《广岛》为例

Coupling of Different Modes in Multimodal Metaphors with ELAN:A Case Study of Spoken Word Poetry Hiroshima

文章基于概念隐喻理论,通过ELAN软件对口语诗《广岛》中的话语文本、音韵特征和语伴手势进行了分层标注、统计和分析,研究不同模态如何互动耦合来动态构建多模态隐喻。从统计结果来看,在多模态隐喻构建中,言语、音韵特征和手势基本上同步,实现了时空耦合;言语提供解释,手势形象地表示源域指明动作的产生和结果,音韵特征突出言语的中心内容,三种模态相互作用并贯通成和谐的整体,通过语义耦合和语境耦合形象地揭示了隐喻思维,突出了语篇的主题。

This paper investigates the coupling of different modes in constructing multimodal metaphors in spoken word poetry Hiroshima by means of annotation, statistics and analysis of speech, prosody and gestures with ELAN on the basis of conceptual metaphor theory.Speech and prosody synchronize with gestures to turn for spatiotemporal coupling;the dynamic interaction of the three modes forms a coherent whole in which speech explains metaphors, gestures embody the source domain by describing the action and result, and prosody stresses the key content of the speech.Hence, the semantic coupling and contextual coupling of the three modes reveal the poet ’ s metaphorical thinking and highlight the theme of the poem.