谈多模态小品中的主体模态

On Chief Modals of Multi-Modal Short Essays

多模态性的研究旨在说明人们在表达意义时对不同符号特性的掌握和运用,以及对不同符号体系之间相互关系的了解。随着计算科学的发展,多模态小品在本世纪开始流传。所谓多模态小品,是作者借用"小品文"的概念命名的,即生动活泼的说理抒情的短篇散文或作品,但它是多模态的。这些小品中的模态有不同的组合,如文字、乐曲、图象、动作。对同一语篇意义的表达可以采用不同模态。这些模态可以分别使用,也可以同步使用。在多种模态同步使用的情况下,其中一至二种模态是主体的,其余模态起陪衬作用。人们从一种模态发展为更多地使用另一种模态,这与社会进程是分不开的。

The study of multi-modality aims at describing how people manipulate different symbolic features when expressing their meanings and how they understand the correlation between various symbolic systems. With the progress of computing sci- ence, the multi-modal short essay has become popular in this century. By multi-modal essays, the author refers to vivid and short lyric essays or other sketches, provided that they are multi-modal. The modals in such essays may be different composi- tions of written language, music, images or actions. To express the meaning of the same text, different modals may be adopt- ed. These modals may be used separately or synchronically. In the use of many modals, one or two modals are principal while the others are secondary. People have developed from one modal to the use of another, which is closely related to social progress.