符号的物质性在多模态话语建构中的作用

The Role of Materiality of the Sign in Multimodal Discourse Construction

本研究集中探讨不同类型的符号的物质性对符号意义的贡献。首先探讨了不同类型的符号的物质性,以及这些符号的物质性如何构建了不同层次的符号;然后探讨了符号的物质实体被符号化的过程;最后探讨了不同层次的符号对话语意义的贡献,以及它们是如何建构不同体裁的多模态话语的。本研究发现:本源符号是符号产生的基础;物质实体被符号化要经历被感知、赋予价值、被规约化这几个阶段;根据符号物质性的特点,从本源符号到任意性符号,符号可以分为不同的层次。本源符号可以直接提供全息性、具体、逼真、形象的意义特性;图像符号也具有与此相似的作用;抽象符号可直接提供概括性、框架性意义模式;任意性符号基本上没有可直接提供的意义,而是通过学习和规约化过程来释解符号的意义。希望本研究对于在新媒体和人工智能时代,根据不同的交际目的选择合适的、具有不同物质性的模态及其配置模式以构建不同体裁类型的多模态话语有一定启示。

The present research focuses on the study of the contribution of materiality of different types of signs to their meanings.First,it studies the materiality of different types of signs,and how their materiality contributes to sign formation at different levels;then it investigates the process of how the material entity of signs is semiotized;and finally,it probes into the contribution of signs at different levels to the construction of the meaning of discourse and that of multimodal discourse of different genres.It is found that the ontological sign is the basis of sign formation,and the semiotization of the material entity goes through several stages:being perceived,valued and conventionalized.According to the materiality of signs,they can be classified into different levels,from the ontological sign to the arbitrary one.The ontological sign can directly provide holographic,concrete,realistic,and vivid semantic characteristics;the image sign has the same function;the abstract sign can directly provide general and schematic semantic patterns;and the arbitrary sign basically has no direct connection with its meaning(signified),but can be acquired by learning and conventionalization.We hope that in this new media and AI era,it can throw light on the choice of the appropriate modes of different materiality according to different communicative purposes and their arrangements and integration to construct discourses of different genres.