沉浸式数字叙事中的视听联觉研究与构建——以宋庆龄与中国福利会相关档案开发实践为例

Sound Design in the Construction of Immersive Digital Narratives ——Taking Song Qingling and China Welfare Institute's Related Archive as an Example

在档案资源开发过程中应用沉浸式数字叙事,可使档案记忆立体化、具象化,实现从物理空间向记忆空间的演变。研究对数字人文视域下的档案资源开发利用实践现状进行回顾,分析目前针对档案资源所进行的沉浸式数字叙事构建的局限,论证基于精细声音设计的沉浸式叙事路径在档案资源开发利用中的可行性。并以宋庆龄与中国福利会的相关档案为对象,探索了基于VR、模拟人声、数字人等多种数字技术、强调声音设计的沉浸式叙事方法。当中虚拟展厅与全景色、无损音效的结合,使档案资源从平面延伸到丰满的立体空间,从而验证了音乐和图像多模态交叉交融的可能性,针对文本所进行的视听联觉研究与构建的尝试,拓展了数字人文研究新领域。

Immersive digital narrative of archival resources accelerates the three-dimensionalization and concreteness of archival memory,realizing the evolution from physical space to memory space.This study reviews the current status of the development and utilization of archival resources from the perspective of digital humanities,analyzes the limitations of the current construction of immersive digital narratives of archival resources,and demonstrates the feasibility of immersive narrative paths based on sophisticated sound design in the development and utilization of archival resources.Taking the relevant archives of Soong Ching Ling and the China Welfare Institute as an example,we synesthetically construct an audio-visual archival immersive narrative method based on multiple state-of-the-art technologies,such as VR,MetaHuman and Mockingbird.It verifies the possibility of multi-modal cross-fertilization of music and image resources.By combining the virtual exhibition hall with panoramic views and lossless sound effects,archival resources and image resources can be extended from a flat space to an infinite three-dimensional space.