声音渲染技术及其在虚拟环境中的应用

Sound Rendering Technology and its Application in Virtual Environment

在虚拟现实和分布交互仿真应用中，为增加参与者或观察者的沉浸感，生成多维的感官信息（ 如视觉、听觉、触觉以及动感等信息） 更能符合人的生理和心理感知。本文论述了虚拟环境中的声音渲染技术。首先从声音的传播和人的感知角度，论述了声音渲染的数学模型，然后论述了其研究内容和实现的关键技术，如声音的建模分析、三维空间定位、距离感知、与图象信息的融合以及声音渲染的验证等。文章最后给出了用于虚拟座舱的一种声音渲染方案。

The immersion of the participator or viewer in virtual environment can be enhanced greatly if their visual,auditory,tactile and other sensory organs are stimulated simultaneously. This paper addresses issues of the sound rendering technology providing the auditory cue,particularly the real time digital acoustic synthesis for reproduction via headphone. Based on the sound's propagation and the human's psychoacoustics,a mathematical model has been made to explain the principle of real time three dimensional sound synthesis and manipulation. The analysis and modeling of the sound is the first step for synthesis,an interactive,real time ability to spatialize the sound and simulate the distance is essential,the fusion between the audio and other (primarily visual) modality contexts can enhance the immersion and imagination. The paper includes an application example in a form of the real time digital acoustic synthesis for the virtual cockpit. The off line work and the real time pipeline procedure are described.