摘要
This paper reports the recent works and progress on a PC and C++ language-based virtual auditory environment(VAE) system platform.By tracing the temporary location and orientation of listener's head and dynamically simulating the acoustic propagation from sound source to two ears,the system is capable of recreating free-field virtual sources at various directions and distances as well as auditory perception in reflective environment via headphone presentation.Schemes for improving VAE performance,including PCA-based(principal components analysis) near-field virtual source synthesis,simulating six degrees of freedom of head movement,are proposed.Especially,the PCA-based scheme greatly reduces the computational cost of multiple virtual sources synthesis.Test demonstrates that the system exhibits improved performances as compared with some existing systems.It is able to simultaneously render up to 280 virtual sources using conventional scheme,and 4500 virtual sources using the PCA-based scheme.A set of psychoacoustic experiments also validate the performance of the system,and at the same time,provide some preliminary results on the research of binaural hearing.The functions of the VAE system is being extended and the system serves as a flexible and powerful platform for future binaural hearing researches and virtual reality applications.
This paper reports the recent works and progress on a PC and C++ language-based virtual auditory environment (VAE) system platform. By tracing the temporary location and orientation of listener's head and dynamically simulating the acoustic propagation from sound source to two ears, the system is capable of recreating free-field virtual sources at various directions and distances as well as auditory perception in reflective environment via headphone presentation. Schemes for improving VAE performance, including PCA-based (principal components analysis) near-field virtual source synthesis, simulating six degrees of freedom of head movement, are proposed. Especially, the PCA-based scheme greatly reduces the computational cost of multiple virtual sources synthesis. Test demonstrates that the system exhibits improved performances as compared with some existing systems. It is able to simultaneously render up to 280 virtual sources using conventional scheme, and 4500 virtual sources using the PCA-based scheme. A set of psychoacoustic experiments also validate the performance of the system, and at the same time, provide some preliminary results on the research of binaural hearing. The functions of the VAE system is being extended and the system serves as a flexible and powerful platform for future binaural hearing researches and virtual reality applications.
基金
supported by the National Natural Science Foundation of China(11174087,10774049)
State Key Laboratory of Subtropical Building Science,South China University of Technology
关键词
动态虚拟
听觉感知
系统
平台
实时渲染
环境
虚拟现实技术
动态模拟
virtual auditory environment (VAE), dynamic and real-time rendering, head related transfer function (HRTF), principal components analysis (PCA)