A new three-dimensional(3D) audio coding approach is presented to improve the spatial perceptual quality of 3D audio. Different from other audio coding approaches, the distance side information is also quantified, and...A new three-dimensional(3D) audio coding approach is presented to improve the spatial perceptual quality of 3D audio. Different from other audio coding approaches, the distance side information is also quantified, and the non-uniform perceptual quantization is proposed based on the spatial perception features of the human auditory system, which is named as concentric spheres spatial quantization(CSSQ) method. Comparison results were presented, which showed that a better distance perceptual quality of 3D audio can be enhanced by 5.7%~8.8% through extracting and coding the distance side information comparing with the directional audio coding, and the bit rate of our coding method is decreased of 8.07% comparing with the spatial squeeze surround audio coding.展开更多
3D audio effects can provide immersive auditory experience, but we often face the so-called in-head localization （IHL） problem in headphone sound reproduction. To ad- dress this problem, we propose an effective soun...3D audio effects can provide immersive auditory experience, but we often face the so-called in-head localization （IHL） problem in headphone sound reproduction. To ad- dress this problem, we propose an effective sound image externalization approach. Specifically, we consider several important factors related to sound propagation, which include image-source model based early reflections with distance decay, wall absorption and air absorption, late reverberation and other dynamic factors like head movement. We apply our sound image externalization approach to a headphone based real-time 3D audio system. Subjective listening tests show that the sound image externalization performance is significantly improved and the sound source direction is preserved as well. A/B preference test further shows that, as compared with a recent popular approach, the proposed approach is mostly preferred by the listeners.展开更多
This paper proposes an unequal error protection（UEP）coding method to improve the transmission performance of three-dimensional（3D）audio based on expanding window fountain（EWF）.Different from other transmissions ...This paper proposes an unequal error protection（UEP）coding method to improve the transmission performance of three-dimensional（3D）audio based on expanding window fountain（EWF）.Different from other transmissions with equal error protection（EEP）when transmitting the 3D audio objects.An approach of extracting the important audio object is presented,and more protection is given to more important audio object and comparatively less protection is given to the normal audio objects.Objective and subjective experiments have shown that the proposed UEP method achieves better performance than equal error protection method,while the bits error rates（BER）of the important audio object can decrease from 10^（–3） to 10^（–4）,and the subjective quality of UEP is better than that of EEP by 14%.展开更多
信息技术的快速发展为计算机虚拟立体声像软件的设计提供新的机遇。探讨信息技术,特别是数字信号处理(Digital Signal Processing,DSP)技术、三维音频算法、虚拟现实(Virtual Reality,VR)技术在计算机虚拟立体声像软件设计中的应用。这...信息技术的快速发展为计算机虚拟立体声像软件的设计提供新的机遇。探讨信息技术,特别是数字信号处理(Digital Signal Processing,DSP)技术、三维音频算法、虚拟现实(Virtual Reality,VR)技术在计算机虚拟立体声像软件设计中的应用。这些技术的综合利用,不仅提升了声音的空间感和真实感,还增强了用户的沉浸式体验。展开更多
三维(Three-dimension,3D)多媒体技术,尤其是和3D视频相比有所差距的3D音频技术受到了广泛的关注。当前三维音频技术研究可分为基于物理声场重建的多声道音频技术和基于感知的声音场景重建的多声道音频技术两大类。物理声场重建技术的...三维(Three-dimension,3D)多媒体技术,尤其是和3D视频相比有所差距的3D音频技术受到了广泛的关注。当前三维音频技术研究可分为基于物理声场重建的多声道音频技术和基于感知的声音场景重建的多声道音频技术两大类。物理声场重建技术的重要代表是基于球谐分解的声重放技术和波场合成技术(Wave field synthesis,WFS),基于感知的声音场景重建技术主要包括幅度平移技术(Amplitude panning,AP)和基于头相关传输函数的双耳重建技术(Head related transfer function,HRTF)。本文对上述4类三维音频技术及其对应的典型系统进行了介绍及对比分析,并对三维音频技术当前3大主要研究热点:空间听觉机制、三维音频压缩编码以及三维音频系统精简的现状与前沿技术进行了介绍。展开更多
基金supported by National High Technology Research and Development Program of China (863 Program, No. 2015AA016306)National Nature Science Foundation of China (No. 61662010, 61231015, 61471271, 61761044, 61762005)
文摘A new three-dimensional(3D) audio coding approach is presented to improve the spatial perceptual quality of 3D audio. Different from other audio coding approaches, the distance side information is also quantified, and the non-uniform perceptual quantization is proposed based on the spatial perception features of the human auditory system, which is named as concentric spheres spatial quantization(CSSQ) method. Comparison results were presented, which showed that a better distance perceptual quality of 3D audio can be enhanced by 5.7%~8.8% through extracting and coding the distance side information comparing with the directional audio coding, and the bit rate of our coding method is decreased of 8.07% comparing with the spatial squeeze surround audio coding.
文摘3D audio effects can provide immersive auditory experience, but we often face the so-called in-head localization （IHL） problem in headphone sound reproduction. To ad- dress this problem, we propose an effective sound image externalization approach. Specifically, we consider several important factors related to sound propagation, which include image-source model based early reflections with distance decay, wall absorption and air absorption, late reverberation and other dynamic factors like head movement. We apply our sound image externalization approach to a headphone based real-time 3D audio system. Subjective listening tests show that the sound image externalization performance is significantly improved and the sound source direction is preserved as well. A/B preference test further shows that, as compared with a recent popular approach, the proposed approach is mostly preferred by the listeners.
基金Supported by the National High Technology Research and Development Program of China(863 Program,2015AA016306)the National Natural Science Foundation of China(61662010,61231015,61471271)+1 种基金Science and Technology Plan Projects of Shenzhen(ZDSYS2014050916575763)Science and Technology Foundation of Guizhou Province(LKS[2011]1)
文摘This paper proposes an unequal error protection（UEP）coding method to improve the transmission performance of three-dimensional（3D）audio based on expanding window fountain（EWF）.Different from other transmissions with equal error protection（EEP）when transmitting the 3D audio objects.An approach of extracting the important audio object is presented,and more protection is given to more important audio object and comparatively less protection is given to the normal audio objects.Objective and subjective experiments have shown that the proposed UEP method achieves better performance than equal error protection method,while the bits error rates（BER）of the important audio object can decrease from 10^（–3） to 10^（–4）,and the subjective quality of UEP is better than that of EEP by 14%.
文摘信息技术的快速发展为计算机虚拟立体声像软件的设计提供新的机遇。探讨信息技术,特别是数字信号处理(Digital Signal Processing,DSP)技术、三维音频算法、虚拟现实(Virtual Reality,VR)技术在计算机虚拟立体声像软件设计中的应用。这些技术的综合利用,不仅提升了声音的空间感和真实感,还增强了用户的沉浸式体验。
文摘三维(Three-dimension,3D)多媒体技术,尤其是和3D视频相比有所差距的3D音频技术受到了广泛的关注。当前三维音频技术研究可分为基于物理声场重建的多声道音频技术和基于感知的声音场景重建的多声道音频技术两大类。物理声场重建技术的重要代表是基于球谐分解的声重放技术和波场合成技术(Wave field synthesis,WFS),基于感知的声音场景重建技术主要包括幅度平移技术(Amplitude panning,AP)和基于头相关传输函数的双耳重建技术(Head related transfer function,HRTF)。本文对上述4类三维音频技术及其对应的典型系统进行了介绍及对比分析,并对三维音频技术当前3大主要研究热点:空间听觉机制、三维音频压缩编码以及三维音频系统精简的现状与前沿技术进行了介绍。
