A new three-dimensional(3D) audio coding approach is presented to improve the spatial perceptual quality of 3D audio. Different from other audio coding approaches, the distance side information is also quantified, and...A new three-dimensional(3D) audio coding approach is presented to improve the spatial perceptual quality of 3D audio. Different from other audio coding approaches, the distance side information is also quantified, and the non-uniform perceptual quantization is proposed based on the spatial perception features of the human auditory system, which is named as concentric spheres spatial quantization(CSSQ) method. Comparison results were presented, which showed that a better distance perceptual quality of 3D audio can be enhanced by 5.7%~8.8% through extracting and coding the distance side information comparing with the directional audio coding, and the bit rate of our coding method is decreased of 8.07% comparing with the spatial squeeze surround audio coding.展开更多
3D audio effects can provide immersive auditory experience, but we often face the so-called in-head localization （IHL） problem in headphone sound reproduction. To ad- dress this problem, we propose an effective soun...3D audio effects can provide immersive auditory experience, but we often face the so-called in-head localization （IHL） problem in headphone sound reproduction. To ad- dress this problem, we propose an effective sound image externalization approach. Specifically, we consider several important factors related to sound propagation, which include image-source model based early reflections with distance decay, wall absorption and air absorption, late reverberation and other dynamic factors like head movement. We apply our sound image externalization approach to a headphone based real-time 3D audio system. Subjective listening tests show that the sound image externalization performance is significantly improved and the sound source direction is preserved as well. A/B preference test further shows that, as compared with a recent popular approach, the proposed approach is mostly preferred by the listeners.展开更多
This paper proposes an unequal error protection（UEP）coding method to improve the transmission performance of three-dimensional（3D）audio based on expanding window fountain（EWF）.Different from other transmissions ...This paper proposes an unequal error protection（UEP）coding method to improve the transmission performance of three-dimensional（3D）audio based on expanding window fountain（EWF）.Different from other transmissions with equal error protection（EEP）when transmitting the 3D audio objects.An approach of extracting the important audio object is presented,and more protection is given to more important audio object and comparatively less protection is given to the normal audio objects.Objective and subjective experiments have shown that the proposed UEP method achieves better performance than equal error protection method,while the bits error rates（BER）of the important audio object can decrease from 10^（–3） to 10^（–4）,and the subjective quality of UEP is better than that of EEP by 14%.展开更多
基金supported by National High Technology Research and Development Program of China (863 Program, No. 2015AA016306)National Nature Science Foundation of China (No. 61662010, 61231015, 61471271, 61761044, 61762005)
文摘A new three-dimensional(3D) audio coding approach is presented to improve the spatial perceptual quality of 3D audio. Different from other audio coding approaches, the distance side information is also quantified, and the non-uniform perceptual quantization is proposed based on the spatial perception features of the human auditory system, which is named as concentric spheres spatial quantization(CSSQ) method. Comparison results were presented, which showed that a better distance perceptual quality of 3D audio can be enhanced by 5.7%~8.8% through extracting and coding the distance side information comparing with the directional audio coding, and the bit rate of our coding method is decreased of 8.07% comparing with the spatial squeeze surround audio coding.
文摘3D audio effects can provide immersive auditory experience, but we often face the so-called in-head localization （IHL） problem in headphone sound reproduction. To ad- dress this problem, we propose an effective sound image externalization approach. Specifically, we consider several important factors related to sound propagation, which include image-source model based early reflections with distance decay, wall absorption and air absorption, late reverberation and other dynamic factors like head movement. We apply our sound image externalization approach to a headphone based real-time 3D audio system. Subjective listening tests show that the sound image externalization performance is significantly improved and the sound source direction is preserved as well. A/B preference test further shows that, as compared with a recent popular approach, the proposed approach is mostly preferred by the listeners.
基金Supported by the National High Technology Research and Development Program of China(863 Program,2015AA016306)the National Natural Science Foundation of China(61662010,61231015,61471271)+1 种基金Science and Technology Plan Projects of Shenzhen(ZDSYS2014050916575763)Science and Technology Foundation of Guizhou Province(LKS[2011]1)
文摘This paper proposes an unequal error protection（UEP）coding method to improve the transmission performance of three-dimensional（3D）audio based on expanding window fountain（EWF）.Different from other transmissions with equal error protection（EEP）when transmitting the 3D audio objects.An approach of extracting the important audio object is presented,and more protection is given to more important audio object and comparatively less protection is given to the normal audio objects.Objective and subjective experiments have shown that the proposed UEP method achieves better performance than equal error protection method,while the bits error rates（BER）of the important audio object can decrease from 10^（–3） to 10^（–4）,and the subjective quality of UEP is better than that of EEP by 14%.
文摘虚拟现实(Virtual Reality,VR)的兴起使得三维音频技术得到进一步的应用。VR中三维音频的回放一般采用基于双耳的方式,目前VR中应用较多的三维音频技术有基于物理声场重建和球谐分解的Ambisonics技术,基于自然双耳录音(Binaural recording)的技术,以及基于头相关传递函数(Head Related Transfer Function,HRTF)重建的技术。此外在考虑环境混响效果的场景下还需要双耳房间脉冲响应(Binaural Room Impulse Response,BRIR)技术。介绍了VR中现有的三维音频技术和市场上的主要应用,介绍了VR音频从采集,编码传输到渲染回放整个过程中的主流相关技术,最后对VR三维音频的发展进行了展望。
