Depth estimation is an active research area with the developing of stereo vision in recent years. It is one of the key technologies to resolve the large data of stereo vision communication. Now depth estimation still ...Depth estimation is an active research area with the developing of stereo vision in recent years. It is one of the key technologies to resolve the large data of stereo vision communication. Now depth estimation still has some problems, such as occlusion, fuzzy edge, real-time processing, etc. Many algorithms have been proposed base on software, however the performance of the computer configurations limits the software processing speed. The other resolution is hardware design and the great developments of the digital signal processor (DSP), and application specific integrated circuit (ASIC) and field programmable gate array (FPGA) provide the opportunity of flexible applications. In this work, by analyzing the procedures of depth estimation, the proper algorithms which can be used in hardware design to execute real-time depth estimation are proposed. The different methods of calibration, matching and post-processing are analyzed based on the hardware design requirements. At last some tests for the algorithm have been analyzed. The results show that the algorithms proposed for hardware design can provide credited depth map for further view synthesis and are suitable for hardware design.展开更多
多视点视频加深度(MVD,multi-view video plus depth)的编码格式包含多个纹理视频序列及其对应的深度图,深度图与对应的纹理视频具有相似的边缘信息。传统的编码模式不考虑两者的联系,单独编码导致复杂度高、编码时间过长。因此,合理利...多视点视频加深度(MVD,multi-view video plus depth)的编码格式包含多个纹理视频序列及其对应的深度图,深度图与对应的纹理视频具有相似的边缘信息。传统的编码模式不考虑两者的联系,单独编码导致复杂度高、编码时间过长。因此,合理利用深度图与纹理图的相似性进行编码,可以有效降低编码复杂度,同时应该确保编码质量不受影响。本文利用深度图的这一特点辅助纹理视频的编码,提出一种帧间快速模式选择算法,充分利用深度图与纹理图之间的相似性,建立一种联合复杂度模型,根据模型得到每个宏块的复杂度。对于复杂度低的宏块,在计算率失真代价之前跳过编码中一些不必要的模式,从而降低编码复杂度。实验表明,本文提出的快速模式选择算法,在保证率失真性能基本不变的情况下,能减少60.57%的编码复杂度,并最高能减少80.64%的编码时间。展开更多
基金supported by the National Natural Science Foundation of China(Grant Nos.60832003)the Key Laboratory of Advanced Display and System Applications(Shanghai University),Ministry of Education,China(Grant No.P200801)the Science and Technology Commission of Shanghai Municipality(Grant No.10510500500)
文摘Depth estimation is an active research area with the developing of stereo vision in recent years. It is one of the key technologies to resolve the large data of stereo vision communication. Now depth estimation still has some problems, such as occlusion, fuzzy edge, real-time processing, etc. Many algorithms have been proposed base on software, however the performance of the computer configurations limits the software processing speed. The other resolution is hardware design and the great developments of the digital signal processor (DSP), and application specific integrated circuit (ASIC) and field programmable gate array (FPGA) provide the opportunity of flexible applications. In this work, by analyzing the procedures of depth estimation, the proper algorithms which can be used in hardware design to execute real-time depth estimation are proposed. The different methods of calibration, matching and post-processing are analyzed based on the hardware design requirements. At last some tests for the algorithm have been analyzed. The results show that the algorithms proposed for hardware design can provide credited depth map for further view synthesis and are suitable for hardware design.
文摘多视点视频加深度(MVD,multi-view video plus depth)的编码格式包含多个纹理视频序列及其对应的深度图,深度图与对应的纹理视频具有相似的边缘信息。传统的编码模式不考虑两者的联系,单独编码导致复杂度高、编码时间过长。因此,合理利用深度图与纹理图的相似性进行编码,可以有效降低编码复杂度,同时应该确保编码质量不受影响。本文利用深度图的这一特点辅助纹理视频的编码,提出一种帧间快速模式选择算法,充分利用深度图与纹理图之间的相似性,建立一种联合复杂度模型,根据模型得到每个宏块的复杂度。对于复杂度低的宏块,在计算率失真代价之前跳过编码中一些不必要的模式,从而降低编码复杂度。实验表明,本文提出的快速模式选择算法,在保证率失真性能基本不变的情况下,能减少60.57%的编码复杂度,并最高能减少80.64%的编码时间。