期刊文献+

视点合成中基于深度的空洞修复 被引量:1

Depth-based hole filling in view synthesis
下载PDF
导出
摘要 为提高视点合成中空洞的修复质量,基于样本图像修复技术,提出利用深度信息进行修复的方法.通过深度图预处理、图像映射变换、合成深度图修复以及合成视图修复等步骤,实现对空洞区域的填充,得到虚拟视点视图.所提出的深度边缘单向膨胀预处理方法、先修复合成深度图再修复合成视图的策略以及匹配块的预编辑方法,可以提高最终合成视图的质量.实验结果表明:所提出方法在主观视觉对比、峰值信噪比(PSNR)以及运行耗时上优于现有方法,在图像边缘连续性的保持、前景和背景像素渗透现象的消除等方面具有较好的效果. An image inpainting method based on exemplar-based image restoration technology was proposed to improve the quality of hole filling in view synthesis by using depth information.This method fills the holes and provides a synthesized view through depth map preprocessing,image warping,depth inpainting and color image inpainting.The final synthesized view quality is improved by the depth edge's unidirectional dilation,the strategy that firstly inpaintes synthesized depth map and then the synthesized image,and the pre-editing of matched patch.The experimental results show that this method is superior to the existing methods in terms of subjective visual perception and objective index,such as peak signal to noise ratio(PSNR)and time consuming.The proposed method also has outstanding effects on maintaining the foreground edges and eliminating the infiltration from foreground to background.
作者 杜歆 邹泷
出处 《浙江大学学报(工学版)》 EI CAS CSCD 北大核心 2015年第9期1616-1624,共9页 Journal of Zhejiang University:Engineering Science
基金 国家自然科学基金资助项目(61271339) 浙江省自然科学基金资助项目(LY12F01019)
关键词 视点合成 空洞修复 深度图修复 view synthesis hole-filling depth map inpainting
  • 相关文献

参考文献23

  • 1SHUM H Y, KANG S B. A review of imagebased rendering techniques [C] ∥ Proceedings of SPIE 4067, Visual Communications and Image Processing 2000. Perth:SPIE, 2000: 2-13.
  • 2FEHN C. Depthimagebased rendering (DIBR), compression, and transmission for a new approach on 3DTV [C] ∥ Proceedings of SPIE 5291,Stereoscopic Displays and Virtual Reality Systems XI. San Jose: SPIE, 2004: 93-104.
  • 3SHADE J, GORTLER S, HE L, et al. Layered depth images [C] ∥ Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques. Orlando: ACM, 1998: 231-242.
  • 4陈坤斌,刘海旭,李学明.构造全局背景的虚拟视点合成算法[J].信号处理,2013,29(10):1307-1314. 被引量:3
  • 5YAO C, TILLO T, ZHAO Y, et al. Depth map driven hole filling algorithm exploiting temporal correlation information [J]. IEEE Transactions on Broadcasting, 2014, 60(2): 394-404.
  • 6王奎,安平,张兆杨,程浩,李贺建.Kinect深度图像快速修复算法[J].上海大学学报(自然科学版),2012,18(5):454-458. 被引量:22
  • 7ZHANG L, TAM W J. Stereoscopic image generation based on depth images for 3DTV [J]. IEEE Transactions on Broadcasting, 2005, 51(2): 191-199.
  • 8LEE P J, EFFENDI. Nongeometric distortion smoothing approach for depth map preprocessing [J]. IEEE Transactions on Multimedia, 2011, 13(2): 246-254.
  • 9高凯,陈贺新,赵岩,耿英楠,王钢.面向虚拟视点绘制的深度图滤波及上采样方法[J].中国图象图形学报,2013,18(9):1085-1092. 被引量:4
  • 10李应彬,冯杰,张华熊,李晨勤.基于改进双边滤波的Kinect深度图像空洞修复算法研究[J].工业控制计算机,2013,26(11):105-106. 被引量:19

二级参考文献36

  • 1DARIBO I, SAITO H. A novel inpainting-based layered depth video for 3DTV [ J ]. IEEE Transactions on Broadcasting, 2011:533-541.
  • 2UM G M, KIM T, BANG G. Multi-view 3D video acquisition using hybrid camera with beem spliter [ C ]// 3 DTV Conference : The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON). 2011:1-4.
  • 3DARIBO I, TILLIER C, PESQUET-POPESCU B. Distance dependent depth filtering in 3D warping for 3DTV [ C]// Multimedia Signal Processing. 2007:312-315.
  • 4CHEN W Y, CHANG Y L, LIN S F, et al. Efficient depth image based rendering with edge dependent depth filter and interpolation [ C ] // IEEE International Conference on Multimedia and Expo. 2005:1314-1317.
  • 5KIM S Y, CHO J H, KOSCHAN A, et al. Spatial and temporal enhancement of depth images captured by a time-of-flight depth sensor [ C ] // Pattern Recognition (ICPR). 2010:2358-2361.
  • 6ZHU J J, WANG L, YANG R G, et al. Fusion of time-of- flight depth and stereo for high accuracy depth maps [C]//Computer Vision and Pattern Recognition ( CVPR2008 ). 2008 : 1-8.
  • 7WILSON A. Using a depth camera as a touch sensor [C]// ITS' 10 ACM International Conference on Interactive Tabletops and Surfaces. 2010:69-72.
  • 8MATYUNIN S, VATOLIN D, BERDNIKOV Y. Temporal filtering for depth maps generated by kinect depth camera [ C ]//The True Vision-Capture, Transmission and Display of 3 D Video (3 DTV-CON ). 2001 : 1-4.
  • 9Jl X P, WEI Z Q, FENG Y W. Effective vehicle detection technique for traffic surveillance systems [ J ]. Visual Communication & Image Representation, 2005, 17(3) :647-658.
  • 10侯春萍,杨蕾,宋晓炜,戴居丰.立体电视技术综述[J].信号处理,2007,23(5):729-736. 被引量:13

共引文献41

同被引文献9

引证文献1

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部