结合显著性的MVD视频整帧丢失错误隐藏

Error Concealment for Frame Losses in MVD Video Using Saliency

基于多视点视频加深度(Multiview Video plus Depth,MVD)格式的三维视频能给用户提供多视角的沉浸式视觉体验.针对MVD视频流传输中彩色帧发生整帧丢失的情况,提出了一种结合视觉显著性的三维视频整帧丢失错误隐藏算法.先将丢失帧各区域划分为三种不同的显著等级,然后对低、中、高显著区域,分别采用时域直接拷贝、时域和视点间像素自适应搜索法和新型的运动矢量补偿法进行恢复.相较于目前的对比算法,经提出算法重建后的丢失帧的峰值信噪比值(Peak Signal to Noise Ratio,PSNR)和结构相似度值(Structural Similarity Index Measure,SSIM)能分别提高0.99~2.61 dB和0.005~0.012,并且重建图像主观视觉质量更佳.

The 3D video based on multiview video plus depth(MVD)format can provide users with immersive expe⁃riences from different viewpoints.To solve the whole color frame losses in MVD video stream transmission,we propose a novel error concealment algorithm of whole-frames loss using visual saliency.Firstly,each region of the lost frame is classi⁃fied into three different saliency levels.The low,medium and high saliency regions are recovered by direct temporal copy,adaptive pixel matching search between temporally and inter-view domains,and a new motion vector compensation,respec⁃tively.Compared with the recent algorithms,the lost frame concealed by the proposed algorithm achieves significant im⁃provements in the average PSNR and SSIM with approximate gains of 0.99~2.61 dB and 0.005~0.012,respectively.In addi⁃tion,our concealed results have better visual quality than compared methods.