灵活的多视点视频编码预测结构

Flexible prediction structure for multi-view video coding

多视点视频的时空相关性不仅随着序列的变化而改变,而且视频序列内的相关性特征随着时间的推移也会发生变化,固定的预测结构难以适应复杂情况下多视点视频编码的各种要求。在分析分层B帧预测结构和多视点视频图像中当前帧及其参考帧之间时间相关性和视点间相关性的基础上,提出一种灵活的预测编码结构,根据该多视点视频的时间及视点间相关关系和当前帧与其时间参考帧之间的距离来确定该帧是否采用耗时的视点间预测。实验结果表明,与分层B帧的改进算法——可扩展性预测结构多视点编码算法相比,本文算法在保证编码效率基本不变的前提下,编码复杂度降低了约45%,随机访问性能提高28%,解码图像缓冲区要求降低46%左右。

The temporal and inter-view correlation of multi-view videos （MVV） changes not only from sequence to sequence but also from frame to frame. Therefore, the fixed prediction structure of the Joint Multi-View Video Coding （JMVC） has difficulties coping with various characteristics of different MVV sequences. In this paper, a flexible prediction structure for multi-view video coding （FPS MVC） is proposed based on the analysis of the hierarchical B picture prediction structure and the temporal correlation and inter-view correlation between the current frame and its references. Its temporal level （TL） and the temporal and inter-view correlation of the MVV sequence decide whether the inter-view prediction of the current encoded frame is adopted. Experimental results show that the proposed FPS_MVC outperforms Scalable Prediction Structure （SPS_MVC） on reducing computation complexity, improving random access （RA） ability, and decreasing the decode picture buffer （ DPB ） size by about 45% , 28% , and 46% on average, while maintaining almost the same coding efficiency.