虚拟视点插值中参考视图选择策略

Reference Image Selection in Virtual View Interpolation

基于图像的渲染是图像处理与计算机图像交叉应用领域中热门研究方向,又称作自由视角技术或者虚拟视点插值技术。虚拟视点插值技术根据已经拍摄或者渲染得到的图像来渲染虚拟视点的视图。由于视角遮挡关系和视点位置与虚拟视点不重合,通常在虚拟视点合成中会因为虚拟视点可见场景采样不足或者几何采样缺失而导致空洞现象的产生,而空洞问题会严重降低视觉质量导致基于虚拟视点的渲染应用(例如自由漫游系统)无法提供用户良好的使用体验。本文提出一种可以快速在目标场景图像库中计算最优的参考图像对,用于合成高质量的虚拟视点图像。

Image-based rendering is a popular research direction in the field of image processing and computer grapy cross-application,also known as free viewpoint or virtual viewpoint interpolation technology.Virtual viewpoint interpolation technology renders a virtual view based on images that have been captured or rendered.Because of the difference of perspective occlusion relationship and viewpoint,hole is usually produced by insufficient sampling the visible scenes of virtual view or missing geometry samples and the hole problems can seriously de⁃grade visual quality,providing a bad user experience in virtual view system.In this paper,we propose a reference image selection strategy that will find a pair of images quickly in the target scene image library which can synthesize high-quality virtual view point images and can be used in real-time virtual view synthesis.