基于二维仿射变换的几何一致性虚实融合

Virtual-real fusion with geometric consistency based on two-dimensional affine transformation

几何一致性和光照一致性在虚拟物体叠加到真实场景中的真实感渲染中起着重要作用。为了构建立体相机的真实场景和虚拟场景的坐标测量系统,实现虚实融合过程中的几何一致性和光照一致性,提升虚实融合的真实感,提出了一种几何一致性虚实融合方法,利用从三维空间到二维空间的转换,详细计算虚拟对象与真实场景之间的几何关系,并应用二维仿射变换处理二维图像,以实现更精确的计算。最后,结合光照一致性估计,使用差分渲染法将虚拟对象准确地插入到真实场景中实现虚实融合。实验结果表明,虚拟物体可以完全按照尺寸和体积融合到真实场景中,融合后的几何一致性提升了15%以上,该方法为增强现实的应用奠定了基础。

With the rapid development of three-dimentional technologies,geometric and illumination consistency play an important role in the realistic rendering of virtual objects superimposed on real scenes. In order to construct the coordinate measurement system of real and virtual scenes of a stereo camera,realize the geometric and illumination consistency in real fusion,and improve the realism of virtual-real fusion,a geometric consistency virtual-real fusion method was proposed. At transformation from three to two-dimensional space was used for detailed calculation of the geometric relationship between a virtual object and real scene. Following this,a two-dimensional affine transformation was applied to process the two-dimensional images for a more accurate calculation. Finally,combined with the illumination consistency estimation,the virtual object was accurately inserted into the real scene using the differential rendering method to realize virtual-real fusion. The experimental results show that the virtual object can be fused into the real scene completely in terms of size and volume. The geometric consistency after fusion is increased by more than 15%. This verifies the effectiveness of the method and lays a foundation for applications of augmented reality.