装配工具的增强现实虚实遮挡研究

Occlusion Handling For Assembly Tools In Augmented Reality

要有效提高增强现实的虚实融合效果,关键是解决虚拟物体与真实物体之间的相互遮挡关系,即虚实遮挡问题。本文拟采用一种基于不可见虚拟替身去替换真实物体的方法把虚实遮挡转换成虚拟物体之间的相互遮挡问题。本方法首先通过颜色阈值分割方法把目标物体从复杂背景中提取出来,然后通过基于单应性的三维注册方法计算出其在摄像机坐标系中的位置与姿态,最后把虚拟替身贴合到真实物体上。为验证上述方法的有效性,本文最后通过效率与效果分析实验对上述方法进行验证,实验结果表明,上述方法能够在满足实时性要求的前提下得到令人比较满意的虚实遮挡处理效果。

It is a key problem to improve the effect of occlusion in augmented reality,that is how to compute the pose of virtual and real object in the common room.A method was illustrated which converted the occlusion of the real and virtual object into the occlusion of the virtual ones by a invisible virtual avatar.Firstly the occluder is extracted from the picture of environment by color segmentation.Secondly the pose of object is computed in the coordinate system of camera with 3D registration based on the homographies between current frame and template image.Finally the pose of virtual avatar was set with the pose of the occluder to exactly cover the real object.In addition,the experiment is mask to Test the availability of the method by the analysis of the effect and prove that with running real-time a satisfactory result can be gained by the method.