面向实物交互的空间增强现实数字孪生法配准技术

Digital Twin Registration Technique of Spatial Augmented Reality for Tangible Interaction

在支持实物交互的空间增强现实系统中,交互会引起实物对象方向、位置的快速改变.为了确保实物移动过程中的虚实配准实时性和精确性,提出一种面向实物交互的空间增强现实数字孪生法配准技术.通过在数字空间建立与物理空间一致的对象数字模型,实时捕获物理空间中对象的方向、位置信息,利用该信息实时调整数字空间中的虚拟对象方向、位置参数;离线标定投影机的内外部参数,同时在数字空间中建立与物理空间中投影机内外部参数一致的虚拟相机,将实时渲染生成的数字图像输出至投影画面,从而实现虚实图像的精确配准.使用搭建的投影式交互桌面开展中学物理认识磁感线实验,交互过程中磁铁、指南针的检测与配准结果表明,该技术具有很好的配准实时性和精度,能够满足空间增强现实系统中的实物交互需求.

In spatial augmented reality(SAR)systems supporting tangible interaction,user interactions can cause rapid changes in orientation and position of interaction objects.To ensure the efficiency and accuracy of registration during objects movements,a digital twin registration technique for SAR is proposed.Models are made in the digital space and their geometric parameters are entirely consistent with the objects in the physical space.The orientation and position parameters of the physical objects are tracked in real-time during user interaction.Then the digital objects are adjusted according the parameters.Moreover,intrinsic and extrinsic parameters of the projector,which are calibrated in advance,are used to set the virtual camera in the digital space.The projection patterns are rendered in that virtual camera and then projected onto the interaction objects.The efficiency and accuracy are evaluated in the middle school physical experiment learning magnetic induction line based on the projection interaction tabletop,which meet the requirements of tangible interaction in SAR systems.