基于混合现实的远程协同式装配维修引导

Mixed reality based remote collaborative assembly guidance

提出一种基于混合现实设备HoloLens头盔的一种远程协同装配维修系统。利用HoloLens的深度摄像头和摄像头对空间的感知能力,通过改进手势识别算法将专家端的二维手势操作转换为用户端的三维动画标识。这种简洁生动的三维动画标识通过空间锚点固定在相应的空间位置上,为操作人员开展下一步操作提供清晰的指引,且无需放下手头工作与计算机进行手势交互,实现了专家-用户模式的远程协同工作。相对于传统的协同式系统,实验验证了该文开发的协同式装配维修引导系统的友好性和实用性。

A remote collaborative assembly and maintenance system was proposed based on mixed reality technology.HoloLens’s spatial perception capability of the depth camera and RGB camera was employed to map the interaction from the 2D gestures on the expert side to the 3D animation markers on the operator side,where the gestures were recognized using an improved method.These simple and vivid 3D markers were located with spatial anchors to provide the operator with clear directions about the next steps for expert-operator-mode collaborative tasks,freeing the operator’s hands from interacting with the computer by gestures.The experiments verify the feasibility of such user-friendly guide interfaces for remote collaboration of assembly and maintenance tasks.