基于手势交互的输电线路运维沉浸式操作训练平台

Research on the immersive training platform of transmission line operation and maintenance work based on gesture interaction

针对目前输电线路运维作业技能仿真培训存在交互体验不足的问题,提出一种采用手势交互方式开展技能模拟训练的方法。通过Leap Motion手势采集设备和手势交互识别技术,建立适用于线路运维操作模拟的虚拟手模型和手势库,借助Unity3D、VC++、3Dmax等开发工具实现输电线路运维三维场景的配置和基于手势交互的训练任务驱动。结合Oculus Rift立体成像系统,采用立体渲染技术实现作业场景的立体显示和视觉跟踪,最后,构建了基于手势交互的输电线路运维技能沉浸式操作训练平台。测试结果表明:采用Leap Motion手势识别技术可以实现手部运动对模拟操作过程的有效控制,能够满足输电线路运维技能操作训练的自然交互体验需求,同时,结合Oculus Rift的立体成像进一步增强了训练过程的沉浸式体验效果。该文的研究成果为输电线路运维技能训练提供了一种新型有效的培训手段。

According to the shortages of poor interactive experience in the existing transmission line operation and maintenance simulation training, a skill simulating training method based on gesture interaction was proposed in this paper. Based on gesture acquisition device Leap Motion and gesture recognition technology, the virtual hand model and gesture base were built. The 3D scene configuration of transmission line operation and simulation task driving based on gesture recognition were realized by using Unity3D, VC＋＋ and 3Dmax development platform. Besides, the stereo display and visual tracking of operation scene were realized by the 3D rendering technology of the Oculus Rift stereoscopic imaging system. Finally, the immersive operating platform of transmission line operation and maintenance work based on gesture interaction was constructed. Testing results show that the control of hand movement in simulation operation process is effectively realized by the accurate gesture recognition of Leap Motion, which can meet the natural interaction requirements of transmission line operation and maintenance skill operation training, and the immersion experience in transmission line operation and maintenance training is enhanced further by stereoscopic imaging of Oculus Rift. Insummary, the proposed immersive training platform can provide an effective method for the transmission line operation and maintenance skill training.