虚拟现实训练系统中基于手势的人机交互

Hand Gesture-based Interaction in Virtual Reality Training System

给出了虚拟手建模和数据手套校正的方法和步骤。通过数据手套与位置跟踪设备的结合使用,得到现实世界中手的姿势以及位置,并以此驱动虚拟世界中的虚拟手进行交互操作。运用神经网络和逻辑组合的方法分别对定义的静态手势和动态命令进行识别,形成相应的操作命令。为验证所提方法的有效性和实用性,将基于手势的人机交互技术应用于某型自行火炮的虚拟驾驶训练中,受训者可以像在真实世界中一样操纵虚拟训练环境中的虚拟物体和部件,取得了满意的训练效果。

The methods of virtual hand modeling and dataglove calibration were proposed firstly. The gestures and positions of the hand in real world, which were tracked with the datatglove and motion tracking device, were used to drive the virtual hand in virtual environment. Neural network and logic combination was used to recognize the static hand gestures and dynamic commands. The required computer manipulation commands were got according to the recognition results. The efficiency and practicability of the presented methods were validated by applying it to the virtual driving training system of self-propelled gun (SPG). In the system, the users can manipulate the virtual objects and components as if they are in real world.