一种基于Leap Motion的直观体交互技术

A Leap Motion Based Intuitive Volume Interaction Technology

Leap Motion系统可高精度实时检测并跟踪手掌、手指的位置和速度等信息,为大屏幕、远距离体交互提供有效途径。通过观察用户手势远距离操控现实环境中的物体,该文设计易于理解的体交互操作手势;借助对Leap Motion传感器工作区域的远近场划分,建立合理的物理空间和信息空间映射关系;针对利用深度相机的手部姿态解算问题,结合Leap Motion传感器的特点,提出一种结合手掌法向和指尖向量的空间姿态算法;结合大屏幕体交互的任务特点,设计了支持连续数据流的非接触式体交互原型系统;最后通过用户实验对原型系统进行评估。结果表明,和传统的2D体交互比较,该文算法的用户体验和表现更为自然、直观和高效。

The Leap Motion sensor can detect the position and speed information of hands and fingers with high precision in real-time, which provides an effective way for volume interaction with large screen at long-distance. A set of understandable gesture for volume interaction is designed by observing gestures of the users to control the remote real objects. By dividing the near and far field regions of the Leap Motion sensor, a reasonable mapping between physics space and information space is established. According to the estimation solution for hand orientation with Depth Camera, an orientation estimation algorithm combining hand normal vector with fingertip vector is proposed using Leap Motion sensor. In addition, a non touching volume interaction prototype is designed for large screen application, and the prototype evaluation is given through the user experiment. Experimental results show that the proposed algorithm can provide a more natural, intuitive and efficient user experience compared with the traditional 2D volume interaction.