沉浸式三维视线追踪算法研究

Eye Gaze Tracking in 3D Immersive Environments

针对大型沉浸式虚拟环境中人机交互完全依赖肢体动作且效率低等问题,提出利用三维视线追踪技术得到用户注视点,以实现交互操作,为沉浸式环境提供一种自然、双向的交互手段。创新性地将Leap Motion用于瞳孔位置跟踪,通过被动式光学追踪设备获取使用者的头部运动状态,依据初始标定得到的映射方程来估计使用者大空间范围内自由运动状态下的三维注视点。实验表明,使用者在3.0 m×3.2 m×2.0 m的空间内自由运动时,集成系统对三维注视点的估计频率可达60 Hz,估计误差小于45 mm,为视线追踪在沉浸式虚拟环境中的广泛应用奠定了基础。

Aiming at the problem that human-computer interaction in immersive environments is entirely dependent on the body movement with low operational efficiency,a 3D eye gaze tracking method is proposed to gain the 3D gaze point of the user. Thus the interactive operation could be achieved, which provides a natural and bidirectional way for interaction. The Leap Motion controller is innovatively used to track the coordinates of eyes and the head position is tracked with the motion capture device. The gaze point under free movement can be estimated based on the mapping equation that is obtained in the initial calibration state. Experimental results show that when user moves freely in the 3.0 m×3.2 m×2.0 m space, the frequency of estimation of 3D gaze point is up to 60 Hz and the error is within 45 mm, which lays a foundation for the wide application of eye gaze tracking in immersive virtual environments.