基于LeapMotion手势识别的认知训练系统的设计和实现

The design and implement of cognitive training system based on leapMotion gesture recognition

针对当前儿童认知训练系统缺乏自然的人机交互手段的缺陷,设计实现了一种高精度自然人机交互的认知训练系统。详细介绍了系统的实现,设计了模仿类等认知训练任务,使用Leap Motion设备获得手部实时数据,并对其进行计算处理后获得手部动作,利用Unity3D开发3D任务场景客户端,增加用户临场感。系统实现了训练场景自然的人机交互,展示了自然人机交互在儿童发展,虚拟现实,医疗,健康等领域的美好应用前景。

Aiming at the defects of natural Human-Computer interaction in the current children’s cognitive training system, a kind of cognitive training system with high accuracy and natural Human-Computer interaction is designed and realized. This paper introduces the implementation of the training system, designs cognitive training tasks such as mitation taskand so on. Using the LeapMotion device to obtain the real-time data, the system can get the hand action after the calculation. Meanwhile, the 3D client is developed by Unity3D whick aims at enhancing user’s presence. The system has realized the natural Human-Computer interaction in the training scene, and has demonstrated the good application prospect in the field of virtual reality, medical treatment, health and other fields.