Virtools环境下基于Kinect的手势识别与手部跟踪

USING Kinect FOR GESTURE RECOGNITION AND TRACKING IN Virtools ENVIRONMENT

为了实现在Virtools环境下利用手势对虚拟物体进行交互操作,设计开发了一个针对Kinect设备的插件。该插件基于Kinect的程序开发接口和Virtools的软件开发工具包,以Visual C++2010.Net为程序开发工具设计实现。首先根据Virtools的软件架构和模块开发技术,设计插件的管理器和行为模组,它们提供手势信息与手点位置;然后设计相应的扩展行为模组,利用手势选中物体零部件,零部件跟随手的运动做平移或缩放;最后通过实例验证了该插件的手势识别和手部跟踪功能的有效性,扩展了Virtools软件的应用领域。

To realize interactive manipulation upon virtual objects with gestures in Virtools environment, a plug-in is specially designed and developed for Kinect devices. The plug-in takes advantage of Kinect API and Virtools SDK and is implemented with C ＋ ＋ 2010. Net as its developing tool. Firstly according to Virtools software structure and module development techniques, a plug-in manager and a behavior pat- tern group are designed, which provide gesture information and hand point positions. Next a corresponding extended behavior module group is designed, by which the object parts can be picked up by gestures and moved around or scaled with hand movements. Finally a practical in- stance validates the effectiveness of gesture recognition and hand tracking function, so that the Virtools application realm is expanded.