Unity3D中的Kinect主角位置检测与体感交互

Protagonist Position Detection and Somatosensory Interaction Based on Kinect in Unity3D

将Kinect与Unity3D联合,使玩家在三维虚拟场景里通过肢体控制游戏。根据Kinect的骨骼跟踪原理,对用户进行实时骨骼跟踪,利用Kinect SDK获取Kinect记录的关节点三维数据,实现硬件设备与Windows平台的连通。通过CMU的Kinect Wrapper实现Kinect SDK与Unity3D之间的数据交互。测试时,在Unity3D中建立三维虚拟场景,通过Kinect Wrapper中的Kinect Model Controller V2脚本对场景内的人物模型进行控制,并在Unity3D平台上实时确定用户的三维位置信息,完成Kinect与Unity3D的体感交互,可以扩展应用于高级人机交互应用,如虚拟现实系统、作战模拟训练等方面。

Kinect combined with Unity3D will take players into three-dimensional virtual scene and control game through their body. According to the principle of the skeleton tracking,the user＇s skeleton is tracked in real-time by using Kinect SDK, which obtains joint three-dimensional position records by Kinect to implement communication of hardware devices and Windows platform. Kinect Wrapper of CMU will implement data interaction between the Kinect SDK and Unity3D. Three-dimensional virtual scene is built in Unity3D when testing by using the ControllerV2 script in Kinect Wrapper, which controls the character models and determines user＇s real-time three-dimensional position on Unity3D playform, and somatosensory interaction between Kinect and Unity could be extended for advanced human-computer interaction applications like virtual reality system and combat simulation training.