基于Kinect的手术辅助系统研究

Research on Operation Auxiliary System Based on Kinect

针对手术室无菌环境要求非常高的现实需求,以及传统鼠标键盘等人机交互方式存在的需要定期消毒且无法在手术过程中进行操作等客观限制,对目前手术室中人机交互存在的问题进行了分析,提出了一套基于Kinect自然人机交互技术的手术辅助系统。该系统包括一个病人资料库、一套Windows系统下基于Kinect自然人机交互技术的控制程序及一套Kinect手术辅助系统硬件。实验结果表明通过Kinect可以收集操作者的手势、动作、声音等,并将其转化为操作系统可以理解的命令,对手术辅助系统进行相关操作,从而辅助手术进行。该系统对于改善手术条件、节省手术时间、缓解病患痛苦具有一定帮助。

Aiming at the high demand for sterile operating room environment and the objective constrains of regular disinfection and not operating during the operation for traditional interactive ways such as mouse and keyboard, analyze the human-computer interaction problems in the operating room, and put forward a set of operation auxiliary system based on natural Kinect human computer interaction technology. The system includes a patient database, a set of control procedure based on natural Kinect human-computer interaction technology under Windows system and a set of Kinect operation auxiliary system hardware. The experimental results show that the Kinect can collect the operator gesture,movement,sound and so on,that change to the command which the operating system could understand,carrying out corresponding operation for the system to support the operation. The system is beneficial for improving the operation conditions, saving the operation time and alleviating patients pain.