一种联合语音与手势识别的增强现实人机交互系统

AR HCI System by Uniting Speech and Gesture Recognition

针对AR系统人机交互问题,提出了一种联合语音与手势识别的AR系统人机交互系统,利用语音识别传感器和手势识别传感器构建AR系统人机交互硬件系统,利用MCU芯片对语音识别传感器和手势识别传感器进行控制,实现了"翻页""缩放""上一步""下一步"等多种交互命令。与传统人机交互方法相比,克服了单个传感器使用环境受限制的缺陷,提高了AR系统人机交互的实时性和鲁棒性,实现了AR系统人机交互方法的普适性、低成本和高效率。

Aiming at the problem of human-computer interaction（HCI）for AR system, a human-com- puter interaction system combining speech and gesture recognition is proposed. Its hardware system is mainly constructed by speech recognition sensor and gesture recognition sensor, and a MCU is used to control the sensors, to achieve interactive command such as ＂flip＂ ＂zoom＂ ＂previous step＂ ＂next step＂ and so on. Comparing with traditional HCI methods, it makes up the limits of single sensor and improves the realtime performance and robustness of HCI in AR system, achieving a low cost, high efficiency and general applicability method.