面向虚拟装配的层次化交互手势技术

A Hierarchical Method of Interaction Hand Gesture for Virtual Assembly

针对目前虚拟装配系统存在的用户体验不足问题,文中将手势识别技术引入虚拟装配的人机交互中,提出了一种面向虚拟装配操作的层次化交互手势模型;根据装配任务和交互模式的特点,提出了二级手势分类策略:先对交互手势进行初步分类再利用情境感知技术判断手势的类型;然后利用运动感知技术对手势的交互语义进行识别;接着通过对用户作业空间的手功能区感知来实现不同交互模式的自然过渡,从而降低用户在交互过程中的认知负担;最后通过自主开发的虚拟装配原型系统对文中提出的交互手势技术进行验证.实验结果表明,文中的层次化交互手势建模与识别方法能有效地增加虚拟装配环境中的人机交互效率和用户体验.

In this paper, by introducing a gesture recognition technology into the human computer interaction in vir-tual assembly, a hierarchical interaction hand gesture model is proposed to improve the user experience in virtual assembly tasks.According to the characteristics of assembly tasks and interactive modes, a two-level gesture recog-nition strategy is designed.In the strategy, firstly, interaction hand gestures are preliminarily classified, and the types of the hand gestures are identified on the basis of context-awareness.Next, a gesture semantic is recognized by capturing the motion features of hand.Then, different interaction modes are integrated seamlessly by estimating the functional region of hand workspace, and thus, users’difficulty in recognition is reduced.Experiment results show that the proposed model and recognition method can effectively improve both the human computer interaction efficiency and the user experience in a virtual assembly prototype system.