虚拟界面自然交互模型与算法

Natural interaction model and algorithm based on virtual interface

针对基于视觉的手势交互界面中的"点石成金问题(Midas Touch Problem)",提出虚拟界面的概念.采用统计分析的方法建立虚拟界面的认知基础,提出基于认知行为模型的虚拟界面构建算法,实现基于虚拟界面的示范应用.采用静态和动态2种方式构建虚拟界面,对已构建的虚拟界面进行分区,使得每个分区具有不同的功能,从而达到一种手势实现多个功能,降低用户记忆负荷的目的.实现虚拟界面的实时刷新功能,达到与人体亦步亦趋的效果.提出有效的虚拟界面感知方法,验证其交互能力及其解决"Midas Touch Problem"的积极效果.实验结果表明:虚拟界面不仅能够高效解决"Midas Touch Problem",还具有良好的用户体验.

The concept of virtual interface was proposed aiming at the＂Midas Touch Problem＂that occured in gesture interaction interfaces based vision.The statistical analysis method was used to establish the cognitive basis of virtual interface,and virtual interface construction algorithm was proposed based on cognitive behavioral model.Then a demonstration application based on virtual interface was implemented.Two methods including the static and dynamic ways were applied to construct the virtual interface.The virtual interface was divided into several regions averagely and each region was endowed with different functions.Therefore,multiple functions could be realized by only one kind of gesture,which reduced the memory load of users.The function of real-time refresh of virtual interface was achieved,which was the same effect as the human body.The effective perception method of virtual interface was put forward,and the interactive ability and positive effect of solving ＂Midas Touch Problem＂ were verified. The experimental results show that the proposed virtual interface not only solves the＂Midas Touch Problem＂efficiently,but also has a good user experience.