体感交互设计及其在三维虚拟实验中的应用

Design of Somatosensory Interaction and Application in Three-Dimensional Virtual Experiment

人机交互方式直接影响三维虚拟学习系统的沉浸感和用户体验,基于桌面的WIMP交互由于信息维度的限制,在完成三维交互任务时存在用户体验不佳问题。体感交互使用自然习惯动作直接交互,其交互信息具有连续性、多维性、隐含性等特点,能减轻对WIMP交互中鼠标键盘的操控依赖与操控复杂度,使学习者更关注学习任务本身,在三维虚拟学习系统中具有更好的适用性。与WIMP交互相比,体感交互设计的最终目标是提升学习体验,在影响学习体验的四个主要因素中,体感交互行为过程最为关键,主要体现在"定位"、"操作"、"反馈"等环节,并通过隐喻设计促进学习者的认知和反思。对体感虚拟实验的案例分析和开发实践表明,体感交互能提高与三维对象的交互效率、增强学习沉浸感,体感交互设计应遵循情景性、隐含性、及时反馈、反思性等原则。

The way of HCI （Human-Computer Interaction） directly impacts the immersion and user experience in 3D virtual learning system. Due to the limitation of WIMP＇s information dimension,there are some user experience problems in completing 3D interactive tasks. Natural Somatosensory Interaction （NSI） using natural gestures to interact with the computer learning environment with continuity, multi-dimensional, implicit characteristics can reduce the manipulation dependence and complexity of the mouse and keyboard in WIMP＇s interaction so that students are more concerned about learning tasks itself,and NSI has better adaptability in a 3D virtual learning system. On the basis of comparison of interactive features between NSI and WIMP,the paper proposes that the ul- timate goal of somatosensory interaction is to promote the learning experience, and analyzes the key factors affecting the learning expe- rience-the somatosensory interactive behavior process. A 3D virtual experiment named “the reducer virtual assembly” shows that the NSI can improve the efficiency of interaction with the 3D object and enhance the immersion in learning, and then the principle of the situational, implicit, timely feedback and reflexivity in the somatosensory interaction design is derived.