混合现实电子沙盘虚拟对象的手眼协同交互设计研究

Hand-Eye Collaborative Interaction Design of Virtual Object in Mixed Reality Sand Table

目的面向混合现实电子沙盘虚拟3D对象,开展3D交互性能与用户体验研究与评估,提出交互设计原则和设计建议。方法针对混合现实环境下双手可触范围外的虚拟对象“选择”任务开展交互设计研究,引入虚拟对象布局排列方式作为评估变量,在3种典型的虚拟对象布局情况下,分别进行手控光线、头动、眼动与手势协同的3种交互方式性能及用户体验对比研究。通过设计原型实验系统,进行用户体验测试,实验数据分析与评估,验证交互设计原则,提出交互设计建议。结论实验结果显示眼动与捏合手势结合的手眼协同交互方式在时间、任务负荷及用户偏好方面都具有显著优势。手控光线与手势协同交互的准确性最优,并且这一优势在任何一种布局方式中都有所体现。建议混合现实环境下的“选择”任务交互设计要注重功用性、持续性和愉悦性原则,提出了降低“选择”任务交互的工作负荷与疲劳及增强新颖交互提升愉悦性的设计建议。

This paper studies the 3D interaction performance and user experience evaluation of the virtual 3D object in the mixed reality sand table,and puts forward interaction design principles and design suggestions.The interaction design is carried out for the"selection"task of virtual objects outside the touchable range of both hands in the mixed reality environment.The layout mode of virtual objects is creatively introduced as an evaluation variable.And under the three typical virtual object layouts,a comparative study on the performance and user experience of three interactive modes of hand-controlled light,head movement,eye movement and gesture coordination is carried out.Through the design of an experimental prototype system,user experience test,experimental data analysis and evaluation,we verify the principles of interactive design,and put forward interactive design suggestions.The experimental results show that the hand-eye collaborative interaction mode combined with gaze and pinch gesture has significant advantages in time,task load and user preference.The accuracy of point and pinch interaction is the best in all the three layouts.It is suggested that the design of"selection"task interaction in the mixed reality environment should pay attention to the principles of functionality,continuity and pleasure,and put forward some design suggestions to reduce the work load and fatigue of"selection"task interaction and adopt novel interaction to improve pleasure.