沉浸式虚拟装配中物体交互特征建模方法研究

Interaction Feature Modeling of Virtual Object in Immersive Virtual Assembly

沉浸式虚拟装配是一种"人在回路"的虚拟现实系统,可用于大型设备的设计及装配人员的培训等领域.作为其关键技术之一,如何实现"真实"人对"虚拟"物体的操作,仍是一项具有挑战性的工作.针对这一问题,提出了一种基于交互区和状态机的物体交互特征建模方法.通过交互区,虚拟物体可理解用户的操作意图,并据此发生相应的状态转换,进而正确监测用户的交互行为.该方法可实现包括使用工具在内的复杂装配操作以及对装配流程的管理控制.通过在实际项目中的应用验证了该方法的有效性.

Immersive virtual assembly, a man-in-loop virtual reality system, can be used for the design and assembly of large equipment, personnel training and other fields. As one of its key technologies, how to realize “real” man operating on “virtual” objects is still a challenging task. In this paper, an interaction feature modeling method based on interactive zone and finite state machine （FSM） is proposed. Interactive zone is the visual representation of the interaction process. Different settings of interactive zone lead to different interaction monitoring functions. The possible interactions between user and object depend on object＇s binding zones. Virtual objects can understand the intention of user＇s action through the interactive zone, and then transit their interactive state according to the related FSM. The state of objects determines the action that user can take. According to the current state, the object will provide effective operational clues to guide the user to interact with them correctly. On that basis, task-level process control is proposed to manage the assembly process. Last but not least, direct hand interaction and indirect interaction using tools can be handled in the same way through the probe zone. This method has good versatility, extendibility and reusability of interaction process. The effectiveness is verified through the application of actual projects.