虚拟环境下面向装配培训的人机交互技术

Human-Computer Interaction Technology for Assembly Training under Virtual Reality

随着高新产品的不断出现,零件的复杂程度不断提高,对装配工人的技术培训要求也越来越高,若使用物理样机进行装配培训,增加了企业成本,提高了培训场地需求,而通过构建虚拟样机,利用人机交互进行装配培训是一个缩短周期,降低成本有效的手段;以手势输入设备LeapMotion为基础,利用Unity3D开发了相应的功能,实现了虚拟手与零件的交互以及装配信息的显示,同时设计了虚拟环境中人机交互的虚拟操作面板,实现了人与电子手册的交互;应用表明:研究为虚拟环境下装配培训提供了很好的人机交互,增强了装配培训的效果。

Assembly is an important guarantee of product quality.With the continuous emergence of high-technology products,the complexity of parts is constantly increased,and the requirement of technical training for assembly workers is becoming higher and higher.If the assembly training is carried out by using physical prototype,the cost of enterprises will be further increased,and the requirement for training sites will be demanded.By constructing virtual prototype,it is an effective ways to shorten the cycle and reduce costs with the assembly training be carried out by using human-computer interaction.Based on the gesture input device LeapMotion,the corresponding functions were developed to realize the interaction between virtual hand and parts and the display of assembly information with Unity3D.Meanwhile,the human-computer interaction interface was also achieved in the virtual environment according to the training requirements between human and electronic manuals through the virtual operation panel.The application shows that this research provides a good human-computer interaction for assembly training in virtual environment,and improves the effect of assembly training.