基于HoloLens的多模态虚拟现实教学实验系统

Multi-modal Virtual Reality Teaching Experimental System Based on HoloLens

随着计算机技术发展和移动计算能力的提高,虚拟现实技术得到广泛应用。针对《计算机软件技术基础》理论课程和《计算机实践》实验课程要求,基于微软HoloLens全息智能眼镜和磁力驱动的力触觉交互模块,设计实现了视觉和力触觉融合的多模态虚拟现实实验系统,构建了符合课程教学要求的综合实验平台。基于这一综合实验平台,将计算机最新前沿技术引入课程教学,设计开发了综合性、创新性和开放性的实验项目,以此激发学生学习的积极性和主观能动性,巩固课程知识点,有效促进了学生计算机软件实践能力和创新能力的提高。

As the development of computer technology and the increase of mobile computing ability,virtual reality has been widely used in various application fields. Aiming at fulfilling the teaching requirements for the theoretical course of foundations of computer software technology and computer practice experimental course in universities of higher education,this paper presents a visual and haptic rendering based multi-modal virtual reality teaching experiment system,which includes the Microsoft HoloLens holographic intelligent glasses and the magnetic force based haptic rendering subsystem. On this multi-modal virtual reality experimental platform,comprehensive,innovative and open experimental projects were designed and developed to improve students’ motivation in their studies,which not only enhances their understanding of course knowledge,but also effectively improves their practical abilities and innovation abilities in software development.