中学化学沉浸式虚拟实验系统研究

Researching on immersive virtual chemistry experiment system for middle schools

为解决中学化学实验操作要求高、危险系数大、三废处理难等问题,本文结合虚拟现实技术和自然人机交互技术基于Untiy3D设计开发了一套沉浸式虚拟化学实验系统。整个系统分为四大模块:实验场景控制模块借助模型贴图构建逼真度更高的虚拟实验环境;实验流程管控模块参考中学课本的实验考核要求定义实验进度、操作步骤、操作反馈等具体实验逻辑;沉浸式交互与显示模块中提供两种硬件呈现环境,一种采用Oculus+Leap Motion硬件环境,借助自然手势双目视觉追踪交互设计方法完成沉浸式交互操作,另一种采用Cardboard+Visual Glove的硬件环境,通过单目视觉位置追踪方法实现沉浸式空间映射;实验综合评估模块从实验分析、实验能力判断、综合评价、详细评估多个角度进行量化评估。最后通过酸碱中和实验的制作过程证明本文系统的有效性。

In order to solve the problems of high operation demand,high risk factors and disposal difficulty of three wastes in middle school chemical experiment,this paper developed an immersive virtual chemical experiment system based on Untiy3D using virtual reality technology and natural human-computer interaction technology. The system is composed of four modules. The experimental scene control module constructs a realistic virtual experiment environment based on the model map; the experimental processmanagement module refers to the experimental assessment requirements of middle school textbooks to defines the specific experimental logic,such as the progress of experiment,operation steps,and operation feedback. The immersive interaction and display module provides two kinds of hardware presentation environment. One uses the Oculus＋Leap Motion hardware environment with the aid of the natural gesture binocular vision tracking interactive design method to complete the immersive interactive operation. The other uses the Cardboard ＋ Visual Glove hardware environment to realize immersive spatial mapping through a monocular vision position tracking method. The comprehensive evaluation module of the experiment evaluates quantitatively from multiple perspectives,such as experimental analysis,experimental ability judgement,comprehensive evaluation,and detailed assessment. Finally,the effectiveness of the system is verified by the process of acid-base neutralization experiment.