基于虚拟现实系统的声乐教学平台优化设计

An Optimal Design of Vocal Music Teaching Platform Based onVirtual Reality System

通过虚拟现实技术,实现一种声乐教学人机沉浸式交互系统、情境式虚拟场景及高仿真人物模型,展示虚拟现实技术在声乐教学方面的创新型实践运用。构建一套高仿真度、多感知维度的虚拟现实系统:创建多模态场景模型,建立完善的数据传输机制,并针对场景模型进行必要的优化处理;利用点阵技术精准模拟面部表情,借助投屏传输互动技术对虚拟角色进行实时绑定;配合定位追踪技术细化虚拟角色的手势动作,并在虚拟相机多视角的记录下完成关键数据的保存。经实践证明,上述系统激发学生内在体验、舞台临场、情景代入等多种感知体验,从而有针对性地解决学生学习过程中的演唱情感体验与表达等问题,具有较强的实践应用价值。

The purpose of this study is to use virtual reality technology to build a vocal teaching human-computer immersive interactive system including situational virtual scenes and high-simulation character models, and to demonstrate the virtual reality technology in the practice and application of vocal teaching. This study built a set of virtual reality system with high simulation degree and multi-perceptual dimensions: create a multi-modal scene model;establish a complete data transmission mechanism;perform necessary optimization processing for the scene model;use lattice technology to accurately simulate facial expressions and bind virtual characters in real-time with the help of screen projection and transmission interaction technology;coordinate the positioning and tracking technology to refine the gestures of the virtual characters and save critical data under the multi-view recording of the virtual camera. The results show that the system stimulates students’ inner experience, stage presence, scene substitution, and other perceptual experiences. Therefore, it solves the problems such as students’ emotional experience and singing with expression in the learning process. Thus, the system has a high practical application value.