基于虚拟现实的多感官视觉交互界面生成方法

Multi Sensory Visual Interactive Interface Generation Method Based on Virtual Reality

以提升交互界面生成结果与实际物体的拟合度,为用户提供更真实的交互效果为目的,研究基于虚拟现实的多感官视觉交互界面生成方法。交互界面生成过程分为两个环节,设计内容环节包括视觉信息设计与交互方式设计,视觉信息设计中将交互界面最终布局的视觉注意力划分最优作为目标函数,设计基于视觉注意力的功能界面布局优化模型,利用粒子群算法求解该模型完成功能界面布局设计;针对功能界面中的不同区域,通过3D几何模型构建、纹理映射等过程构建三维物体与情景空间的三维模型,生成不同区域内所需图像信息。多感官视觉体验设计过程中,采用ANNS-DS信息融合算法融合传感信息、体感信息与视觉信息,基于融合结果实现虚拟现实图形显示、振动与声音反馈等界面交互功能,并结合设计内容环节中的交互方式设计提升用户对交互界面的多感官视觉体验感受。应用结果显示该方法所生成的交互界面内物体与情景空间图像的拟合度均高于0.9,可通过视觉、听觉等不同感官提升用户的体验感受。

In order to improve the fitting degree between interactive interface generation results and real objects, and provide users with more real interactive effects, the generation method of multi-sensory visual interactive interface based on virtual reality is studied. The interface generation process is divided into two areas, the design content link includes visual information design and interaction design, visual information design. In the visual information design, the optimal visual attention division of the final layout of the interactive interface is taken as the objective function, and the function of the design is based on the visual attention interface layout optimization model, using particle swarm optimization(PSO) algorithm solving the model complete function layout design. Aiming at different areas in the functional interface, 3 D models of 3 D objects and scene space were constructed through 3 D geometric model construction, texture mapping and other processes to generate the required image information in different areas. In the process of Multi-sensory visual experience design, the ANNS-DS information fusion algorithm is used to fuse sensing information, body feeling and visual information, and based on the fusion results, the graphic display of virtual reality, vibration and sound feedback interface interaction capabilities are realized, and the interaction mode in the design content link is designed to improve the user’s multi-sensory visual experience of the interactive interface. The application results show that the fitting degree of objects in the interactive interface generated by this method is higher than 0.9,and the user experience can be improved through different senses such as vision and hearing.