Hololens混合现实Leap发动机诱导维修系统开发

Development of Induction Maintenance System for Hololens Hybrid Reality Leap Engine

随着5G通信、人工智能(AI)、虚拟现实(Virtual Reality,VR)、增强现实(Augmented Reality,AR)和混合现实(Mixed Reality,MR)等技术的发展,结合多媒体体系交互使新型信息教学方式变得可能。基于当今民航维修业发展趋势,顺应混合现实技术在国内的迅速发展及大环境下互联网技术的发展模式,该系统研究并开发了以用户为中心的人性化、智能化的Hololens混合现实LEAP发动机诱导维修系统,帮助用户完成复杂的维修工作。以虚拟集成开发平台Unity3D核心,结合Solidworks、3Dmax、C4D等对场景中的机械以及人物进行建模;在CPU层面借助Visual Studio编辑器采用C#脚本语言为核心的多语言开发,结合在GPU层面的图形渲染编程语言,突出虚拟中的优点以及重点的视觉效果;利用混合现实交互技术以及Vuforia进行实物扫描与识别,实现虚拟和现实的对接,形成视觉、听觉、触觉结合的多媒体交互体系,突破空间、时间和现实约束,在现实世界中投射出全面、逼真、可交互的航空发动机模型,构建以Hololens为基础的三维混合现实维修体系。

With the development of 5 G communication, artificial intelligence(AI), VirtualReality(VR), Augmented Reality(AR) and Mixed Reality(MR) technologies, it is possible to integrate the interaction of multimedia systems into new information teaching methods. Based on the current development trend of civil aviation maintenance industry and in line with the rapid development of hybrid reality technology in China and the development mode of Internet technology in the general environment, this system studies and develops a user-centered humanized and intelligent Hololens hybrid reality leap engine induction maintenance system to help users complete complex maintenance work. Taking the virtual integrated development platform Unity3 D as the core, combined with Solidworks, 3 Dmax, C4 D, etc., to model the machinery and characters in the scene;at the CPU level, with the help of visual studio editor, the multi language development with C# script language as the core, combined with the graphics rendering programming language at the GPU level, highlights the advantages of virtual and key visual effects;the hybrid reality interaction technology and Vuforia are used for physical scanning and recognition to realize the connection between virtual and reality, form a multimedia interaction system combining vision, hearing and touch, break through the constraints of space, time and reality, and project a comprehensive, realistic and interactive aeroengine model in the real world, Build a three-dimensional hybrid reality maintenance system based on Hololens.