虚拟环境下的低延迟协同渲染方法研究

Research on Low Latency Collaborative Rendering inVirtual Environment

虚拟现实技术以其独特的沉浸感、交互性,在游戏、直播等各领域的应用愈加广泛。渲染技术是虚拟现实的核心环节之一,而只在本地客户端渲染是目前主要渲染方案,由于实时渲染需要大量的计算资源,导致虚拟现实应用存在响应延迟高、画面刷新率低、图像质量差以及虚拟场景复杂等问题。针对上述问题,该文提出了虚拟环境下低延迟协同渲染方法。首先,将复杂的虚拟环境进行前景交互和背景环境拆分;其次,将渲染工作量较大的背景环境卸载至服务端进行处理;最后,通过运动轨迹预测将渲染的复杂背景以全景图的方式进行分割编码传输至客户端与前景渲染的内容进行合并呈现。经过实验验证,这种协同渲染的方法能够进一步降低传输过程中的CPU/GPU利用率以及网络延迟,提高帧刷新率,进而实现高清低延迟交互。

With its unique sense of immersion and interactivity,virtual reality technology is increasingly widely used in various fields such as games and live broadcasting.Rendering technology is one of the core links of virtual reality,and only rendering on the local client is the main rendering scheme at present.Due to the large amount of computing resources required for real-time rendering,virtual reality applications have problems such as high response delay,low image refresh rate,poor image quality and complex virtual scenes.To solve the above problems,we propose a low latency collaborative rendering method in virtual environment.Firstly,the complex virtual environment between foreground interaction and background environment is split.Secondly,the background environment with a high rendering workload is offloaded to the server for processing.Finally,the complex background is segmented and encoded in the way of panorama through motion trajectory prediction and transmitted to the client for merging with the foreground rendered content.After experimental verification,the collaborative rendering method can further reduce the CPU/GPU utilization and network latency in the transmission process,and improve the frame refresh rate,thus achieving high definition and low latency interaction.