A survey of real-time rendering on Web3D application

Background In recent years, with the rapid development of mobile Internet and Web3D technologies, a large number of web-based online 3D visualization applications have emerged. Web3D applications, including Web3D online tourism, Web3D online architecture, Web3D online education environment, Web3D online medical care, and Web3D online shopping are examples of these applications that leverage 3D rendering on the web. These applications have pushed the boundaries of traditional web applications that use text, sound, image, video, and 2D animation as their main communication media, and resorted to 3D virtual scenes as the main interaction object, enabling a user experience that delivers a strong sense of immersion. This paper approached the emerging Web3D applications that generate stronger impacts on people's lives through “real-time rendering technology”, which is the core technology of Web3D. This paper discusses all the major 3D graphics APIs of Web3D and the well-known Web3D engines at home and abroad and classify the real-time rendering frameworks of Web3D applications into different categories. Results Finally, this study analyzed the specific demand posed by different fields to Web3D applications by referring to the representative Web3D applications in each particular field. Conclusions Our survey results show that Web3D applications based on real-time rendering have in-depth sectors of society and even family, which is a trend that has influence on every line of industry.

Real-Time Rendering of Large-Scale Ocean Environments

Simulation and rendering of large-scale natural environments, especially the ocean, has always been one of the hot issues in computer graphics, which can provide realism for various applications such as computer game, movie and military usage. Simulation of ocean environment is often lack of realism for real-time application due to its complexity of dynamic waves. In this paper, a method based on FFT Wave model is proposed to solve this problem, which can also simulate the ocean optic property with atmosphere scattering. Furthermore, our method has a lot of advantages including global ocean dataset support, real-time, dynamic reflection of ocean, the foam on the wave, smooth transition from deep ocean to seacoast, etc. The experimental results demonstrate the realism and effectiveness of our approach.

Real-Time Rendering of Dynamic Clouds Using Multi-Resolution Adaptive Grids

The multi-resolution adaptive grids method is proposed to solve the problems of inefficiency in the previous grid-based methods,and it can be used in clouds simulation as well as the interactive simulation between objects and clouds.Oriented bounding box(OBB)hierarchical trees of objects are established,and the resolutions of global and local grids can be selected automatically.The motion equations of fluid dynamics are simplified.Upwind difference is applied to ensure the stability of the simulation process during the discrete process of partial differential equations.To solve the speed problem of existed phase functions,the improved phase function is applied to the illumination calculation of clouds.Experimental results show that the proposed methods can promote the simulation efficiency and meet the need for the simulation of large-scale clouds scene.Real-time rendering of clouds and the interaction between clouds and objects have been realized without preprocessing stage.

Two-phase real-time rendering method for realistic water refraction

Background Realistic rendering has been an important g oal of several interactive applications,which requires an efficient virtual simulation of many special effects that are common in the real world.However,refraction is often ignored in these applications.Rendering the refraction effect is extremely complicated and time-consuming.Methods In this study,a simple,efficient,and fast rendering technique of water refraction effects is proposed.This technique comprises a broad and narrow phase.In the broad phase,the water surface is considered flat.The vertices of underwater meshes are transformed based on Snell's Law.In the narrow phase,the effects of waves on the water surface are examined.Every pixel on the water surface mesh is collected by a screen-space method with an extra rendering pass.The broad phase redirects most pixels that need to be recalculated in the narrow phase to the pixels in the rendering buffer.Results We analyzed the performances of three different conventional methods and ours in rendering refraction effects for the same scenes.The proposed method obtains higher frame rate and physical accuracy comparing with other methods.It is used in several game scenes,and realistic water refraction effects can be generated efficiently.Conclusions The two-phase water refraction method produces a tradeoff between efficiency and quality.It is easy to implement in modern game engines,and thus improve the quality of rendering scenes in video games or other real-ti me applications.

Data-based real-time petrochemical gas diffusion simulation approach on virtual reality

Background Petrochemical products possess a high risk of flammability,explosivity,and toxicity,making petrochemical accidents exceedingly destructive.Therefore,disaster analysis,prediction,and real-time simulations have become important means of controlling and reducing accident hazards.Methods This study proposes a complete real-time simulation solution of gas diffusion with coordinate and concentration data,which was mainly aimed at simulating the types of harmful gas leakage and diffusion accidents in the petrochemical industry.The rendering effect was more continuous and accurate through grid homogenization and trilinear interpolation.This study presents a data processing and rendering parallelization process to enhance simulation efficiency.Gas concentration and fragment transparency were combined to synthesize transparent pixels in a scene.To ensure the approximate accuracy of the rendering effect,improve the efficiency of real-time rendering,and meet the requirement of intuitive perception using concentration data,a weighted blended order-independent transparency(OIT)with enhanced alpha weight is presented,which can provide a more intuitive perception of the hierarchical information of concentration data while preserving depth information.This study compares and analyzes three OIT algorithms-depth peeling,weighted blended OIT,and weighted blended OIT with enhanced alpha weight-in terms of rendering image quality,rendering time,required memory,and hierarchical information.Results Using weighted blended OIT with an enhanced alpha weight technique,the rendering time was shortened by 53.2%compared with that of the depth peeling algorithm,and the texture memory required was significantly smaller than that of the depth peeling algorithm.The rendering results of weighted blended OIT with an enhanced alpha weight were approximately accurate compared with those of the depth peeling algorithm as the ground truth,and there was no popping when surfaces passed through one another.Simultaneously,compared with weighted blended OIT,weighted blended OIT with an enhanced alpha weight achieved an intuitive perception of the hierarchical information of concentration data.

冬奥气象图形产品可视化模型研究

高质量图形产品是冬奥气象服务信息的重要载体。基于冬奥气象数据高时空分辨率特征,研究了由多维气象信息向制图要素转换的冬奥气象图形产品可视化概念模型;设计了由基于数据引擎的结构映射、赛事服务的空间映射、组件应用的元素映射和派生思想的属性映射组成的冬奥气象图形产品可视化过程模型。针对差异化、准实时气象服务制图需求,设计了基于DVDL可视化描述语言的制图表达框架,对可视化模型进行业务组织,研发了冬奥气象图形产品加工系统,提供50余种基础产品样式和所见即所得的制图编辑功能,支持任意位置点长时间序列气象产品、山地赛场三维气象产品和多赛区综合服务气象产品的制图渲染。成果在2022年北京冬奥会气象服务中应用,生产了200余种不用服务主题气象图形产品,后续也可为其他冬季赛事和重大活动气象服务保障提供精细化产品制作解决方案。

Real-time rendering of layered materials with anisotropic normal distributions

This paper proposes a lightweight bidirectional scattering distribution function(BSDF)model for layered materials with anisotropic reflection and refraction properties.In our method,each layer of the materials can be described by a microfacet BSDF using an anisotropic normal distribution function(NDF).Furthermore,the NDFs of layers can be defined on tangent vector fields,which differ from layer to layer.Our method is based on a previous study in which isotropic BSDFs are approximated by projecting them onto base planes.However,the adequateness of this previous work has not been well investigated for anisotropic BSDFs.In this paper,we demonstrate that the projection is also applicable to anisotropic BSDFs and that the BSDFs are approximated by elliptical distributions using covariance matrices.

A Fast Ambient Occlusion Method for Real-Time Plant Rendering

Global illumination effects are crucial for virtual plant rendering. Whereas real-time global illumination rendering of plants is impractical, ambient occlusion is an efficient alternative approximation. A tree model with millions of triangles is common, and the triangles can be considered as randomly distributed. The existing ambient occlusion methods fail to apply on such a type of object. In this paper, we present a new ambient occlusion method dedicated to real time plant rendering with limited user interaction. This method is a three-step ambient occlusion calculation framework which is suitable for a huge number of geometry objects distributed randomly in space. The complexity of the proposed algorithm is O（n）, compared to the conventional methods with complexities of O（n^2）. Furthermore, parameters in this method can be easily adjusted to achieve flexible ambient occlusion effects. With this ambient occlusion calculation method, we can manipulate plant models with millions of organs, as well as geometry objects with large number of randomly distributed components with affordable time, and with perceptual quality comparable to the previous ambient occlusion methods.

Domino Tiling:A New Method of Real-Time Conforming Mesh Construction for Rendering Changeable Height Fields

In this paper we present a novel GPU-oriented method of creating an inherently continuous triangular mesh for tile-based rendering of regular height fields. The method is based on tiling data-independent semi-regular meshes of non-uniform structure, a technique that is quite different from other mesh tiling approaches. A complete, memory efficient set of mesh patterns is created by an off-line procedure and stored into the graphics adapter＇s memory at runtime. At rendering time, for each tile, one of the precomputed mesh patterns is selected for rendering. The selected mesh pattern fits the required level of details of the tile and ensures seamless connection with other adjacent mesh patterns, like in a game of dominoes. The scalability potential of the proposed method is demonstrated through quadtree hierarchical grouping of tiles. The efficiency is verified by experimental results on height fields for terrain representation, where the method achieves high frame rates and sustained triangle throughput on high resolution viewports with sub-pixel error tolerance. Frame rate sensitivity to real-time modifications of the height field is measured, and it is shown that the method is very tolerant and consequently well tailored for applications dealing with rapidly changeable phenomena represented by height fields.

气象网格数据的快速渲染研究与应用

随着更高精度的气象网格数据在气象业务中的广泛应用,使用高精度网格数据为社会公众提供精细化气象服务的需求越来越旺盛。针对气象网格数据文件大,网页前端动态渲染效率低等问题,提出基于瓦片金字塔模型的网格数据快速传输和渲染技术的研究及应用。采用服务器端的金字塔模型的瓦片动态切割、压缩传输以及浏览器终端的插值和渲染等技术,实现基于B/S框架下HTML5的气象网格数据快速展示的流程。同时,利用中国区域1 km分辨率多源融合实况分析产品,基于微信小程序终端进行检验发布,试验结果表明,百兆级气象网格数据可视化更新时间达毫秒量级,可以广泛应用于各类空间网格数据高效可视化的页面渲染。

Development and Evaluation of Hourly and Kilometer Resolution Retrospective and Real-Time Surface Meteorological Blended Forcing Dataset(SMBFD) in China

A real-time,long-term surface meteorological blended forcing dataset(SMBFD)has been developed based on station observations,satellite retrievals,and reanalysis products in China.The observations are collected at national and regional automatic weather stations,satellite data are obtained from the Fengyun(FY)series satellites retrievals,and the reanalysis products are obtained from the ECMWF.The 90-m resolution digital terrain elevation data in China are obtained from the Shuttle Radar Topographic Mission(SRTM)for temperature and humidity elevation adjustment.The dataset includes 2-m air temperature and humidity,10-m zonal and meridional winds,downward shortwave radiation,surface pressure,and precipitation.The spatial resolution is 1 km,and the temporal resolution is 1 h.During the data processing procedure,various data fusion techniques including the space–time multiscale variational analysis,the discrete ordinates radiative transfer(DISORT)model,the hybrid radiation estimation model,and a terrain correction algorithm are employed.Dependent and independent evaluations of the dataset are performed against observations.The SMBFD dataset is also compared with similar datasets produced in other major meteorological operational centers in the world.The results are as follows.(1)All variables show reasonable geographic distribution features and realistic spatial and temporal variations.(2)Dependent and independent evaluations both indicate that the gridded SMBFD dataset is close to the observations,while the dependent evaluation yields better results than the independent evaluation.(3)Compared with similar datasets produced in other meteorological operational centers,the real-time and retrospective surface meteorological fusion data obviously have higher quality.The dataset introduced in the present study is in general stable and accurate,and can be applied in various practice such as meteorology,agriculture,ecology,environmental protection,etc.Meanwhile,this dataset has been used as the atmospheric forcing data to drive the operational High-resolution Land Data Assimilation System of China Meteorological Administration.The dataset with the network Common Data Form(NETCDF)can be decoded by various programming languages,and it is freely available to non-commercial users.

Foveated rendering:A state-of-the-art survey

Recently,virtual reality(VR)technology has been widely used in medical,military,manufacturing,entertainment,and other fields.These applications must simulate different complex material surfaces,various dynamic objects,and complex physical phenomena,increasing the complexity of VR scenes.Current computing devices cannot efficiently render these complex scenes in real time,and delayed rendering makes the content observed by the user inconsistent with the user’s interaction,causing discomfort.Foveated rendering is a promising technique that can accelerate rendering.It takes advantage of human eyes’inherent features and renders different regions with different qualities without sacrificing perceived visual quality.Foveated rendering research has a history of 31 years and is mainly focused on solving the following three problems.The first is to apply perceptual models of the human visual system into foveated rendering.The second is to render the image with different qualities according to foveation principles.The third is to integrate foveated rendering into existing rendering paradigms to improve rendering performance.In this survey,we review foveated rendering research from 1990 to 2021.We first revisit the visual perceptual models related to foveated rendering.Subsequently,we propose a new foveated rendering taxonomy and then classify and review the research on this basis.Finally,we discuss potential opportunities and open questions in the foveated rendering field.We anticipate that this survey will provide new researchers with a high-level overview of the state-of-the-art in this field,furnish experts with up-to-date information,and offer ideas alongside a framework to VR display software and hardware designers and engineers.

沙尘暴场景的参数化建模与实时绘制

沙尘暴是一种灾难性的自然景象,对沙尘暴的量化建模与实时绘制,在环境保护、灾难救援、城市交通及影视特技制作等领域有重要的应用价值.为此,提出了一种基于气象学原理的沙尘暴景象参数化建模方法,特别地,分析了上升气流与温度场的关系,并提供了模拟沙尘暴起沙和升流的简化模型.只需输入气压、气温、沙尘密度、场景类型等不同参数即可模拟出特定条件下的沙尘暴景象.在对沙尘暴景象进行实时绘制时,采用基于半角切片的前向多散射的体绘制模型,大大减少了了整体散射模型的计算量.对沙漠和城市场景不同程度沙尘暴景象的实时模拟结果表明了文中方法的有效性;最后采用气象计算模型对所生成的沙尘暴景象的能见度进行了定量的评估分析.

基于气象要素标量场对象的可视化及其应用

本文以气象要素标量场为对象，利用体绘制方法来实现其可视化。根 据气象数据特点以及可视化对数据集的要求，建立了一个气象要素标量场可视化 绘制模型，并给出绘制的实例，能达到实用的效果。

一种全球尺度三维大气数据可视化系统

气象数据具有时变、多源、多维度、数据量大和多尺度等特征,常规的气象数据可视化方法难以满足气象预报与气象研究中的需求.描述了一个新的全球尺度三维大气数据可视化系统——AVIS.系统实现了面向各类密度场、向量场、张量场和非空间数据的可视化方法,设计了适用于大气数据的球面体绘制和混合绘制方法.系统还实现了一套跨平台并行可视化及分析构架,支持在浏览器中或其他显示和交互设备上使用,并利用后端计算集群加速数据的计算与绘制过程.案例分析表明,该系统可以全方位地展现气象数据中的信息,帮助用户综合多种气象信息进行分析.

D-S算法在气象卫星功能仿真中的应用

气象卫星云图模拟是气象卫星功能仿真所研究的核心问题，在此研究了Diamond\|Square算法的原理与实现，然后应用正弦函数和高斯函数，从Diamond\|Square算法生成的二维数组出发，构造三维离散数据场；运用体绘制技术实现三维数据场的可视化，得到卫星云图。

基于气象卫星数据的三维云景可视化方法

云景可视化是计算机图形学和虚拟现实领域的研究热点之一。目前基于气象卫星数据的三维云景可视化方法大部分是基于二维卫星云图,无法真实反映云的三维信息。提出一种基于云顶温度/云高/云光学厚度卫星产品数据的三维云景直接可视化方法。该方法将整个空间视为由不同密度粒子构成的区域,首先得到粒子的分布函数,再由分布函数得到粒子的半径、密度等属性信息,完成云粒子模型构建;然后利用大气物理学相关知识计算粒子的光学参数;最后通过求解光在云粒子中的传播方程来得到云的三维可视化效果。实验结果表明该方法可以产生具有较高真实感的三维云景。

Real-Time Watercolor for Animation

We present algorithms that allow for reat-time rendering of 3D-scenes with a watercolor painting appearance,Our approach provides an appropriate simplification of the visual complexity,initates characteristic natural effects of watercolor,and provides two essential painting techniques,the wet-on-wet and the wet-on-dry painting.We concentrate on efficient algorithms based on image space processing rather than on an exact simulation.This allows for the real-time rendering of 3D-scenes.During an animation a high frame-to-frame coherence can be achieved due to a stable segmentation scheme.Finally,we seamlessly integrate a smooth illumination into the watercolor renderings nsing information from the 3D-scenc.

Temporal and spatial anti-aliasing for rendering reflections on water waves

The reflection of a bright light source on a dynamic surface such as water with waves can be difficult to render well in real time due to reflection aliasing and flickering.In this paper,we propose a solution to this problem by approximating the reflection direction distribution for the water surface as an elliptical Gaussian distribution.Then we analytically integrate the reflection contribution throughout the rendering interval time.Our method can render in real time an animation of the time integrated reflection of a spherical light source on highly dynamic waves with reduced aliasing and flickering.

面向移动计算平台的气象数据可视化系统关键技术

移动计算时代的到来伴随着人工智能、大数据挖掘、GPU并行计算等信息技术的飞跃和Web技术规范的统一,这一发展促进了众多面向移动计算平台的气象数据可视化应用的诞生和蓬勃发展。然而移动计算设备存在计算能力较弱、图形软件库功能不齐全的缺陷,造成国内的气象应用存在着可视化方法陈旧、浏览器兼容性和性能不理想的问题。为此,本文设计并实现了基于B/S架构、面向移动计算的气象数据交互分析与显示系统WeatherApp。首先研发了二三维一体化的数字地球引擎,该引擎提供了常用的地理信息系统功能,能够在不同维度视图之间快速切换,为全新渲染方法的引入奠定了基础。其次,实现了包括流线和体绘制在内的高级三维可视化方法。本系统已应用于台风预报业务中并取得较好的应用效果。通过支持所有主流桌面和手机浏览器,WeatherApp能够让用户随时随地通过移动计算设备查看感兴趣的资料,进而提高工作效率。