A survey of real-time rendering on Web3D application

Background In recent years, with the rapid development of mobile Internet and Web3D technologies, a large number of web-based online 3D visualization applications have emerged. Web3D applications, including Web3D online tourism, Web3D online architecture, Web3D online education environment, Web3D online medical care, and Web3D online shopping are examples of these applications that leverage 3D rendering on the web. These applications have pushed the boundaries of traditional web applications that use text, sound, image, video, and 2D animation as their main communication media, and resorted to 3D virtual scenes as the main interaction object, enabling a user experience that delivers a strong sense of immersion. This paper approached the emerging Web3D applications that generate stronger impacts on people's lives through “real-time rendering technology”, which is the core technology of Web3D. This paper discusses all the major 3D graphics APIs of Web3D and the well-known Web3D engines at home and abroad and classify the real-time rendering frameworks of Web3D applications into different categories. Results Finally, this study analyzed the specific demand posed by different fields to Web3D applications by referring to the representative Web3D applications in each particular field. Conclusions Our survey results show that Web3D applications based on real-time rendering have in-depth sectors of society and even family, which is a trend that has influence on every line of industry.

Real-Time Rendering of Large-Scale Ocean Environments

Simulation and rendering of large-scale natural environments, especially the ocean, has always been one of the hot issues in computer graphics, which can provide realism for various applications such as computer game, movie and military usage. Simulation of ocean environment is often lack of realism for real-time application due to its complexity of dynamic waves. In this paper, a method based on FFT Wave model is proposed to solve this problem, which can also simulate the ocean optic property with atmosphere scattering. Furthermore, our method has a lot of advantages including global ocean dataset support, real-time, dynamic reflection of ocean, the foam on the wave, smooth transition from deep ocean to seacoast, etc. The experimental results demonstrate the realism and effectiveness of our approach.

Real-Time Rendering of Dynamic Clouds Using Multi-Resolution Adaptive Grids

The multi-resolution adaptive grids method is proposed to solve the problems of inefficiency in the previous grid-based methods,and it can be used in clouds simulation as well as the interactive simulation between objects and clouds.Oriented bounding box(OBB)hierarchical trees of objects are established,and the resolutions of global and local grids can be selected automatically.The motion equations of fluid dynamics are simplified.Upwind difference is applied to ensure the stability of the simulation process during the discrete process of partial differential equations.To solve the speed problem of existed phase functions,the improved phase function is applied to the illumination calculation of clouds.Experimental results show that the proposed methods can promote the simulation efficiency and meet the need for the simulation of large-scale clouds scene.Real-time rendering of clouds and the interaction between clouds and objects have been realized without preprocessing stage.

Two-phase real-time rendering method for realistic water refraction

Background Realistic rendering has been an important g oal of several interactive applications,which requires an efficient virtual simulation of many special effects that are common in the real world.However,refraction is often ignored in these applications.Rendering the refraction effect is extremely complicated and time-consuming.Methods In this study,a simple,efficient,and fast rendering technique of water refraction effects is proposed.This technique comprises a broad and narrow phase.In the broad phase,the water surface is considered flat.The vertices of underwater meshes are transformed based on Snell's Law.In the narrow phase,the effects of waves on the water surface are examined.Every pixel on the water surface mesh is collected by a screen-space method with an extra rendering pass.The broad phase redirects most pixels that need to be recalculated in the narrow phase to the pixels in the rendering buffer.Results We analyzed the performances of three different conventional methods and ours in rendering refraction effects for the same scenes.The proposed method obtains higher frame rate and physical accuracy comparing with other methods.It is used in several game scenes,and realistic water refraction effects can be generated efficiently.Conclusions The two-phase water refraction method produces a tradeoff between efficiency and quality.It is easy to implement in modern game engines,and thus improve the quality of rendering scenes in video games or other real-ti me applications.

Real-time rendering of large-scale static scene

In virtual simulation application, it is often necessary to use Open GL to render large-scale 3D static scenes including urban architectures. Each scene unit generally has individual vertex data and texture. For large-scale data set, it is hard to render all scene units simultaneously. We need to render part of the scene separately, which is called the scene partition and culling. In general, we partition the whole scene into different units on the CPU. We present a scheme that optimize the GPU rendering pipeline to cull the large-scale static scene, which will reduce the CPU suspending time and take full advantage of GPU computing advantages to speed up the rendering efficiency.

Shadow Volume in Real-Time Rendering

This paper presents an optimization of shadow volume algorithm, which allow a rendering in real-time. This technique is based on previous works which makes it possible to obtain shadows in real-time, although the calculation of the silhouette requires a pretreatment of the geometry implemented on the CPU （Central Processing Unit）. By using last version of the GPU （Graphic Processing Unit）, the authors propose to implement the calculation of the silhouette on the GPU by using Geometry Shader. The authors present the step which made it possible to lead to a concrete implementation of this algorithm, the modifications which were made, as well as a comparative study of results, followed by a discussion of these results and choices of implementation.

RenderKernel:High-level programming for real-time rendering systems

Real-time rendering applications leverage heterogeneous computing to optimize performance.However,software development across multiple devices presents challenges,including data layout inconsistencies,synchronization issues,resource management complexities,and architectural disparities.Additionally,the creation of such systems requires verbose and unsafe programming models.Recent developments in domain-specific and unified shading languages aim to mitigate these issues.Yet,current programming models primarily address data layout consistency,neglecting other persistent challenges.In this paper,we introduce RenderKernel,a programming model designed to simplify the development of real-time rendering systems.Recognizing the need for a high-level approach,RenderKernel addresses the specific challenges of real-time rendering,enabling development on heterogeneous systems as if they were homogeneous.This model allows for early detection and prevention of errors due to system heterogeneity at compile-time.Furthermore,RenderKernel enables the use of common programming patterns from homogeneous environments,freeing developers from the complexities of underlying heterogeneous systems.Developers can focus on coding unique application features,thereby enhancing productivity and reducing the cognitive load associated with real-time rendering system development.

Platform for dynamic virtual auditory environment real-time rendering system

This paper reports the recent works and progress on a PC and C++ language-based virtual auditory environment(VAE) system platform.By tracing the temporary location and orientation of listener's head and dynamically simulating the acoustic propagation from sound source to two ears,the system is capable of recreating free-field virtual sources at various directions and distances as well as auditory perception in reflective environment via headphone presentation.Schemes for improving VAE performance,including PCA-based(principal components analysis) near-field virtual source synthesis,simulating six degrees of freedom of head movement,are proposed.Especially,the PCA-based scheme greatly reduces the computational cost of multiple virtual sources synthesis.Test demonstrates that the system exhibits improved performances as compared with some existing systems.It is able to simultaneously render up to 280 virtual sources using conventional scheme,and 4500 virtual sources using the PCA-based scheme.A set of psychoacoustic experiments also validate the performance of the system,and at the same time,provide some preliminary results on the research of binaural hearing.The functions of the VAE system is being extended and the system serves as a flexible and powerful platform for future binaural hearing researches and virtual reality applications.

基于Real-time PCR法检测乳粉中牛源性成分定量研究

基于Real-timePCR建立了乳粉中牛源性成分相对定量检测方法,并对牛的特异性引物与探针进行了特异性、灵敏度和稳定性测试。通过模拟不同浓度牛乳粉与马乳粉混合样本,根据其△Ct值的函数关系进行线性拟合进而绘制标准曲线,建立乳粉中牛源性成分的相对定量检测。结果显示,该方法的最低检测限为0.00001 mg/mL,回收率为91.11%~119.2%,组间变异系数≤0.58%、组内变异系数≤1.44%。说明该方法在特异性与稳定性上适用于乳粉中牛源性成分及含量的掺假检测。

A multifunctional shear apparatus for rocks subjected to true triaxial stress and high temperature in real-time

Deep engineering disasters,such as rockbursts and collapses,are more related to the shear slip of rock joints.A novel multifunctional device was developed to study the shear failure mechanism in rocks.Using this device,the complete shearedeformation process and long-term shear creep tests could be performed on rocks under constant normal stiffness(CNS)or constant normal loading(CNL)conditions in real-time at high temperature and true-triaxial stress.During the research and development process,five key technologies were successfully broken through:(1)the ability to perform true-triaxial compressioneshear loading tests on rock samples with high stiffness;(2)a shear box with ultra-low friction throughout the entire stress space of the rock sample during loading;(3)a control system capable of maintaining high stress for a long time and responding rapidly to the brittle fracture of a rock sample as well;(4)a refined ability to measure the volumetric deformation of rock samples subjected to true triaxial shearing;and(5)a heating system capable of maintaining uniform heating of the rock sample over a long time.By developing these technologies,loading under high true triaxial stress conditions was realized.The apparatus has a maximum normal stiffness of 1000 GPa/m and a maximum operating temperature of 300C.The differences in the surface temperature of the sample are constant to within5C.Five types of true triaxial shear tests were conducted on homogeneous sandstone to verify that the apparatus has good performance and reliability.The results show that temperature,lateral stress,normal stress and time influence the shear deformation,failure mode and strength of the sandstone.The novel apparatus can be reliably used to conduct true-triaxial shear tests on rocks subjected to high temperatures and stress.

Pore-pressure and stress-coupled creep behavior in deep coal:Insights from real-time NMR analysis

Understanding the variations in microscopic pore-fracture structures(MPFS) during coal creep under pore pressure and stress coupling is crucial for coal mining and effective gas treatment. In this manuscript, a triaxial creep test on deep coal at various pore pressures using a test system that combines in-situ mechanical loading with real-time nuclear magnetic resonance(NMR) detection was conducted.Full-scale quantitative characterization, online real-time detection, and visualization of MPFS during coal creep influenced by pore pressure and stress coupling were performed using NMR and NMR imaging(NMRI) techniques. The results revealed that seepage pores and microfractures(SPM) undergo the most significant changes during coal creep, with creep failure gradually expanding from dense primary pore fractures. Pore pressure presence promotes MPFS development primarily by inhibiting SPM compression and encouraging adsorption pores(AP) to evolve into SPM. Coal enters the accelerated creep stage earlier at lower stress levels, resulting in more pronounced creep deformation. The connection between the micro and macro values was established, demonstrating that increased porosity at different pore pressures leads to a negative exponential decay of the viscosity coefficient. The Newton dashpot in the ideal viscoplastic body and the Burgers model was improved using NMR experimental results, and a creep model that considers pore pressure and stress coupling using variable-order fractional operators was developed. The model’s reasonableness was confirmed using creep experimental data. The damagestate adjustment factors ω and β were identified through a parameter sensitivity analysis to characterize the effect of pore pressure and stress coupling on the creep damage characteristics(size and degree of difficulty) of coal.

Real-time rendering of layered materials with anisotropic normal distributions

This paper proposes a lightweight bidirectional scattering distribution function(BSDF)model for layered materials with anisotropic reflection and refraction properties.In our method,each layer of the materials can be described by a microfacet BSDF using an anisotropic normal distribution function(NDF).Furthermore,the NDFs of layers can be defined on tangent vector fields,which differ from layer to layer.Our method is based on a previous study in which isotropic BSDFs are approximated by projecting them onto base planes.However,the adequateness of this previous work has not been well investigated for anisotropic BSDFs.In this paper,we demonstrate that the projection is also applicable to anisotropic BSDFs and that the BSDFs are approximated by elliptical distributions using covariance matrices.

一种基于real-time PCR技术的TTV检测方法的建立及应用

目的:本研究旨在开发一种具有更高灵敏度和特异性的TTV检测技术,为揭示TTV在多种疾病过程中的作用提供重要的技术支持。方法:为了更精确、灵敏的检测TTV,本研究分析了目前公布的所有亚型的TTV基因序列,在此基础上建立了一种基于UTR区域的real-time PCR检测方法,并与文献报道应用较为广泛的PCR检测方法进行了对比。结果:本研究建立的方法在1×10^(7)~1×10^(1) copies/μL标准品浓度范围内具有良好的线性关系,相关系数为1.000,斜率为-3.446,检测下限为1×10^(1) copies/μL。重复性试验结果显示,组内变异系数为7.22%,表明本方法重复性、稳定性较强。针对30份临床样本,使用本研究建立的real-time PCR检测方法及目前被多个研究所使用的4套引物进行对比。结果表明,本研究所建立的方法灵敏度显著高于文献中报道的4种方法(P<0.01);Sanger测序结果表明,本方法检测出的30份阳性样本均为TTV,检测特异性为100%。结论:本研究采用基于TaqMan探针的real-time PCR检测方法,检测灵敏性高、覆盖基因型范围广,尤其对于TTV病毒载量较低的情况下能够进行定量检测,对于TTV病毒的致病性及作为免疫标志物的应用提供重要的技术支持。

Real-time data processing method for CO_(2) dispersion interferometer on EAST

A real-time data processing system is designed for the carbon dioxide dispersion interferometer(CO_(2)-DI)on EAST.The system utilizes the parallel and pipelining capabilities of an fieldprogrammable gate array(FPGA)to digitize and process the intensity of signals from the detector.Finally,the real-time electron density signals are exported through a digital-to-analog converter(DAC)module in the form of analog signals.The system has been successfully applied in the CO_(2)-DI system to provide low-latency electron density input to the plasma control system on EAST.Experimental results of the latest campaign with long-pulse discharges on EAST(2022–2023)demonstrate that the system can respond effectively in the case of rapid density changes,proving its reliability and accuracy for future electron density calculation.

Real-Time Intelligent Diagnosis of Co-frequency Vibration Faults in Rotating Machinery Based on Lightweight-Convolutional Neural Networks

The co-frequency vibration fault is one of the common faults in the operation of rotating equipment,and realizing the real-time diagnosis of the co-frequency vibration fault is of great significance for monitoring the health state and carrying out vibration suppression of the equipment.In engineering scenarios,co-frequency vibration faults are highlighted by rotational frequency and are difficult to identify,and existing intelligent methods require more hardware conditions and are exclusively time-consuming.Therefore,Lightweight-convolutional neural networks(LW-CNN)algorithm is proposed in this paper to achieve real-time fault diagnosis.The critical parameters are discussed and verified by simulated and experimental signals for the sliding window data augmentation method.Based on LW-CNN and data augmentation,the real-time intelligent diagnosis of co-frequency is realized.Moreover,a real-time detection method of fault diagnosis algorithm is proposed for data acquisition to fault diagnosis.It is verified by experiments that the LW-CNN and sliding window methods are used with high accuracy and real-time performance.

Real-time debris flow monitoring and automated warning system

At present,debris flow warning uses precipitation threshold and issues regional warning throughout the world.Precipitation threshold warning is less accurate and in most of the time large portion of unaffected population are evacuated.More precise warning should use direct monitoring.There are many debris flow monitoring stations but no real time warning system in use.The main reason is that the identification and confirmation of debris flow occurrence requires human interaction and it is too slow.A debris flow monitoring and warning system has been installed in the midstream section of Yusui Stream,Taiwan China.The monitoring station operates fully automatically,providing early warnings without the need for manual intervention.The system comprises two webcam cameras,two Micro-Electro-Mechanical Systems(MEMS),and a rain gauge.The arrival of debris flows is detected and confirmed through both webcam images and MEMS signals.Once debris flow is detected,the system automatically issues a warning to the affected areas via voice messages,line messages,broadcasts,and web-based alerts.The webcam cameras are also used to estimate debris flow velocity and flow height,while the MEMS sensors are utilized to determine the phase speed and flow rate.On July 24th,2014,Typhoon Gaemi triggered several debris flows,and the system successfully issued several warnings automatically.The entire video record,along with depth variation data,was recorded automatically.

Nanomaterial-assisted wearable glucose biosensors for noninvasive real-time monitoring:Pioneering point-of-care and beyond

This review explores glucose monitoring and management strategies,emphasizing the need for reliable and userfriendly wearable sensors that are the next generation of sensors for continuous glucose detection.In addition,examines key strategies for designing glucose sensors that are multi-functional,reliable,and cost-effective in a variety of contexts.The unique features of effective diabetes management technology are highlighted,with a focus on using nano/biosensor devices that can quickly and accurately detect glucose levels in the blood,improving patient treatment and control of potential diabetes-related infections.The potential of next-generation wearable and touch-sensitive nano biomedical sensor engineering designs for providing full control in assessing implantable,continuous glucose monitoring is also explored.The challenges of standardizing drug or insulin delivery doses,low-cost,real-time detection of increased blood sugar levels in diabetics,and early digital health awareness controls for the adverse effects of injectable medication are identified as unmet needs.Also,the market for biosensors is expected to expand significantly due to the rising need for portable diagnostic equipment and an ever-increasing diabetic population.The paper concludes by emphasizing the need for further research and development of glucose biosensors to meet the stringent requirements for sensitivity and specificity imposed by clinical diagnostics while being cost-effective,stable,and durable.

Integrated strategy for real-time wind power fluctuation mitigation and energy storage system control

To address the impact of wind-power fluctuations on the stability of power systems,we propose a comprehensive approach that integrates multiple strategies and methods to enhance the efficiency and reliability of a system.First,we employ a strategy that restricts long-and short-term power output deviations to smoothen wind power fluctuations in real time.Second,we adopt the sliding window instantaneous complete ensemble empirical mode decomposition with adaptive noise(SW-ICEEMDAN)strategy to achieve real-time decomposition of the energy storage power,facilitating internal power distribution within the hybrid energy storage system.Finally,we introduce a rule-based multi-fuzzy control strategy for the secondary adjustment of the initial power allocation commands for different energy storage components.Through simulation validation,we demonstrate that the proposed comprehensive control strategy can smoothen wind power fluctuations in real time and decompose energy storage power.Compared with traditional empirical mode decomposition(EMD),ensemble empirical mode decomposition(EEMD),and complete ensemble empirical mode decomposition with adaptive noise(CEEMDAN)decomposition strategies,the configuration of the energy storage system under the SW-ICEEMDAN control strategy is more optimal.Additionally,the state-of-charge of energy storage components fluctuates within a reasonable range,enhancing the stability of the power system and ensuring the secure operation of the energy storage system.

Real-Time Detection and Instance Segmentation of Strawberry in Unstructured Environment

The real-time detection and instance segmentation of strawberries constitute fundamental components in the development of strawberry harvesting robots.Real-time identification of strawberries in an unstructured envi-ronment is a challenging task.Current instance segmentation algorithms for strawberries suffer from issues such as poor real-time performance and low accuracy.To this end,the present study proposes an Efficient YOLACT(E-YOLACT)algorithm for strawberry detection and segmentation based on the YOLACT framework.The key enhancements of the E-YOLACT encompass the development of a lightweight attention mechanism,pyramid squeeze shuffle attention(PSSA),for efficient feature extraction.Additionally,an attention-guided context-feature pyramid network(AC-FPN)is employed instead of FPN to optimize the architecture’s performance.Furthermore,a feature-enhanced model(FEM)is introduced to enhance the prediction head’s capabilities,while efficient fast non-maximum suppression(EF-NMS)is devised to improve non-maximum suppression.The experimental results demonstrate that the E-YOLACT achieves a Box-mAP and Mask-mAP of 77.9 and 76.6,respectively,on the custom dataset.Moreover,it exhibits an impressive category accuracy of 93.5%.Notably,the E-YOLACT also demonstrates a remarkable real-time detection capability with a speed of 34.8 FPS.The method proposed in this article presents an efficient approach for the vision system of a strawberry-picking robot.

A real-time performance improvement method for composite time scale

The composite time scale(CTS)provides a stable,accurate,and reliable time scale for modern society.The improvement of CTS’s real-time performance will improve its stability,which strengths related applications’performance.Aiming at this goal,a method achieved by determining the optimal calculation interval and accelerating adjustment stage is proposed in this paper.The determinants of the CTS’s calculation interval(characteristics of the clock ensemble,the measurement noise,the time and frequency synchronization system’s noise and the auxiliary output generator noise floor)are studied and the optimal calculation interval is obtained.We also investigate the effect of ensemble algorithm’s initial parameters on the CTS’s adjustment stage.A strategy to get the reasonable initial parameters of ensemble algorithm is designed.The results show that the adjustment stage can be finished rapidly or even can be shorten to zero with reasonable initial parameters.On this basis,we experimentally generate a distributed CTS with a calculation interval of 500 s and its stability outperforms those of the member clocks when the averaging time is longer than1700 s.The experimental result proves that the CTS’s real-time performance is significantly improved.