Depth-aided inpainting for disocclusion restoration of multi-view images using depth-image-based rendering

A new algorithm is proposed for restoring disocclusion regions in depth-image-based rendering （DIBR） warped images. Current solutions include layered depth image （LDI）, pre-filtering methods, and post-processing methods. The LDI is complicated, and pre-filtering of depth images causes noticeable geometrical distortions in cases of large baseline warping. This paper presents a depth-aided inpainting method which inherits merits from Criminisi＇s inpainting algorithm. The proposed method features incorporation of a depth cue into texture estimation. The algorithm efficiently handles depth ambiguity by penalizing larger Lagrange multipliers of flling points closer to the warping position compared with the surrounding existing points. We perform morphological operations on depth images to accelerate the algorithm convergence, and adopt a luma-first strategy to adapt to various color sampling formats. Experiments on test multi-view sequence showed that our method has superiority in depth differentiation and geometrical loyalty in the restoration of warped images. Also, peak signal-to-noise ratio （PSNR） statistics on non-hole regions and whole image comparisons both compare favorably to those obtained by state of the art techniques.

End-to-End Paired Ambisonic-Binaural Audio Rendering

Binaural rendering is of great interest to virtual reality and immersive media. Although humans can naturally use their two ears to perceive the spatial information contained in sounds, it is a challenging task for machines to achieve binaural rendering since the description of a sound field often requires multiple channels and even the metadata of the sound sources. In addition, the perceived sound varies from person to person even in the same sound field. Previous methods generally rely on individual-dependent head-related transferred function(HRTF)datasets and optimization algorithms that act on HRTFs. In practical applications, there are two major drawbacks to existing methods. The first is a high personalization cost, as traditional methods achieve personalized needs by measuring HRTFs. The second is insufficient accuracy because the optimization goal of traditional methods is to retain another part of information that is more important in perception at the cost of discarding a part of the information. Therefore, it is desirable to develop novel techniques to achieve personalization and accuracy at a low cost. To this end, we focus on the binaural rendering of ambisonic and propose 1) channel-shared encoder and channel-compared attention integrated into neural networks and 2) a loss function quantifying interaural level differences to deal with spatial information. To verify the proposed method, we collect and release the first paired ambisonic-binaural dataset and introduce three metrics to evaluate the content information and spatial information accuracy of the end-to-end methods. Extensive experimental results on the collected dataset demonstrate the superior performance of the proposed method and the shortcomings of previous methods.

Research and Application of Caideng Model Rendering Technology for Virtual Reality

With the development of virtual reality (VR) technology, more and more industries are beginning to integrate with VR technology. In response to the problem of not being able to directly render the lighting effect of Caideng in digital Caideng scenes, this article analyzes the lighting model. It combines it with the lighting effect of Caideng scenes to design an optimized lighting model algorithm that fuses the bidirectional transmission distribution function (BTDF) model. This algorithm can efficiently render the lighting effect of Caideng models in a virtual environment. And using image optimization processing methods, the immersive experience effect on the VR is enhanced. Finally, a Caideng roaming interactive system was designed based on this method. The results show that the frame rate of the system is stable during operation, maintained above 60 fps, and has a good immersive experience.

SPEEDING-UP RE-SAMPLED ALGORITHM IN RAY CASTING VOLUME RENDERING OF MEDICAL IMAGES

Ray casting algorithm can obtain a better quality image in volume rendering, however, it exists some problems, such as powerful computing capacity and slow rendering speed. How to improve the re-sampled speed is a key to speed up the ray casting algorithm. An algorithm is introduced to reduce matrix computation by matrix transformation characteristics of re-sampling points in a two coordinate system. The projection of 3-D datasets on image plane is adopted to reduce the number of rays. Utilizing boundary box technique avoids the sampling in empty voxel. By extending the Bresenham algorithm to three dimensions, each re-sampling point is calculated. Experimental results show that a two to three-fold improvement in rendering speed using the optimized algorithm, and the similar image quality to traditional algorithm can be achieved. The optimized algorithm can produce the required quality images, thus reducing the total operations and speeding up the volume rendering.

Very-High Color Rendering Index Hybrid White Organic Light-Emitting Diodes with Double Emitting Nanolayers

A very-high color rendering index white organic light-emitting diode(WOLED) based on a simple structure was successfully fabricated. The optimized device exhibits a maximum total efficiency of 13.1 and 5.4 lm/W at 1,000 cd/m2. A peak color rendering index of 90 and a relatively stable color during a wide range of luminance were obtained. In addition, it was demonstrated that the 4,40,400-tri(9-carbazoyl) triphenylamine host influenced strongly the performance of this WOLED.These results may be beneficial to the design of both material and device architecture for high-performance WOLED.

A Mixed-Depth Visual Rendering Method for Bleeding Simulation

The visual fidelity of bleeding simulation in a surgical simulator is critical since it will affect not only the degree of visual realism,but also the user’s medical judgment and treatment in real-life settings.The conventional marching cubes surface rendering algorithm provides excellent visual effect in rendering gushing blood,however,it is insufficient for blood flow,which is very common in surgical procedures,since in this case the rendered surface and depth textures of blood are rough.In this paper,we propose a new method called the mixed depth rendering for rendering blood flow in surgical simulation.A smooth height field is created to minimize the height difference between neighboring particles on the bleeding surface.The color and transparency of each bleeding area are determined by the number of bleeding particles,which is consistent with the real visual effect.In addition,there is no much extra computational cost.The rendering of blood flow in a variety of surgical scenarios shows that visual feedback is much improved.The proposed mixed depth rendering method is also used in a neurosurgery simulator that we developed.

Cluster parallel rendering based on encoded mesh

Use of compressed mesh in parallel rendering architecture is still an unexplored area, the main challenge of which is to partition and sort the encoded mesh in compression-domain. This paper presents a mesh compression scheme PRMC (Parallel Rendering based Mesh Compression) supplying encoded meshes that can be partitioned and sorted in parallel rendering system even in encoded-domain. First, we segment the mesh into submeshes and clip the submeshes’ boundary into Runs, and then piecewise compress the submeshes and Runs respectively. With the help of several auxiliary index tables, compressed submeshes and Runs can serve as rendering primitives in parallel rendering system. Based on PRMC, we design and implement a parallel rendering architecture. Compared with uncompressed representation, experimental results showed that PRMC meshes applied in cluster parallel rendering system can dramatically reduce the communication requirement.

使用Light Field Rendering实现森林的实时渲染及光照算法

森林的实时渲染及光照是视景系统中的一个难题.基于图像的渲染方法(IBR)由于渲染速度与模型复杂度无关,被广泛应用于场景重建.基于光流场(Light Field Rendering)的IBR技术,提出一种迭代投射算法来进行外形重建,实现了具有实时光影特征的森林效果.实验表明该算法结合了传统迭代、投射算法各自的优点,在质量和效率方面取得了平衡.

Introducing Cinematic Rendering: A Novel Technique for Post-Processing Medical Imaging Data

Since the 1980s, various techniques have been used in the field of medicine for the post-processing of medical imaging data from computed tomography (CT) and magnetic resonance (MR). They include multiplanar reformations (MPR), maximum intensity projection (MIP) and Volume Rendering (VR). This paper presents the prototype of a new means of post-processing radiological examinations such as CT and MR, a technique that, for the first time, provides photorealistic visualizations of the human body. This new procedure was inspired by the quality of images achieved by animation software such as programs used in the entertainment industry, particularly to produce animated films. Thus, the name: Cinematic Rendering. It is already foreseeable that this new method of depiction will quickly be incorporated into the set of instruments employed in socalled virtual anatomy (teaching anatomy through the use of radiological depictions of the human body via X-ray, CT and MR in addition to the use of computer animation programs designed especially for human anatomy). Its potential for medical applications will have to be evaluated by future scientific investigations.

Terrain Rendering LOD Algorithm Based on Improved Restrictive Quadtree Segmentation and Variation Coefficient of Elevation

Aiming to deal with the difficult issues of terrain data model simplification and crack disposal,the paper proposed an improved level of detail(LOD)terrain rendering algorithm,in which a variation coefficient of elevation is introduced to express the undulation of topography.Then the coefficient is used to construct a node evaluation function in the terrain data model simplification step.Furthermore,an edge reduction strategy is combined with the improved restrictive quadtree segmentation to handle the crack problem.The experiment results demonstrated that the proposed method can reduce the amount of rendering triangles and enhance the rendering speed on the premise of ensuring the rendering effect compared with a traditional LOD algorithm.

Virtual Anatomy: The Dissecting Theatre of the Future—Implementation of Cinematic Rendering in a Large 8 K High-Resolution Projection Environment

Modern computer techniques have been in use for several years to generate three-dimensional visualizations of human anatomy. Very good 3-D computer models of the human body are now available and used routinely in anatomy instruction. These techniques are subsumed under the heading “virtual anatomy” to distinguish them from the conventional study of anatomy entailing cadavers and anatomy textbooks. Moreover, other imaging procedures (X-ray, angiography, CT and MR) are also used in virtual anatomy instruction. A recently introduced three-dimensional post-processing technique named Cinematic Rendering now makes it possible to use the output of routine CT and MR examinations as the basis for highly photo-realistic 3-D depictions of human anatomy. We have installed Cinematic Rendering (enabled for stereoscopy) in a high-definition 8K 3-D projection space that accommodates an audience of 150. The space’s projection surface measures 16 × 9 meters;images can be projected on both the front wall and the floor. A game controller can be used to operate Cinematic Rendering software so that it can generate interactive real-time depictions of human anatomy on the basis of CT and MR data sets. This prototype installation was implemented without technical problems;in day-to-day, real-world use over a period of 22 months, there were no impairments of service due to software crashes or other technical problems. We are already employing this installation routinely for educational offerings open to the public, courses for students in the health professions, and (continuing) professional education units for medical interns, residents and specialists—in, so to speak, the dissecting theater of the future.

High color rendering index white organic light-emitting diode using levofloxacin as blue emitter

Levofloxacin （LOFX）, which is well-known as an antibiotic medicament, was shown to be useful as a 452-nm blue emitter for white organic light-emitting diodes （OLEDs）. In this paper, the fabricated white OLED contains a 452-nm blue emitting layer （thickness of 30 nm） with 1 wt% LOFX doped in CBP （4,4＇-bis（carbazol-9-yl）biphenyl） host and a 584-nm orange emitting layer （thickness of 10 nm） with 0.8 wt% DCJTB （4-（dicyanomethylene）-2-tert-butyl-6-（1,1,7,7- tetramethyljulolidin-4-yl-vinyl）-4H-pyran） doped in CBE which are separated by a 20-nm-thick buffer layer of TPBi （2,2＇,2＂-（benzene-1,3,5-triyl）-tri（1-phenyl-lH-benzimidazole）. A high color rendering index （CRI） of 84.5 and CIE chromaticity coordinates of （0.33, 0.32）, which is close to ideal white emission CIE （0.333, 0.333）, are obtained at a bias voltage of 14 V. Taking into account that LOFX is less expensive and the synthesis and purification technologies of LOFX are mature, these results indicate that blue fluorescence emitting LOFX is useful for applications to white OLEDs although the maximum current efficiency and luminance are not high. The present paper is expected to become a milestone to using medical drug materials for OLEDs.

Online volume rendering of incrementally accumulated LSCEM images for superficial oral cancer detection

Laser scanning confocal endomicroscope(LSCEM)has emerged as an imaging modality which provides noninvasive,in vivo imaging of biological tissue on a microscopic scale.Scientific visualizations for LSCEM datasets captured by current imaging systems require these datasets to be fully acquired and brought to a separate rendering machine.To extend the features and capabilities of this modality,we propose a system which is capable of performing realtime visualization of LSCEM datasets.Using field-programmable gate arrays,our system performs three tasks in parallel:(1)automated control of dataset acquisition;(2)imaging-rendering system synchronization;and(3)realtime volume rendering of dynamic datasets.Through fusion of LSCEM imaging and volume rendering processes,acquired datasets can be visualized in realtime to provide an immediate perception of the image quality and biological conditions of the subject,further assisting in realtime cancer diagnosis.Subsequently,the imaging procedure can be improved for more accurate diagnosis and reduce the need for repeating the process due to unsatisfactory datasets.

A survey of real-time rendering on Web3D application

Background In recent years, with the rapid development of mobile Internet and Web3D technologies, a large number of web-based online 3D visualization applications have emerged. Web3D applications, including Web3D online tourism, Web3D online architecture, Web3D online education environment, Web3D online medical care, and Web3D online shopping are examples of these applications that leverage 3D rendering on the web. These applications have pushed the boundaries of traditional web applications that use text, sound, image, video, and 2D animation as their main communication media, and resorted to 3D virtual scenes as the main interaction object, enabling a user experience that delivers a strong sense of immersion. This paper approached the emerging Web3D applications that generate stronger impacts on people's lives through “real-time rendering technology”, which is the core technology of Web3D. This paper discusses all the major 3D graphics APIs of Web3D and the well-known Web3D engines at home and abroad and classify the real-time rendering frameworks of Web3D applications into different categories. Results Finally, this study analyzed the specific demand posed by different fields to Web3D applications by referring to the representative Web3D applications in each particular field. Conclusions Our survey results show that Web3D applications based on real-time rendering have in-depth sectors of society and even family, which is a trend that has influence on every line of industry.

Effect of light-emitting diodes with different color rendering indexes on the ocular tissues of rat

AIM:To compare the damage of light-emitting diodes(LEDs)with different color rendering indexes(CRIs)to the ocular surface and retina of rats.METHODS:Totally 20 Sprague-Dawley(SD)rats were randomly divided into four groups:the first group was normal control group without any intervention,other three groups were exposed by LEDs with low(LED-L),medium(LED-M),and high(LED-H)CRI respectively for 12 h a day,continuously for 4 wk.The changes in tear secretion(Schirmer I test,SIt),tear film break-up time(BUT),and corneal fluorescein sodium staining(CFS)scores were compared at different times(1 d before experiment,2 and 4 wk after the experiment).The histopathological changes of rat lacrimal gland and retina were observed at 4 wk,and the expressions of tumor necrosis factor-α(TNF-α)and interleukin-6(IL-6)in lacrimal gland were detected by immunofluorescence method.RESULTS:With the increase of light exposed time,the CFS value of each light exposed group continued to increase,and the BUT and SIt scores continued to decrease,which were different from the control group,and the differences between the light exposed groups were statistically significant.Hematoxylin-eosin(HE)results showed that the lacrimal glands of each exposed group were seen varying degrees of acinar atrophy,vacuoledistribution,increasing of eosinophil granules,etc.;the retina showed obvious reduction of photoreceptor cell layer and changes in retinal thickness;LED-L group has the most significant change in all tests.Immunofluorescence suggested that the positive expressions of TNF-αand IL-6 in the lacrimal glands of each exposed group were higher than those of the control group.CONCLUSION:LED exposure for 4 wk can cause the pathological changes of lacrimal gland and retina of rats,and increase the expression of TNF-αand IL-6 in lacrimal gland,the degree of damage is negatively correlated with the CRI.

An improved 3D shape haptic rendering algorithm for finger mounted vibrotactile device

To improve the sense of reality on perception, an improved algorithm of 3D shape haptic rendering is put forward based on a finger mounted vibrotactile device. The principle is that the interactive information and the shape information are conveyed to users when they touch virtual objects at mobile terminals by attaching the vibrotactile feedback on a fingertip. The extraction of shape characteristics, the interactive information and the mapping of shape in formation of vibration stimulation are key parts of the proposed algorithm to realize the real tactile rendering. The contact status of the interaction process, the height information and local gradient of the touch point are regarded as shape information and used to control the vibration intension, rhythm and distribution of the vibrators. With different contact status and shape information, the vibration pattern can be adjusted in time to imitate the outlines of virtual objects. Finally, the effectiveness of the algorithm is verified by shape perception experiments. The results show that the improved algorithm is effective for 3D shape haptic rendering.

Non-Photorealistic Rendering in Chinese Painting of Animals

A set of algorithms is proposed in this paper to automatically transform 3D animal models to Chinese painting style. Inspired by real painting process in Chinese painting of animals, we divide the whole rendering process into two parts: borderline stroke making and interior shading. In borderline stroke making process we first find 3D model silhouettes in real-time depending on the viewing direction of a user. After retrieving silhouette information from all model edges, a stroke linking mechanism is applied to link these independent edges into a long stroke. Finally we grow a plain thin silhouette line to a stylus stroke with various widths at each control point and a 2D brush model is combined with it to simulate a Chinese painting stroke. In the interior shading pipeline, three stages are used to convert a Gouraud-shading image to a Chinese painting style image: color quantization, ink diffusion and box filtering. The color quantization stage assigns all pixels in an image into four color levels and each level represents a color layer in a Chinese painting. Ink diffusion stage is used to transfer inks and water between different levels and to grow areas in an irregular way. The box filtering stage blurs sharp borders between different levels to embellish the appearance of final interior shading image. In addition to automatic rendering, an interactive Chinese painting system which is equipped with friendly input devices can be also combined to generate more artistic Chinese painting images manually.

Research of global illumination algorithms rendering in glossy scene

In computer graphic （CG）, illumination rendering generated realistic effect at virtual scene is amazing. Not only plausible lighting effect is to show the relative position between of the objects, but also to reflect the material of visual appearance of the vir- tual objects. The diffuse-scene rendering reflectance credibility has gradually matured. Global illumination rendering method for the glossy material is still a challenge for the CG research. Because of the shiny materials is highly energy reflection between the com- plex light paths. Whether we trace glossy reflection paths, or use of one-reflection or multi-reflection approximate above complex il- lumination transmission is a difficult working. This paper we gather some commonly used global illumination algorithms recently year and its extension glossy scene improvements. And we introduce the limitation of classical algorithms rendering glossy scene and some extended solution. Finally, we will summarize the illumination rendering for specular scene, there are still some open prob- lems.

Real-Time Rendering of Large-Scale Ocean Environments

Simulation and rendering of large-scale natural environments, especially the ocean, has always been one of the hot issues in computer graphics, which can provide realism for various applications such as computer game, movie and military usage. Simulation of ocean environment is often lack of realism for real-time application due to its complexity of dynamic waves. In this paper, a method based on FFT Wave model is proposed to solve this problem, which can also simulate the ocean optic property with atmosphere scattering. Furthermore, our method has a lot of advantages including global ocean dataset support, real-time, dynamic reflection of ocean, the foam on the wave, smooth transition from deep ocean to seacoast, etc. The experimental results demonstrate the realism and effectiveness of our approach.

Properties of Cementitious Rendering Mortar Prepared with Recycled Fine Aggregates

The results of an experimental study on investigating the properties of cementitious rendering mortars prepared with a recycled fine aggregate（RA） were presented.The RA was obtained from a recycling plant in which mixed demolition wastes were processed by mechanical crushing,sieving and sorting operations.Two series of rendering mortar mixes were prepared with a constant water/cement and a constant aggregate/cement ratios of 0.55 and 3 respectively.River sand and natural crushed rock fine were originally used in the two series separately,and they were consistently replaced by 25%,50%,75% and 100% by the recycled aggregate.The experimental results showed that mechanical properties,such as compressive strength,flexural strength and modulus of elasticity of the mortars prepared with the RA were lower than the mortars made with the natural aggregates.Nevertheless,the bond strength at the interface between the mortar and masonry bricks determined by the Triplet test was found to be higher for the mortars prepared with the RA.