A survey of real-time rendering on Web3D application

Background In recent years, with the rapid development of mobile Internet and Web3D technologies, a large number of web-based online 3D visualization applications have emerged. Web3D applications, including Web3D online tourism, Web3D online architecture, Web3D online education environment, Web3D online medical care, and Web3D online shopping are examples of these applications that leverage 3D rendering on the web. These applications have pushed the boundaries of traditional web applications that use text, sound, image, video, and 2D animation as their main communication media, and resorted to 3D virtual scenes as the main interaction object, enabling a user experience that delivers a strong sense of immersion. This paper approached the emerging Web3D applications that generate stronger impacts on people's lives through “real-time rendering technology”, which is the core technology of Web3D. This paper discusses all the major 3D graphics APIs of Web3D and the well-known Web3D engines at home and abroad and classify the real-time rendering frameworks of Web3D applications into different categories. Results Finally, this study analyzed the specific demand posed by different fields to Web3D applications by referring to the representative Web3D applications in each particular field. Conclusions Our survey results show that Web3D applications based on real-time rendering have in-depth sectors of society and even family, which is a trend that has influence on every line of industry.

Application of real-time 3d echocardiography in mitral valve repair for replacement of chordae tendineae

Objective To investigate the surgical technique and outcomes of replacement of chordae tendineae in mitral valve repair,and evaluate the value of real-time three-di-mensional transesophageal echocardiography in the perioperative period. Methods Thirty-one patients with mitral valve prolapse underwent mitral valve repair using chordae tendineae replacement concomitant with implantation

用Real-time 3D技术制作VR小品

三维技术以前给人们的印象就是三维动画和CG作品，特别是三维动画，最深入人心，不过三维动画不具有交互性，不能指望依靠它实现什么互动功能。实时三维技术虽然在很早以前就有了，但主要用于游戏开发、军事科研、大型仿真等领域。

RT-3D定量技术评价冠心病伴左心衰竭病人右心室收缩功能的临床价值

目的观察RT-3D定量技术评价冠心病伴左心衰竭病人右心室收缩功能的临床价值。方法选取2016年1月—2019年1月我院收治的冠心病伴左心衰竭病人204例作为观察组,其中合并肺动脉高压组114例,未合并动脉高压组90例;选取同期健康正常者80名作为对照组,采用RT-3D定量技术评价冠心病伴左心衰竭病人右心室收缩功能。比较3组临床资料、常规超声参数[包括右室基底部横径(RVDb)、三尖瓣环收缩期位移(TAPSE)、右室面积变化率(RV-FAC)、三尖瓣环收缩期峰值速度(s′)、心肌做功指数(MPI)、左室射血分数(LVEF)、右室射血分数(RVEF)、肺动脉收缩压(PASP)]及应变参数指标[包括二维右室整体纵向应变(2D-GLS)、二维右室游离壁纵向应变(2D-FWLS)及二维右室室间隔纵向应变(2D-SLS)、三维容积右室游离壁纵向应变(3D-FWLS)及三维容积室间隔纵向应变(3D-SLS)]。结果对照组体质指数、心率及收缩压均低于观察组(P<0.05)。对照组RVDb、MPI、右室舒张末期容积(RVEDV)、右室收缩末期容积(RVESV)均低于观察组(P<0.05),对照组TAPSE、RV-FAC、s′、LVEF及RVEF均高于观察组(P<0.05)。观察组2D-FWLS、2D-SLS、2D-GLS、3D-FWLS及3D-SLS均高于对照组(P<0.05)。未合并肺动脉高压病人2D-FWLS、2D-SLS、2D-GLS及3D-FWLS均低于合并肺动脉高压病人(P<0.05)。冠心病伴左心衰竭病人右心室功能参数指标与RVEF呈正相关(P<0.01);3D-FWLS预测冠心病伴左心衰竭发生肺动脉高压的ROC曲线显示:AUC=0.741,3D-FWLS截断值为-14.18%,灵敏度为72.81%,特异度为61.09%。结论RT-3D定量技术可准确评价冠心病伴左心衰竭病人右心室收缩功能,可为临床治疗方案的制定提供影像学依据。

Performance Evaluation of Three-Dimensional UWB Real-Time Locating Auto-Positioning System for Fire Rescue

Fire rescue challenges and solutions have evolved from straightfor-ward plane rescue to encompass 3D space due to the rise of high-rise city buildings.Hence,this study facilitates a system with quick and simplified on-site launching and generates real-time location data,enabling fire rescuers to arrive at the intended spot faster and correctly for effective and precise rescue.Auto-positioning with step-by-step instructions is proposed when launching the locating system,while no extra measuring instrument like Total Station(TS)is needed.Real-time location tracking is provided via a 3D space real-time locating system(RTLS)constructed using Ultra-wide Bandwidth technology(UWB),which requires electromagnetic waves to pass through concrete walls.A hybrid weighted least squares with a time difference of arrival(WLS/TDOA)positioning method is proposed to address real path-tracking issues in 3D space and to meet RTLS requirements for quick computing in real-world applications.The 3D WLS/TDOA algorithm is theoretically constructed with the Cramer-Rao lower bound(CRLB).The computing complexity is reduced to the lower bound for embedded hardware to directly compute the time differential of the arriving signals using the time-to-digital converter(TDC).The results of the experiments show that the errors are controlled when the positioning algorithm is applied in various complicated situations to fulfill the requirements of engineering applications.The statistical analysis of the data reveals that the proposed UWB RTLS auto-positioning system can track target tags with an accuracy of 0.20 m.

Real-time Simulation of Gas Based on Smoothed Particle Hydrodynamics

This paper extends the SPH method to gas simulation. The SPH （Smoothed Particles Hydrodynamics） method is the most popular method of flow simulation, which is widely used in large-scale liquid simulation. However, it is not found to apply to gas simulation, since those methods based on SPH can＇t be used in real-time simulation due to their enormous particles and huge computation. This paper proposes a method for gas simulation based on SPH with a small number of particles. Firstly, the method computes the position and density of each particle in each point-in-time, and outlines the shape of the simulated gas based on those particles. Secondly the method uses the grid technique to refine the shape with the diffusion of particle＇s density under the control of grid, and get more lifelike simulation result. Each grid will be assigned density according to the particles in it. The density determines the final appearance of the grid. For ensuring the natural transition of the color between adjacent grids, we give a diffuse process of density between these grids and assign appropriate values to vertexes of these grids. The experimental results show that the proposed method can give better gas simulation and meet the request of real-time.

Optimized Method for Real-time Texture Reconstruction with RGB-D Camera

With the appearance of RGB-D camera, the field of three-dimensional(3D) reconstruction receives more and more attention. In this paper, we present an optimization approach to produce high-quality textured 3D models based on the real-time 3D reconstruction system.The resulting models of real-time texture reconstruction often suffer from blurring, ghosting, and other artifacts.Our approach addresses this texture quality problem using blur detection and an optimized weight function. Experimental results demonstrate that our approach can improve the quality of textured 3D models by reducing the blur and ghosts on the model surface.

3-D Animation as Applied to the Solving of Coupling Relations in the 6-DOF Parallel Robot

How to solve the coupling relations in a 6 - DOF parallel robot quickly and accurately within the limits of realtime control is a critical problem. In traditional analytic method, the complicated mathemtical model must first be constructed and then solved by programming.Obviously, this method is not very practical. This paper,therefore, proposes a new way of approach with a new method using 3- D animation for the solving of coupling relations in the 6 - DOF parallel robot. This method is much simpler and its solving accuracy approaches that of the more complicated analytic method.

Newer echocardiographic techniques for aortic-valve imaging: Clinical aids today, clinical practice tomorrow

Increasing life expectancy is expected to lead to a corresponding increase in the prevalence of aortic valve disease(AVD). Further, the number of indications for transcatheter aortic valve replacement(TAVR) as a treatment option for AVD is expanding, with a growing role for echocardiography in its management. In this review we summarize the current literature on some newer echocardiographic modalities and the parameters they generate, with a particular focus on their prognostic and clinical value beyond conventional methods in the management of aortic stenosis, TAVR, and aortic regurgitation. Speckle tracking and 3 D echocardiography are now increasingly being used in the management of AVD. For instance, global longitudinal strain, the beststudied speckle tracking echocardiographic parameter, can detect subtle subclinical cardiac dysfunction in patients with AVD that is not apparent using traditional echocardiographic techniques. The emerging technique of 3D full volume color Doppler echocardiography provides more accurate measurement of the severity of aortic regurgitation than 2D-proximal isovelocity surface area. These novel techniques are promising for evaluating and risk stratifying patients to optimize surgical interventions, predict recovery, and improve clinical outcomes.

Research on Automatic Elimination of Laptop Computer in Security CT Images Based on Projection Algorithm and YOLOv7-Seg

In civil aviation security screening, laptops, with their intricate structural composition, provide the potential for criminals to conceal dangerous items. Presently, the security process necessitates passengers to individually present their laptops for inspection. The paper introduced a method for laptop removal. By combining projection algorithms with the YOLOv7-Seg model, a laptop’s three views were generated through projection, and instance segmentation of these views was achieved using YOLOv7-Seg. The resulting 2D masks from instance segmentation at different angles were employed to reconstruct a 3D mask through angle restoration. Ultimately, the intersection of this 3D mask with the original 3D data enabled the successful extraction of the laptop’s 3D information. Experimental results demonstrated that the fusion of projection and instance segmentation facilitated the automatic removal of laptops from CT data. Moreover, higher instance segmentation model accuracy leads to more precise removal outcomes. By implementing the laptop removal functionality, the civil aviation security screening process becomes more efficient and convenient. Passengers will no longer be required to individually handle their laptops, effectively enhancing the efficiency and accuracy of security screening.

A topological framework for real-time 3D weather radar data processing

Real-time 3D weather radar data processing makes it possible to efficiently simulate meteorological processes in digital Earth and support the assessment of meteorological disasters.The current real-time meteorological operation system can only deal with radar data within 2D space as a flat map and lacks supporting 3D characteristics.Thus,valuable 3D information imbedded in radar data cannot be completely presented to meteorological experts.Due to the large amount of data and high complexity of radar data 3D operation,regular methods are not competent for supporting real-time 3D radar data processing and representation.This study aims to perform radar data 3D operations with high efficiency and instant speed to provide real-time 3D support for the meteorological field.In this paper,a topological framework composed of basic inner topological objects is proposed along with the quadtree structure and LOD architecture,based on which 3D operations on radar data can be conducted in a split second and 3D information can be presented in real time.As the applications of the proposed topological framework,two widely used 3D algorithms in the meteorological field are also implemented in this paper.Finally,a case study verifies the applicability and validity of the proposed topological framework.

Real-time pupil tracking backlight system for holographic 3D display(Invited Paper)

We propose an automatic three-dimensionM （3D） pupil tracking backlight system for holographic 3D display system with large image size and full-parallax accommodation effect. The proposed tracking module is applied to a holographic 3D display system with two sets of directional holographic imaging module composed of 2 × 2 large scale lens array and 22-inch high-resolution liquid crystal display 3D panel. System architecture is described and experimental results are presented.

Feature-based RGB-D camera pose optimization for real-time 3D reconstruction

In this paper we present a novel featurebased RGB-D camera pose optimization algorithm for real-time 3D reconstruction systems. During camera pose estimation, current methods in online systems suffer from fast-scanned RGB-D data, or generate inaccurate relative transformations between consecutive frames. Our approach improves current methods by utilizing matched features across all frames and is robust for RGB-D data with large shifts in consecutive frames. We directly estimate camera pose for each frame by efficiently solving a quadratic minimization problem to maximize the consistency of3 D points in global space across frames corresponding to matched feature points. We have implemented our method within two state-of-the-art online 3D reconstruction platforms. Experimental results testify that our method is efficient and reliable in estimating camera poses for RGB-D data with large shifts.

Navigated liver surgery:State of the art and future perspectives

Background:In recent years,the development of digital imaging technology has had a significant influence in liver surgery.The ability to obtain a 3-dimensional(3D)visualization of the liver anatomy has provided surgery with virtual reality of simulation 3D computer models,3D printing models and more recently holograms and augmented reality(when virtual reality knowledge is superimposed onto reality).In addition,the utilization of real-time fluorescent imaging techniques based on indocyanine green(ICG)uptake allows clinicians to precisely delineate the liver anatomy and/or tumors within the parenchyma,applying the knowledge obtained preoperatively through digital imaging.The combination of both has transformed the abstract thinking until now based on 2D imaging into a 3D preoperative conception(virtual reality),enhanced with real-time visualization of the fluorescent liver structures,effectively facilitating intraoperative navigated liver surgery(augmented reality).Data sources:A literature search was performed from inception until January 2021 in MEDLINE(Pub Med),Embase,Cochrane library and database for systematic reviews(CDSR),Google Scholar,and National Institute for Health and Clinical Excellence(NICE)databases.Results:Fifty-one pertinent articles were retrieved and included.The different types of digital imaging technologies and the real-time navigated liver surgery were estimated and compared.Conclusions:ICG fluorescent imaging techniques can contribute essentially to the real-time definition of liver segments;as a result,precise hepatic resection can be guided by the presence of fluorescence.Furthermore,3D models can help essentially to further advancing of precision in hepatic surgery by permitting estimation of liver volume and functional liver remnant,delineation of resection lines along the liver segments and evaluation of tumor margins.In liver transplantation and especially in living donor liver transplantation(LDLT),3D printed models of the donor’s liver and models of the recipient’s hilar anatomy can contribute further to improving the results.In particular,pediatric LDLT abdominal cavity models can help to manage the largest challenge of this procedure,namely large-for-size syndrome.

Mechanical dyssynchrony and deformation imaging in patients with functional mitral regurgitation

Chronic functional mitral regurgitation(FMR) is a frequent finding of ischemic heart disease and dilated cardiomyopathy(DCM), associated with unfavourable prognosis. Several pathophysiologic mechanisms are involved in FMR, such as annular dilatation and dysfunction, left ventricle(LV) remodeling, dysfunction and dyssynchrony, papillary muscles displacement and dyssynchrony. The best therapeutic choice for FMR is still debated. When optimal medical treatment has already been set, a further option for cardiac resynchronization therapy(CRT) and/or surgical correction should be considered. CRT is able to contrast most of the pathophysiologic determinants of FMR by minimizing LV dyssynchrony through different mechanisms: Increasing closing forces, reducing tethering forces, reshaping annular geometry and function, correcting diastolic MR. Deformation imaging in terms of two-dimensional speckle tracking has been validated for LV dyssynchrony assessment. Radial speckle tracking and three-dimensional strain analysis appear to be the best methods to quantify intraventricular delay and to predict CRT-responders. Speckle-tracking echocardiography in patients with mitral valve regurgitation has been usually proposed for the assessment of LV and left atrial function. However it has also revealed a fundamental role of intraventricular dyssynchrony in determining FMR especially in DCM, rather than in ischemic cardiomyopathy in which MR severity seems to be more related to mitral valve deformation indexes. Furthermore speckle tracking allows the assessment of papillary muscle dyssynchrony. Therefore this technique can help to identify optimal candidates to CRT that will probably demonstrate a reduction in FMR degree and thus will experience a better outcome.

Large-Scale Terrain Simplification and Visualization Based on TIN

In the preprocessing phase, the global terrain model is partitioned into blocks with their feature points being picked out to generate TIN model for each terrain block, then the multi-resolution models of terrain organized in the form of quad-tree is created bottom-up. Cracks between terrain blocks are avoided by inserting vertices to form common boundaries. At run-time, a view-dependent LOD algorithm is used to control the loading and unloading of the proper blocks by an additional synchronous thread. To eliminate the artifacts created by LOD transitions, geomorphing is used in real-time. These rendering strategies increase the throughput of GPU and avoid imbalance of load among CPU, GPU and Disk I/O. Experimental results show that the system can perform visually smooth rendering of large-scale terrain scenes with fine quality at an average rate of 80 fps.

Model Implementation and Analysis of a True Three-dimensional Display System

To model a true three-dimensional(3D)display system,we introduced the method of voxel molding to obtain the stereoscopic imaging space of the system.For the distribution of each voxel,we proposed a four-dimensional(4D)Givone–Roessor(GR)model for state-space representation—that is,we established a local state-space model with the 3D position and one-dimensional time coordi-nates to describe the system.First,we extended the original elementary operation approach to a 4D condition and proposed the implementation steps of the realiza-tion matrix of the 4D GR model.Then,we described the working process of a true 3D display system,analyzed its real-time performance,introduced the fixed-point quantization model to simplify the system matrix,and derived the conditions for the global asymptotic stability of the system after quantization.Finally,we provided an example to prove the true 3D display system’s feasibility by simulation.The GR-model-representation method and its implementation steps proposed in this paper simplified the system’s mathematical expression and facilitated the microcon-troller software implementation.Real-time and stability analyses can be used widely to analyze and design true 3D display systems.

Key Technology in Developing Web-Based Engineering Drawing CAI Software

Key techniques to improve the quality of developing Web-based engineering drawing CAI software are discussed and some experience in applying commercial tools for generating vector drawing, concise representation of 3D solids, real-time interactive animation, data management etc. is illustrated. A Web-based Engineering Drawing CAI software 'Solid Projection' has been implemented by using these techniques.

3D modeling and motion parallax for improved videoconferencing

We consider a face-to-face videoconferencing system that uses a Kinect camera at each end of the link for 3D modeling and an ordinary2 D display for output. The Kinect camera allows a 3D model of each participant to be transmitted;the(assumed static) background is sent separately.Furthermore, the Kinect tracks the receiver's head,allowing our system to render a view of the sender depending on the receiver's viewpoint. The resulting motion parallax gives the receivers a strong impression of 3D viewing as they move, yet the system only needs an ordinary 2D display. This is cheaper than a full3 D system, and avoids disadvantages such as the need to wear shutter glasses, VR headsets, or to sit in a particular position required by an autostereo display.Perceptual studies show that users experience a greater sensation of depth with our system compared to a typical 2D videoconferencing system.

Review of Some Advances and Applications in Real-time High-speed Vision: Our Views and Experiences

The frame rate of conventional vision systems is restricted to the video signal formats （e.g., NTSC 30 fps and PAL 25 fps） that are designed on the basis of the characteristics of the human eye, which implies that the processing speed of these systems is limited to the recognition speed of the human eye. However, there is a strong demand for real-time high-speed vision sensors in many application fields, such as factory automation, biomedicine, and robotics, where high-speed operations are carried out. These high-speed operations can be tracked and inspected by using high-speed vision systems with intelligent sensors that work at hundreds of Hertz or more, especially when the operation is difficult to observe with the human eye. This paper reviews advances in developing real-time high Speed vision systems and their applications in various fields, such as intelligent logging systems, vibration dynamics sensing, vision-based mechanical control, three-dimensional measurement/automated visual inspection, vision-based human interface, and biomedical applications.