Audio2AB:Audio-driven collaborative generation of virtual character animation

Background Considerable research has been conducted in the areas of audio-driven virtual character gestures and facial animation with some degree of success.However,few methods exist for generating full-body animations,and the portability of virtual character gestures and facial animations has not received sufficient attention.Methods Therefore,we propose a deep-learning-based audio-to-animation-and-blendshape(Audio2AB)network that generates gesture animations and ARK it's 52 facial expression parameter blendshape weights based on audio,audio-corresponding text,emotion labels,and semantic relevance labels to generate parametric data for full-body animations.This parameterization method can be used to drive full-body animations of virtual characters and improve their portability.In the experiment,we first downsampled the gesture and facial data to achieve the same temporal resolution for the input,output,and facial data.The Audio2AB network then encoded the audio,audio-corresponding text,emotion labels,and semantic relevance labels,and then fused the text,emotion labels,and semantic relevance labels into the audio to obtain better audio features.Finally,we established links between the body,gestures,and facial decoders and generated the corresponding animation sequences through our proposed GAN-GF loss function.Results By using audio,audio-corresponding text,and emotional and semantic relevance labels as input,the trained Audio2AB network could generate gesture animation data containing blendshape weights.Therefore,different 3D virtual character animations could be created through parameterization.Conclusions The experimental results showed that the proposed method could generate significant gestures and facial animations.

Can preoperative planning using IRIS™three-dimensional anatomical virtual models predict operative findings during robot-assisted partial nephrectomy?

Objective To evaluate the predictive validity of IRIS™(Intuitive Surgical®,Sunnyvale,CA,USA)as a planning tool for robot-assisted partial nephrectomy(RAPN)by assessing the degree of overlap with intraoperative execution.Methods Thirty-one patients scheduled for RAPN by four experienced urologists were enrolled in a prospective study.Prior to surgery,urologists reviewed the IRIS™three-dimensional model on an iphone Operating System(iOS)app and completed a questionnaire outlining their surgical plan including surgical approach,and ischemia technique as well as confidence in executing this plan.Postoperatively,questionnaires assessing the procedural approach,clinical utility,efficiency,and effectiveness of IRIS™were completed.The degree of overlap between the preoperative and intraoperative questionnaires and between the planned approach and actual execution of the procedure was analyzed.Questionnaires were answered on a 5-point Likert scale and scores of 4 or greater were considered positive.Results Mean age was 65.1 years with a mean tumor size of 27.7 mm(interquartile range 17.5-44.0 mm).Hilar tumors consisted of 32.3%;48.4%of patients had R.E.N.A.L.nephrometry scores of 7-9.On preoperative questionnaires,the surgeons reported that in 67.7%cases they were confident that they can perform the procedure successfully,and on intraoperative questionnaires,the surgeons reported that in 96.8%cases IRIS™helped achieve good spatial sensation of the anatomy.There was a high degree of overlap between preoperative and intraoperative questionnaires for the surgical approach,interpreting anatomical details and clinical utility.When comparing plans for selective or off-clamp,the preoperative plan was executed in 90.0%of cases intraoperatively.Conclusion A high degree of overlap between the preoperative surgical approach and intraoperative RAPN execution was found using IRIS™.This is the first study to evaluate the predictive accuracy of IRIS™during RAPN by comparing preoperative plan and intraoperative execution.

Microstructure modeling and virtual test of asphalt mixture based on three-dimensional discrete element method

The objective of this work is to model the microstructure of asphalt mixture and build virtual test for asphalt mixture by using Particle Flow Code in three dimensions(PFC^(3D))based on three-dimensional discrete element method.A randomly generating algorithm was proposed to capture the three-dimensional irregular shape of coarse aggregate.And then,modeling algorithm and method for graded aggregates were built.Based on the combination of modeling of coarse aggregates,asphalt mastic and air voids,three-dimensional virtual sample of asphalt mixture was modeled by using PFC^(3D).Virtual tests for penetration test of aggregate and uniaxial creep test of asphalt mixture were built and conducted by using PFC^(3D).By comparison of the testing results between virtual tests and actual laboratory tests,the validity of the microstructure modeling and virtual test built in this study was verified.Additionally,compared with laboratory test,the virtual test is easier to conduct and has less variability.It is proved that microstructure modeling and virtual test based on three-dimensional discrete element method is a promising way to conduct research of asphalt mixture.

Science Letters:Dynamic concision for three-dimensional reconstruction of human organ built with virtual reality modelling language (VRML)

This research studies the process of 3D reconstruction and dynamic concision based on 2D medical digital images using virtual reality modelling language (VRML) and JavaScript language, with a focus on how to realize the dynamic concision of 3D medical model with script node and sensor node in VRML. The 3D reconstruction and concision of body internal organs can be built with such high quality that they are better than those obtained from the traditional methods. With the function of dynamic concision, the VRML browser can offer better windows for man-computer interaction in real-time environment than ever before. 3D reconstruction and dynamic concision with VRML can be used to meet the requirement for the medical observation of 3D reconstruction and have a promising prospect in the fields of medical imaging.

Three-dimensional visualization and virtual reality simulation role in hepatic surgery:Further research warranted

Artificial intelligence(AI)is the study of algorithms that enable machines to analyze and execute cognitive activities including problem solving,object and word recognition,reduce the inevitable errors to improve the diagnostic accuracy,and decision-making.Hepatobiliary procedures are technically complex and the use of AI in perioperative management can improve patient outcomes as discussed below.Three-dimensional(3D)reconstruction of images obtained via ultrasound,computed tomography scan or magnetic resonance imaging,can help surgeons better visualize the surgical sites with added depth perception.Preoperative 3D planning is associated with lesser operative time and intraoperative complications.Also,a more accurate assessment is noted,which leads to fewer operative complications.Images can be converted into physical models with 3D printing technology,which can be of educational value to students and trainees.3D images can be combined to provide 3D visualization,which is used for preoperative navigation,allowing for more precise localization of tumors and vessels.Nevertheless,AI enables surgeons to provide better,personalized care for each patient.

Research on the Three-dimensional Modeling and Optimization of a Virtual Tower Crane Based on 3DS Max, Solidworks and EON Professional

Three-dimensional modeling of virtual hoisting machinery is the critical works to structure the system of virtual construction, and the foundation to realize intelligent and interactive virtual hoisting. Aimed at enhancing the requests of image quality and stability of the virtual construction scene, taking a tower crane for example. We studied the technology of three-dimensional modeling and optimization of a virtual tower crane, and a method named two-stage model optimization was put forward. This depended on the modeling stage using Solidworks and 3DS Max and the performance optimization stage in EON. The practice of software development indicates that the proposed methods of three-dimensional modeling and optimization could satisfy the performance request of virtual construction system and be popularized to other virtual system.

Three-dimensional suboptimal guidance law for fly-over and shoot-down smart ammunition via virtual target

An optimal burst height is required for the fly-over and shoot-down smart ammunition with an EFP warhead at the instant of explosion which brings a special requirement to the miss distance of the terminal guidance law. In this paper, a guidance law based on the virtual target scheme is proposed. First, the practical pursuit-evasion issue between the ammunition and the target with specific miss distance is transformed into a virtuai pursuit-evasion problem with zero miss distance. Secondly, a complete three-dimensional pursuit-evasion kinematics model is established without any simplifications. And then, a suboptimal guidance law is designed based on the θ-D method which has constraints of the elevation and azimuth angular velocity of the virtual line of sight （LOS）. Finally, in order to verify the performance of the proposed guidance law, three test cases are conducted. Numericai results show that under the proposed terminal guidance law, the smart ammunition not only can fly above the target with an optimal burst height but also have a smaller normal acceleration on the terminal trajectory.

Application and Analysis of Computer Virtual Simulation Technology in Three-dimensional Animation Production

With the continuous promotion of computer technology, the application system of virtual simulation technology has been further optimized and improved, and has been widely used in various fields of social development, such as urban construction, interior design, industrial simulation and tourism teaching. China's three-dimensional animation production started relatively late, but has achieved good results with the support of related advanced technology in the process of development. Computer virtual simulation technology is an important technical support in the production of three-dimensional animation. In this paper, firstly, the related content of computer virtual simulation technology was introduced. Then, the specific application of this technology in the production of three-dimensional animation was further elaborated, so as to provide some reference for the improvement of the production effect of three-dimensional animation in the future.

Three-dimensional nonlinear analysis of creep in concrete filled steel tube columns

This paper proposes a based on 3D-VLE （three-dimensional nonlinear viscoelastic theory） three-parameters viscoelastic model for studying the time-dependent behaviour of concrete filled steel tube （CFT） columns. The method of 3D-VLE was developed to analyze the effects of concrete creep behavior on CFT structures. After the evaluation of the parameters in the proposed creep model, experimental measurements of two prestressed reinforced concrete beams were used to investigate the creep phenomenon of three CFT columns under long-term axial and eccentric load was investigated. The experimentally obtained time-dependent creep behaviour accorded well with the cu~＇es obtained from the proposed method. Many factors （such as ratio of long-term load to strength, slenderness ratio, steel ratio, and eccentricity ratio） were considered to obtain the regularity of influence of concrete creep on CFT structures. The analytical results can be consulted in the engineering practice and design.

Three-Dimensional Instability of Flow Around Two Circular Cylinders in Tandem Arrangement

The spatial evolution of vortices and transition to three-dimensionality in the wake of two circular cylinders in tandem arrangement have been numerically studied. An improved virtual body method developed from the virtual boundary method is used here. A Reynolds number range between 220 and 270 has been considered, and the spacing between two cylinders is selected as L/D=3 and L/D=3.5. When L/D=3, the secondary vortices of Mode-A are seen to appear at Re=240 and persist over the range of the Reynolds number of 240～270. When L/D=3.5, the similar critical Reynolds number has been found at Re=250. No obvious discontinuity has been found in the Strouhal-Reynolds number relationship, and this is different from three-dimensional flow around a single cylinder at the critical Reynolds number. The spanwise wavelength is about four times the diameter of the cylinder, and it is the characteristic wavelength for Mode-A instability. This paper can give some foremost insight into the three-dimensional instability of flow by complicated geometrical configuration.

Application of Three-Dimensional Visualization Technology in Project Management of Offshore Platform Engineering Construction

Three-dimensional visualization technology converts engineering design drawings and data into graphics or images, realizes virtual reality perception of simulated users in future construction scene, enhances the interaction between project management and technical personnel and engineering construction achievement, and provides intuitive, flexible and strong realistic experience for project management. It can effectively improve the level of project communication, and assist the needs of project construction planning management, training, exhibition, etc. As a tool to help improve project management skills, it has good application effect and prospects.

虚拟现实动画视听语言及叙事研究

虚拟现实动画以虚拟现实媒体为载体,具有沉浸感、交互性、构想性、多感知性的特征,其题材丰富,包括现实题材、历史题材、微观世界等类型。围绕虚拟现实技术支持下的虚拟现实动画展开深入研究,发现虚拟现实动画的叙事方式具有可选性、多样化、真实性、还原性特征,强调空间对时间的取代性,叙事节奏放缓。在叙事设计方面,虚拟现实动画基于观者、视觉、声音等维度展开。在视听语言方面,虚拟现实动画运用镜头语言、声音语言、光影语言进行创新。

基于HTML5的Web Audio技术实现手机版简易钢琴

现代信息化技术的快速发展,使得能够以软件的形式实现虚拟化的乐器,比如钢琴等。以前实现的虚拟化钢琴常使用按键触发加载音频文件方式发声,由于音频文件大小和内存加载耗时等操作,这种设计在按琴键时有时会感受到明显延时。随着HTML5中Web Audio技术的不断完善,本文使用该技术,结合JS设计出的虚拟简易钢琴有很好的音效和灵敏度,同时在职业院校软件专业Web前端开发课程的实践中取得了良好教学效果。

数字说话人脸生成技术综述

在现代计算机视觉和自然语言处理的交叉领域,数字说话人脸生成技术已经成为一个越来越重要的研究主题。数字说话人脸生成技术专注于依据预定的文本或音频序列生成逼真的人脸图像。近年来,深度学习方法,如卷积神经网络、生成对抗性网络以及神经渲染场在此领域已经表现出了显著的应用价值。这些方法不仅引起了学术界的广泛关注,而且在工业界得以实际应用,用于解决图像处理和计算机视觉方面的具体问题。尽管已经取得了一定的进展,实际应用这些方法仍然面临诸多挑战。综合分析和评估深度学习方法在数字说话人脸生成方面的具体实现,以识别现存方法的优缺点,探讨尚待解决的普遍问题,并突出仍需进一步研究的开放性问题。此外,从统计学角度列出了目前可用的数据集,并对其进行评估和比较,以便研究人员能更容易地选择满足他们需求的数据集。

综艺演播室新闻虚拟制作音频技术研究

信息技术的快速发展改变了电视节目的制作模式,其中虚拟技术已成为新闻节目制作的关键技术之一,对音频相关技术也提出了更高的要求。为推动新闻节目制作技术的不断创新与发展,以某新闻节目为例,从音频技术应用改造、新技术应用等方面研究综合演播室新闻虚拟制作音频技术,并从虚拟现实技术的角度出发,展望未来新闻节目音频制作技术的发展方向,以期推动电视节目制作技术的进步。

信息技术在计算机虚拟立体声像软件设计中的应用

信息技术的快速发展为计算机虚拟立体声像软件的设计提供新的机遇。探讨信息技术,特别是数字信号处理(Digital Signal Processing,DSP)技术、三维音频算法、虚拟现实(Virtual Reality,VR)技术在计算机虚拟立体声像软件设计中的应用。这些技术的综合利用,不仅提升了声音的空间感和真实感,还增强了用户的沉浸式体验。

虚拟数字人技术在广播电视领域的应用

介绍虚拟数字人的概念、技术发展历程、主要类型以及产业发展现状,重点分析虚拟数字人技术在新闻、体育、综艺及短视频等领域的具体应用,为虚拟数字人与广播电视及网络视听融合发展提供参考。

音频技术在虚拟现实场景中的应用

虚拟现实技术在模拟现实世界的视觉体验方面取得了显著的进步。音频技术的融入为虚拟现实技术增添了一个重要的感官维度——听觉。将音频技术融入虚拟现实中在提高用户沉浸感的同时增强了现实感和交互性。基于此,文章阐述虚拟现实与音频技术结合的意义,介绍虚拟现实场景中的音频技术应用,总结音频技术在虚拟现实场景中的相关研究工作。

Virtual endoscopy of the urinary tract

Technological breakthroughs have advanced the temporal and spatial resolutions of diagnostic imaging, and 3 dimensional （3-D） reconstruction techniques have been introduced into everyday clinical practice. Virtual endoscopy （VE） is a non-invasive technique that amplifies the perception of cross-sectional images in the 3-D space, providing precise spatial relationships of pathological regions and their surrounding structures. A variety of computer algorithms can be used to generate 3-D images, taking advantage of the information inherent in either spiral computed tomography or magnetic resonance imaging （MRI）. VE images enable endoluminal navigation through hollow organs, thus simulating conventional endoscopy. Several clinical studies have validated the diagnostic utility of virtual cystoscopy, which has high sensitivity and specificity rates in the detection of bladder tumor. Published experience in the virtual exploration of the renal pelvis, ureter and urethra is encouraging but still scarce. VE is a safe, non-invasive method that could be applied in the long-term follow-up of patients with ureteropelvic junction obstruction, urinary bladder tumors and ureteral and/or urethral strictures. Its principal limitations are the inability to provide biopsy tissue specimens for histopathologic examination and the associated ionizing radiation hazards （unless MR/is used）. However, in the case of endoluminal stenosis or obstruction, VE permits virtual endoluminal navigation both cephalad and caudal to the stenotic segment. To conclude, VE provides a less invasive method of evaluating the urinary tract, especially for clinicians who are less familiar with cross-sectional imaging than radiologists. （Asian J Androl 2006 Jan; 8： 31-38）

Ultrasound virtual endoscopy: Polyp detection and reliability of measurement in an in vitro study with pig intestine specimens

AIM: To present our initial experience regarding the feasibility of ultrasound virtual endoscopy(USVE) and its measurement reliability for polyp detection in an in vitro study using pig intestine specimens.METHODS: Six porcine intestine specimens containing 30 synthetic polyps underwent USVE, computed tomography colonography(CTC) and optical colonoscopy(OC) for polyp detection. The polyp measurement defined as the maximum polyp diameter on twodimensional(2D) multiplanar reformatted(MPR) planes was obtained by USVE, and the absolute measurement error was analyzed using the direct measurement as the reference standard.RESULTS: USVE detected 29(96.7%) of 30 polyps, remaining a 7-mm one missed. There was one falsepositive finding. Twenty-six(89.7%) of 29 reconstructedimages were clearly depicted, while 29(96.7%) of 30 polyps were displayed on CTC with one false-negative finding. In OC, all the polyps were detected. The intraclass correlation coefficient was 0.876(95%CI: 0.745-0.940) for measurements obtained with USVE. The pooled absolute measurement errors ± the standard deviations of the depicted polyps with actual sizes ≤ 5 mm, 6-9 mm, and ≥ 10 mm were 1.9 ± 0.8 mm, 0.9 ± 1.2 mm, and 1.0 ± 1.4 mm, respectively.CONCLUSION: USVE is reliable for polyp detection and measurement in in vitro study.