Applying Virtual Reality to Molecular Graphics System

Molecular graphics can be thought of as a window to the computer through which the chemist expresses ideas for computational evaluation and receives results in an understandable form. Furthermore, with beautiful graphic images it can give out the realistic molecular model like a real thing in real world.Molecule has various properties including volume, electronic, van der Waals forces, etc. These properties are very important to understand the molecular world. So if the virtual reality tools are used, then the imaginary world can be studied intuitively by touching and feeling a tremendous amount of data.Computational chemistry generates such amount of molecular property data through supercomputing with molecular simulation experiment. One of the objects to investigate the molecular world is to understand the intermolecular interaction such as drug-receptor interaction. Another thing is to measure the geometrical data in molecular architecture. Virtual reality system provides the easiest way to meet these objects. This kind of simple system changes a numerical data set, which is very difficult to deal with, into a visible and understandable data set. Recently two functions of such a system were improved to get an insight into biomolecular interaction. The first one is a real time force generation during navigation in macromolecular environment. An cylindrical arrow shows the magnitude and direction of molecular force. The second one is to see a moIecular vibration such as a concerted motion of the binding site in protein molecule. So one can understand the molecular shape change for drugreceptor docking procedure. But some problems which are difficult to solve still remain.

Novel 3-dimensional virtual hepatectomy simulation combined with real-time deformation

AIM:To develop a novel 3-dimensional(3D) virtual hepatectomy simulation software,Liversim,to visualize the real-time deformation of the liver.METHODS:We developed a novel real-time virtual hepatectomy simulation software program called Liversim. The software provides 4 basic functions:viewing 3D models from arbitrary directions,changing the colors and opacities of the models,deforming the models based on user interaction,and incising the liver parenchyma and intrahepatic vessels based on user operations. From April 2010 through 2013,99 patients underwent virtual hepatectomies that used the conventional software program SYNAPSE VINCENT preoperatively. Between April 2012 and October 2013,11 patients received virtual hepatectomies using the novel software program Liversim; these hepatectomies were performed both preoperatively and at the same that the actual hepatectomy was performed in an operating room. The perioperative outcomes were analyzed between the patients for whom SYNAPSE VINCENT was used and those for whom Liversim wasused. Furthermore,medical students and surgical residents were asked to complete questionnaires regarding the new software.RESULTS:There were no obvious discrepancies(i.e.,the emergence of branches in the portal vein or hepatic vein or the depth and direction of the resection line) between our simulation and the actual surgery during the resection process. The median operating time was 304 min(range,110 to 846) in the VINCENT group and 397 min(range,232 to 497) in the Liversim group(P = 0.30). The median amount of intraoperative bleeding was 510 m L(range,18 to 5120) in the VINCENT group and 470 m L(range,130 to 1600) in the Liversim group(P = 0.44). The median postoperative stay was 12 d(range,6 to 100) in the VINCENT group and 13 d(range,9 to 21) in the Liversim group(P = 0.36). There were no significant differences in the preoperative outcomes between the two groups. Liversim was not found to be clinically inferior to SYNAPSE VINCENT. Both students and surgical residents reported that the Liversim image was almost the same as the actual hepatectomy.CONCLUSION:Virtual hepatectomy with real-time deformation of the liver using Liversim is useful for the safe performance of hepatectomies and for surgical education.

Parallel Sensing in Metaverses: Virtual-Real Interactive Smart Systems for “6S” Sensing

In the construction of Metaverses,sensors that are referred to as the“bridge of information transmission”,play a key role.The functionality and efficiency of today’s sensors,which operate in a manner similar to physical sensing,are frequently constrained by their hardware and software.In this research,we proposed the Parallel Sensing framework,which includes background,concept,basic methods and typical application of parallel sensing.In our formulation,sensors are redefined as the integration of real physical sensors and virtual software-defined sensors based on parallel intelligence,in order to boost the performance of the sensors.Each sensor will have a parallel counterpart in the virtual world within the framework of parallel sensing.Digital sensors serve as the brain of sensors and maintain the same properties as physical sensors.Parallel sensing allows physical sensors to operate in discrete time periods to conserve energy,while cloud-based descriptive,predictive,and prescriptive sensors operate continuously to offer compensation data and serve as guardians.To better illustrate parallel sensing concept,we show some example applications of parallel sensing such as parallel vision,parallel point cloud and parallel light fields,both of which are designed by construct virtual sensors to extend small real data to virtual big data and then boost the performance of perception models.Experimental results demonstrate the effective of parallel sensing framework.The interaction between the real and virtual worlds enables sensors to operate actively,allowing them to intelligently adapt to various scenarios and ultimately attain the goal of“Cognitive,Parallel,Crypto,Federated,Social and Ecologic”6S sensing.

Optimizing Real-Time Performance of 3D Virtual Mining Environment with MultiGen Creator

System optimization plays a crucial role in developing VR system after 3D modeling, affecting the system's Immersion and Interaction performance enormously. In this article, several key techniques of optimizing a virtual mining system were discussed: optimizing 3D models to keep the polygon number in VR system within target hardware's processing ability; optimizing texture database to save texture memory with perfect visual effect; optimizing database hierarchy structure to accelerate model retrieval; and optimizing LOD hierarchy structure to speed up rendering.

A State-of-the-Art Survey on Real-Time Issues in Embedded Systems Virtualization

Virtualization has gained great acceptance in the server and cloud computing arena. In recent years, it has also been widely applied to real-time embedded systems with stringent timing constraints. We present a comprehensive survey on real-time issues in virtualization for embedded systems, covering popular virtualization systems including KVM, Xen, L4 and others.

mRNA Dependent Virtual-Real Substitutions of Nucleotides in Codons: The Dynamics of Their Meanings in the Genome Language

This is an attempt to explain mRNA-dependent non-stationary semantic values of codons (triplets) and nucleotides (letters) in codon composition during protein biosynthesis. This explanation is realized by comparing the different protein codes of various biosystem taxa, and, comparing mitochondrial code with the standard code. An initial mRNA transcriptional virtuality (Virtual-Reality) is transformed into material reality at the level of translation of virtual triplets into real (material) amino acids or into a real stop command of protein biosynthesis. The transformation of virtuality into reality occurs de facto when the linguistic sign1 functions of the codon syhoms are realized in the 3’ nucleotide (wobbling nucleotide according to F. Crick) in the process of protein biosynthesis. This corresponds to the theoretical works of the authors of this article. Despite the illusory appearance of semantic arbitrariness during the operation of ribosomes in the mode of codon semantic non-stationarity, this phenomenon probably provides biosystems with an unusually high level of adaptability to changes in the external environment as well as to internal (mental) dynamics of neuron’s genome in the cerebral cortex. The genome’s non-stationarity properties at the nucleotide, codon, gene and mental levels have fractal structure and corresponding dimensions. The highest form of such fractality (with maximum dimension) is probably realized in the genomic continuum of neurons in the human cerebral cortex through this semantic Virtual-to-Real (VR) codon transcoding with the biosynthesis of short-living semantic proteins, as the equivalents of material thinking-consciousness. In fact, this is the language of the brain’s genome, that is, our own language. In this case, the same thing happens in natural, primarily mental (non-verbal) languages. Their materialization is recorded in vocables (sounding words) and in writing. Such writing is the amino acid sequence in the semantic proteins of the human cerebral cortex. Rapidly decaying, such proteins can leave a long-lasting “so-called” Schrödinger wave holographic memory in the cerebral cortex. The presented below study is purely theoretical and based on a logical approach. The topic of the study is very complex and is subject to further development.

Real-time virtual sonography visualization and its clinical application in biliopancreatic disease

AIM:To evaluate the usefulness of real-time virtual sonography(RVS)in biliary and pancreatic diseases.METHODS:This study included 15 patients with biliary and pancreatic diseases.RVS can be used to observe an ultrasound image in real time by merging the ultrasound image with a multiplanar reconstruction computed tomography(CT)image,using pre-scanned CT volume data.The ultrasound used was EUB-8500with a convex probe EUP-C514.The RVS images were evaluated based on 3 levels,namely,excellent,good and poor,by the displacement in position.RESULTS:By combining the objectivity of CT with free scanning using RVS,it was possible to easily interpret the relationship between lesions and the surrounding organs as well as the position of vascular structures.The resulting evaluation levels of the RVS images were12 excellent(pancreatic cancer,bile duct cancer,cholecystolithiasis and cholangiocellular carcinoma)and 3 good(pancreatic cancer and gallbladder cancer).Compared with conventional B-mode ultrasonography and CT,RVS images achieved a rate of 80%superior visualization and 20%better visualization.CONCLUSION:RVS has potential usefulness in objective visualization and diagnosis in the field of biliary and pancreatic diseases.

面向智能制造仿真实验的产线数字孪生建模

针对智能制造领域人才培养中,实践教学存在的成本高、安全保证难等问题,该研究构建了智能制造仿真实验系统。首先,以智能产线为基础、车间信息化平台为桥梁,融合产线数字孪生技术,构建了面向智能制造仿真实验的数字孪生系统框架;其次,对系统中包含的产线物理实体模型、数据采集及车间信息化平台、数字孪生产线的多维度模型及智能制造仿真实验平台展开了详细阐述;最后设计产线生产调度优化实验,验证了该数字孪生仿真实验系统的有效性。

面向数字孪生变压器的计算机辅助运维(CAM+)构架与关键技术

发展数字孪生变压器对支撑电力装备智能运维具有重要价值。目前变压器已具有计算机辅助设计、工程仿真的一般功能,但面向运行维护的场景、性能数字孪生还处于初级阶段。为此,该文提出了一种将计算机辅助设计、工程仿真、制造进一步拓展为电力装备的计算机辅助运维(computer aided maintenance+,CAM+)新模式,包含了场景更新、虚实融合、故障定位、智能运维等功能。该文首先介绍了CAM+的内涵,结合电力装备的数字孪生架构提出了面向数字孪生变压器的CAM+模式的技术架构。然后,综述了3维场景可视化建模、高精度传感、多物理场耦合模型与快速计算、虚实融合的动态推演、多源数据融合、状态智能评估、知识图谱等CAM+模式所涉及的关键技术。最后,分析了CAM+在变压器场景更新、参量孪生和智能运维的应用,并总结了未来CAM+所面临的挑战和发展方向。

数字孪生驱动的巷道自动成形截割虚拟调试方法研究

针对目前巷道自动成形截割控制调试周期长、调试成本大、安全风险大、成形质量难以评价等问题,提出了一种数字孪生驱动的巷道自动成形截割虚拟调试方法。采用基于即时外观建图(RTAP−MAP)技术重建巷道三维环境,构建掘进机控制系统模型,形成虚拟调试环境,并利用虚拟传感器技术实现物理空间到虚拟环境状态的精准映射。针对难以量化评估断面成形质量的问题,确立了巷道自动成形截割性能评价方法,以断面成形截割控制过程在数据传输中心的记录为基础,主要对断面成形精度、截割效率与油缸开关次数、硬岩切割调整、超挖欠挖4个评价指标进行计算,从而为深度学习算法的迭代优化提供精准反馈信号,并提出了一种融合强化学习的自动截割控制策略,以提高自动化作业的适应性和精确度。为验证该虚拟调试方法的有效性和准确性,搭建了掘进机自动控制实验平台,并将虚拟调试系统应用于掘进巷道成形截割自动控制程序中。虚拟仿真结果表明:①被调试软件在控制关键点位处的X,Y,Z轴定位误差的最大值分别为74.8,72.93,123.67 mm,说明虚拟调试方法的定位精度达到性能要求。②虚拟样机与物理样机轨迹基本一致,说明该调试方法实现了对物理空间的映射。应用结果表明:①强化学习控制器在虚拟掘进测试中适应了复杂环境,将虚拟传感器输入有效转换为精准控制指令,验证了模拟−现实迁移训练的可行性。通过处理掘进精度和避免超欠挖的实时反馈,控制器学习并优化了策略。②优化后的断面成形截割控制性能得到了提升,根据数据库中控制量时间戳的记录,用时126 s,较优化前耗时减少了8 s。③优化后截割部末端轨迹跟踪最大误差为6.0 mm,较优化前降低了0.3 mm,避免了截割轨迹抖动导致的欠挖,同时使得轨迹和断面更加平滑。

基于NXMCD的虚实映射实验交互系统设计与实践

该文基于数字孪生理念,结合NX MCD机电概念设计、PLC编程与控制和LabVIEW的图形化编程手段,完成了基于NX MCD的虚实映射实验交互系统设计与实践。以LabVIEW设计的UI界面为控制监测端,物理对象与MCD虚拟模型为执行端,实现了物理对象与MCD虚拟模型的虚实映射,同时MCD虚拟模型能够输出控制信号进而控制物理对象。在此基础上,设计了步进电机往复运动与MCD虚拟模型虚实映射实验案例。该实验案例可为本科生和研究生相关课程的实践教学提供虚实映射交互实验方法和手段,可显著提升学生的创新实践能力与水平,是对数字化实践教学研究的一次探索。

全方位培养自主学习与实践创新能力的教学体系构建与实践

针对高校创新人才培养中存在的问题,如教育教学方法陈旧、实验教学条件有限和学生实践能力不足,缺乏创新意识等,提出并实施“五个环节”研讨式课堂教学方法,打造多层次、虚实结合的实验教学体系,开展“四化”实践教学模式,建立促进学生自主学习与实践创新能力的考核机制等针对性措施,从而全方位提高教育教学质量,培养学生自主学习与实践创新能力,促进新工科人才解决复杂工程问题核心能力的达成。

新工科背景下专业实习体系探索与实践——以轨道交通信号与控制专业为例

为适应新工科对人才培养的新要求,针对轨道交通信号与控制专业的实习体系在实践过程中存在的主要问题,通过深化产教融合、强化虚实结合、细化考评综合,建立纵向“三阶段”逐级递进、横向“双形式”互补的实习新模式,形成“一平台,双引擎,三大素质”的实习教学新理念,构建“一核心,三过程,九指标”的综合能力评价新机制。在实习组织形式、实习资源整合、实习评价方式等方面进行积极探索和大胆实践,对其他工科专业的实习教学体系建立有一定借鉴和参考意义。

牛生产学虚拟仿真教学课程建设与应用研究

为推动信息技术与高等教育深度融合,该文以高校牛生产学教学需求为导向,聚焦高等教育高质量发展的迫切需要,基于动物科学专业及牛生产学课程教学的特点,从课程建设及应用要解决的重点,教学载体与教学方法、虚拟仿真教学课程内容与组织实施、课程成绩评定方式、课程评价及改革成效等方面,对牛生产学引入虚拟仿真教学、虚实结合的课程建设及应用进行详尽的研究。通过项目实施,构建校企信息共享平台、形成虚实融合教学模式,创新人才培养模式。

煤矿井下掘进机器人路径规划方法研究

针对煤矿非全断面巷道条件下掘进机器人移机难度大、效率低下等问题,分析了煤矿井下非结构化环境特征及掘进机器人运动特性,提出了基于深度强化学习的掘进机器人机身路径规划方法。利用深度相机将巷道环境实时重建,在虚拟环境中建立掘进机器人与巷道环境的碰撞检测模型,并使用层次包围盒法进行虚拟环境碰撞检测,形成巷道边界受限下的避障策略。考虑到掘进机器人形体大小且路径规划过程目标单一,在传统SAC算法的基础上引入后见经验回放技术,提出HER-SAC算法,该算法通过环境初始目标得到的轨迹扩展目标子集,以增加训练样本、提高训练速度。在此基础上,基于奖惩机制建立智能体,根据掘进机器人运动特性定义其状态空间与动作空间,在同一场景下分别使用3种算法对智能体进行训练,综合平均奖励值、最高奖励值、达到最高奖励值的步数以及鲁棒性4项性能指标进行对比分析。为进一步验证所提方法的可靠性,采用虚实结合的方式,通过调整目标位置设置2种实验场景进行掘进机器人的路径规划,并将传统SAC算法和HER-SAC算法的路径结果进行对比。结果表明:相较于PPO算法和SAC算法,HER-SAC算法收敛速度更快、综合性能达到最优;在2种实验场景下,HER-SAC算法相比传统SAC算法规划出的路径更加平滑、路径长度更短、路径终点与目标位置的误差在3.53 cm以内,能够有效地完成移机路径规划任务。该方法为煤矿掘进机器人的自主移机控制奠定了理论基础,为煤矿掘进设备自动化提供了新方法。

基于改进深度Q网络的虚拟电厂实时优化调度

深度强化学习算法以数据为驱动,且不依赖具体模型,能有效应对虚拟电厂运营中的复杂性问题。然而,现有算法难以严格执行操作约束,在实际系统中的应用受到限制。为了克服这一问题,提出了一种基于深度强化学习的改进深度Q网络(improved deep Q-network,MDQN)算法。该算法将深度神经网络表达为混合整数规划公式,以确保在动作空间内严格执行所有操作约束,从而保证了所制定的调度在实际运行中的可行性。此外,还进行了敏感性分析,以灵活地调整超参数,为算法的优化提供了更大的灵活性。最后,通过对比实验验证了MDQN算法的优越性能。该算法为应对虚拟电厂运营中的复杂性问题提供了一种有效的解决方案。

元地球与数字孪生:思想突破、技术变革与范式转换

数字孪生在航天、工业制造领域已应用了20多年,但引入海洋科学还是首次。通过数字孪生技术,实现真实地球与虚拟地球的融合,构建一个真实地球与数字地球的虚实共同体,这里称为“元地球”。本文介绍了元地球与早期提出的数字地球、虚拟地球、玻璃地球、智慧地球的本质区别,进而突出元地球理念或思想上的巨大突破。基于现今元宇宙BIGANT技术体系,构架跨越地球各圈层的实时、全天候、立体观测感知系统,打通地球系统各圈层动力学模拟隔阂,实现超越现今地球,再现深时地球,实现时空穿越,从而集数字地球、虚拟地球、玻璃地球、智慧地球、现今地球、深时地球的特性于一个共同体,这个深时的虚实共同体就是元地球。这一理念必将催生新的技术范式变革,进而超越现实地球、虚拟地球,开启人类认识地球、探测地球、开发地球的全新方式。在实现研究范式转换的同时,推动元地球的多场景应用,这也必将催生未来的万亿新产业。

虚实结合教学在护理综合技能训练课程中的应用

目的探讨虚实结合教学在护理综合技能训练课程中的应用效果。方法在明确教学方法、打造教学资源库、构建教学实施方案、明确教学评价内容的基础上,选取某高校2020级61名护理本科生为研究对象,在护理综合技能训练课程中对其开展虚实结合教学,教学过程包括单技能训练阶段、综合能力训练阶段。课程结束后,提取学生虚拟仿真实验平台访问次数、虚拟仿真实验训练时长数据;分析学生课程成绩;邀请学生填写护理综合技能训练课程满意度调查表,对课程的满意度进行评价。结果61名护理本科生中,虚拟仿真实验平台访问次数达16~20次者49名;虚拟仿真实验训练时长为138~272(203.43±28.67)min;课程成绩为(89.66±2.91)分。98.3%(58/59)的学生对课程的综合满意度达满意或非常满意,对实验教学过程、教学方法、教学设计、考核方式、课堂参与度感到满意或非常满意者分别占96.6%(57/59)、98.3%(58/59)、96.6%(57/59)、91.5%(54/59)、100%(59/59)、98.3%(58/59)。结论虚实结合教学在护理综合技能训练课程中取得了良好的应用效果,有助于提高学生课程成绩及对课程的满意度,值得推广。

工科专业虚实结合实践教学方式应用研究

随着工科高等教育改革的推进和行业发展需求的变化,实践教学改革势在必行。针对工科专业实践教学现状,结合硬件在环和数字孪生两种实践教学手段,阐述虚实结合实践教学方式的优势。在此基础上对运动控制系统和可编程控制器两门课程的虚实结合实践教学应用进行分析讨论。实践表明,虚实结合实践教学方式对学生完成理论知识内化、提升实践能力和创新能力具有显著的促进作用。