Chemical simulation teaching system based on virtual reality and gesture interaction

Background Most existing chemical experiment teaching systems lack solid immersive experiences,making it difficult to engage students.To address these challenges,we propose a chemical simulation teaching system based on virtual reality and gesture interaction.Methods The parameters of the models were obtained through actual investigation,whereby Blender and 3DS MAX were used to model and import these parameters into a physics engine.By establishing an interface for the physics engine,gesture interaction hardware,and virtual reality(VR)helmet,a highly realistic chemical experiment environment was created.Using code script logic,particle systems,as well as other systems,chemical phenomena were simulated.Furthermore,we created an online teaching platform using streaming media and databases to address the problems of distance teaching.Results The proposed system was evaluated against two mainstream products in the market.In the experiments,the proposed system outperformed the other products in terms of fidelity and practicality.Conclusions The proposed system which offers realistic simulations and practicability,can help improve the high school chemistry experimental education.

Virtual Reality Toolkit for the Assembly of Nanotube-based Nano-electro-mechanical Systems

Nano assembly and manipulation technologies are the basis for nano-electro-mechanical systems（NEMS）. Atomic force microscope（AFM） is widely used to manipulate nanotubes to assemble NEMS. Manipulating nanotubes with AFM is a challenging and difficult task. One of the major reasons is the deficiency of visual information during the manipulation process. To address these difficulties, this research aims to put forward novel virtual tools and assembly strategies to improve the efficiency, accuracy and ease of the assembly process of NEMS. This paper begins by the discussion of the principles and implementation of a virtual nano-assembly simulator, which serves as a benchmark to test the proposed NEMS assembly techniques and virtual tools. Then, a general framework of nanotube-based NEMS assembly is proposed. Several nano-assembly strategies and virtual tools, such as automated path planning for NEMS assembly, a four-step scheme of nanotube manipulation, virtual fixtures for assembly finalization and safe manipulation, are introduced. These virtual tools and methods are experimented for justification. An assembly task of moderate complexity was performed in our virtual nano-assembly simulator with and without the help of the proposed toolkit. Experimental results suggest that the proposed methods tend to greatly enhance the efficiency and accuracy of nanotube-based NEMS assembly. In general, the proposed virtual reality toolkit not only ensures the safety, but also enhances the accuracy and efficiency of the assembly of nanotube-based NEMS.

Virtual Simulation Experiment Teaching Platform Based on 3R-4A Computer System

Virtual simulation experiment teaching gradually becomes the trend of the computer-related education practice.Through analyzing the problems existed in current computer experiment teaching,this paper proposes the idea of building virtual simulation experiment platform based on 3R-4A computer system and clarifies the design technology,including frame,characteristic and innovation,resource sharing and management,condition protection and so on.

A Virtual Assembly System for Aero-engines Based on VR

In this paper,a synthesized technique is explored through design of a virtual experiment system for main aero-engine based on VR,which attempts to integrate some VR techniques,such as 3D stereo simulation and modeling,3D scene management and human-computer virtual assembly based on data glove and collision detection.The geometry modeling and instantiation technique,virtual hand modeling and data glove interaction technique are discussed chiefly.Finally,taking aim at assembling and dismantling experiment system of a certain aero-engine,interface technology is expounded also.

Virtual&augmented reality for biological microscope in experiment education

Background Mixed-reality technologies,including virtual reality(VR)and augmented reality(AR),are considered to be promising potential tools for science teaching and learning processes that could foster positive emotions,motivate autonomous learning,and improve learning outcomes.Methods In this study,a technology-aided biological microscope learning system based on VR/AR is presented.The structure of the microscope is described in a detailed three-dimensional(3D)model,each component being represented with their topological interrelationships and associations among them being established.The interactive behavior of the model was specified,and a standard operating guide was compiled.The motion control of components was simulated based on collision detection.Combined with immersive VR equipment and AR technology,we developed a virtual microscope subsystem and a mobile virtual microscope guidance system.Results The system consisted of a VR subsystem and an AR subsystem.The focus of the VR subsystem was to simulate operating the microscope and associated interactive behaviors that allowed users to observe and operate the components of the 3D microscope model by means of natural interactions in an immersive scenario.The AR subsystem allowed participants to use a mobile terminal that took a picture of a microscope from a textbook and then displayed the structure and functions of the instrument,as well as the relevant operating guidance.This flexibly allowed students to use the system before or after class without time and space constraints.The system allowed users to switch between the VR and AR subsystems.Conclusions The system is useful for helping learners(especially K-12 students)to recognize a microscope's structure and grasp the required operational skills by simulating operations using an interactive process.In the future,such technology-assisted education would be a successful learning platform in an open learning space.

RESEARCH OF GUIDANCE TECHNOLOGY FOR ASSEMBLY MODELING IN VIRTUAL ENVIRONMENT

Technology of movement and knowledge guidance in virtual assembly is presented The designer can move the mechanical part precisely under the movement guidance The movement guidance is implemented based on constraint recognition and assembly degree of freedom analysis A multi hierarchy knowledge base is built to represent the assembly knowledge and information The virtual assembly system judges the requirement of the designer based on the context of design task and searches for the useful knowledge and information, which can be provided to the designer in a natural way

Teaching mechanism empowered by virtual simulation: Edge computing–driven approach

With the rapid development of network and communication techniques,the teaching forms have become diversified.To enhance the education experience and improve the teaching environment,an increasing number of educational institutions have adopted virtual simulation technology.A typical teaching mechanism is to exploit Virtual Reality(VR)technology,which affords participants an immersive experience.Unquestionably,such a VRbased mode is highly approved.However,the performance of this technology requires further optimization.On one hand,for VR 360video,the current intraframe decision cannot adapt to rapid response demands.On the other hand,the generated data size is considerably large and fast computation may not be realized,depending on the local VR device.Therefore,this study proposes an improved teaching mechanism empowered by edge computing–driven VR,called VE4T,that involves two parts.First,an intraframe decision algorithm for VR 360videos is devised to realize the rapid responses.Second,an edge computing framework is proposed to offload some tasks to an edge server for computation,where a task scheduling strategy is developed to check whether a task needs to be offloaded.Finally,experiments are performed using a practical teaching scenario with some VR devices.The obtained results demonstrate that VE4T is more efficient than existing mechanisms.

The virtual-real measurement of Chinese garden impression:A quantitative analysis of cognitive experience of Jiangnan gardens with virtual reality experiments

Traditional Jiangnan garden architecture in China offers distinct spatial impressions that hold significance in contemporary architectural expression.Yet,the understanding and analysis of these spaces have historically relied on subjective,sensory experiences,often lacking precise,quantitative research.Consequently,establishing clear logical connections between visual cognition and emotional perception within these spatial experiences has been a challenge.This study introduces virtual reality spatial simulation and quantification techniques,summarizing key Jiangnan garden spatial characteristics and prototypes.It includes a series of virtual reality experiments focusing on cognitive experiences within Jiangnan garden spaces.A comprehensive analysis of isovisit quantitative data,questionnaires,and behavioral information explores the logical relationships between emotional perceptions(calmness,surprise,interest,confusion)and visual cognition qualities(openness,complexity,theatricality)in garden space impressions.This research aims to reveal deeper connections between garden space qualities,visual cognition,and emotional experiences,offering valuable insights for the application of historical traditional spatial features in contemporary architecture.It bridges the gap between sensory experiences and rational analysis,enhancing our understanding of the intricate spatial narratives within Jiangnan gardens.

Cable Harness Assembly Planning in Virtual Environment

Based on the analysis of characteristic of cable harness planning in virtual environment,a discrete control node modeling (DCNM) method of cable harness in virtual environment and the cable harness assembly routing technique based on it are proposed. DCNM converts a cable harness into continuous flexed line segments connected by a series of section center points,and the design can realize cable harness planning through controlling those control nodes. This method of cable harness routing in the virtual environment breaks the status that virtual assembly process planning is just suitable for the rigid components at present,and impulse the virtual assembly process planning to be more practical. Relation algorithms have been verified in a self-developed system named virtual cable harness assembly planning (VCHAP) system,and this VCHAP system has been applied in assembly process planning of aerospace-related products.

Thermal perception method of virtual chemistry experiments

Background With the aim of addressing the difficulty in identifying temperatures in virtual chemistry experiments,we propose a temperature-sensing simulation method of virtual chemistry experiments.Methods We construct a virtual chemistry experiment temperature simulation platform,based on which a wearable temperature generation device is developed.The typical middle school virtual experiments of concentrated sulfuric acid dilution and ammonium nitrate dissolution are conducted to verify the actual effect of the device.Results The platform is capable to indicate near real-world experimental situations.The performance of the device not only meets the temperature sensing characteristics of human skin,but also matches the temperature change of virtual chemistry experiments in real-time.Conclusions It is demonstrated that this temperature-sensing simulation method can represent exothermic or endothermic chemistry experiments,which is beneficial for students to gain understanding of the principles of thermal energy transformation in chemical reactions,thus avoiding the danger that may be posed in the course of traditional teaching of chemistry experiments effectively.Although this method does not have a convenient enough operation for users,the immersion of virtual chemical experiments can be enhanced.

Mixed Reality-based Interactive Technology for Aircraft Cabin Assembly

Due to the narrowness of space and the complexity of structure, the assembly of aircraft cabin has become one of the major bottlenecks in the whole manufacturing process. To solve the problem, at the beginning of aircraft design, the different stages of the lifecycle of aircraft must be thought about, which include the trial manufacture, assembly, maintenance, recycling and destruction of the product. Recently, thanks to the development of the virtual reality and augmented reality, some low-cost and fast solutions are found for the product assembly. This paper presents a mixed reality-based interactive technology for the aircraft cabin assembly, which can enhance the efficiency of the assemblage in a virtual environment in terms of vision, information and operation. In the mixed reality-based assembly environment, the physical scene can be obtained by a camera and then generated by a computer. The virtual parts, the features of visual assembly, the navigation information, the physical parts and the physical assembly environment will be mixed and presented in the same assembly scene. The mixed or the augmented information will provide some assembling information as a detailed assembly instruction in the mixed reality-based assembly environment. Constraint proxy and its match rules help to reconstruct and visualize the restriction relationship among different parts, and to avoid the complex calculation of constraint＇s match. Finally, a desktop prototype system of virtual assembly has been built to assist the assembly verification and training with the virtual hand.

Digital assembly technology based on augmented reality and digital twins: a review

Product assembly simulation is considered as one of the key technologies in the process of complex product design and manufacturing.Virtual assembly realizes the assembly process design,verification,and optimization of complex products in the virtual environment,which plays an active and effective role in improving the assembly quality and efficiency of complex products.In recent years,augmented reality(AR)and digital twin(DT)technology have brought new opportunities and challenges to the digital assembly of complex products owing to their characteristics of virtual reality fusion and interactive control.This paper expounds the concept and connotation of AR,enumerates a typical AR assembly system structure,analyzes the key technologies and applications of AR in digital assembly,and notes that DT technology is the future development trend of intelligent assembly research.

Design of Middle School Chemistry Experiment Simulation System Based on Apriori Algorithm

Aiming at the safety problems of toxic,flammable and explosive chemicals used in middle school chemical experiments,such as human poi-soning,skin corrosion,fire or explosion caused by improper experimental operation,a virtual simulation method of chemical experiments based on unity is proposed.Due to the need to analyze and compare the data in chemical experiments,summarize the experimental characteristics and data relevance.Therefore,based on the Apriori algorithm,this method deeply excavates the data obtained in the chemical experiment,uses Maya to model the experimental environment,uses unity to design the interactive functions in the experimental process,and uses visual effect graph technology,shader graph technology and other methods to realize the special effect simula-tion of various chemical experiments.With this method,the virtual simula-tion prototype system of middle school chemistry experiment is developed.The example shows that this method can vividly and realistically reproduce the simulation effect of chemical experiment,find the correlation between the experimental data,classification,properties and the overall characteristics of the data,describe and predict the development trend of the data,so as to make better use of these data to provide support for chemical experiment,and not only solve the problems of poisoning,corrosion of skin and It also solves the problems that it is difficult to scientifically compare data and find data relevance in traditional chemical experiments.

生物科学与技术虚拟仿真实验教学中心的建设与应用

生物科学与技术虚拟仿真实验教学中心通过优秀科研项目转化以及与高新技术企业合作开发,建设了一批高质量的生物类虚拟仿真实验教学资源。多层次、多元化的资源为学生前沿科学知识学习、综合性科研训练和生物下游产业技术训练提供有利环境,有效地实现教学模式的转变以及学科交叉知识的学习和延伸。全天候开放共享虚拟仿真实验教学平台,实现虚拟仿真实验教学软件、实验标准化视频、教学课件和测试题库等线上教学资源的有机整合,满足随时随地实验教学需求,支持了一系列的混合式线上线下实验教学课程开展。生物科学与技术虚拟仿真实验教学中心与国家级生物科学实验教学示范中心形成了“双中心”融合发展的创新人才培养实验教学体系,“虚实结合”的实验教学模式,提升了学生的综合科研能力与教师的业务水平,培养了满足社会需求的生物技术创新实践人才。

近十年我国高校虚拟仿真实验教学研究发展述评

自从2013年教育部开展国家级虚拟仿真实验教学中心建设工作以来,近十年我国高校在虚拟仿真实验领域产生了大量的研究新进展与应用新成效。采用CiteSpace软件分析CNKI数据库中2014~2023年的高校虚拟仿真实验或虚拟现实实验文献集合,挖掘了该领域研究的核心单位、作者与发文期刊;分析了高被引文献的特征。同时,基于关键词共现关系聚类,阐释了虚拟仿真实验研究的主要类别、发展历程和前沿领域,进而探讨了虚拟仿真实验教学的技术层次、覆盖学科、开发软硬件和发展趋势。研究得出,标准化、网络化共享平台和混合现实技术,是推动虚拟仿真实验新发展的重要技术途径。

增强现实环境下装配操作感知方法研究

现有的自然虚拟装配操作交互模型对双手协同操作和单步操作工作量的表达存在不足,针对这个问题,提出增强现实装配操作感知模型,实现机械装配操作参数化表达。提出基于装配运动特征的虚拟物体位姿计算方法,建立模型的真实手部元素与被操作虚拟物体元素的运动关联,满足模型对虚拟物体位姿求解的需求。提出基于模型元素的模型关键状态计算方法,满足模型运行需求。开发了应用案例,实验表明,模型可表达五种常见装配操作,满足装配培训需求。

为复浮生是梦中?——虚拟现实媒介的美学逻辑与问题审视

虚拟现实与我们共在已多年,当其携数字基础设施的强大力量回归后,成为重新定义用户生活体验和所在空间视角的媒介形式,并引发了独特的美学体验。围绕这一美学体验的中心问题不是虚拟对象是否真实存在,而是虚拟现实媒介如何将我们日常的感官和知觉能力虚拟化,从而使我们在虚拟世界中具有知觉主动性。虚拟现实媒介的美学逻辑表现在沉浸式美学体验和计算美学体验上。这些体验基于计算视觉文化的支持,强调物质世界可能总是悬浮在身体、技术和审美调解之间。主体似乎在审视着一个可以随意支配的世界,但忽略了他们自身也被算作其中的一部分。虚拟现实媒介并没有使世界变得触手可及,更多地是体现了海德格尔所描述的只剩下“技术关系”的境况。

虚拟现实技术在数字媒体交互中的应用

相比于传统媒体技术,数字媒体采用更多的先进技术,是信息量大、操作体验感好、支持用户更多的主动操作。虚拟现实技术可以提供良好的体验感、满意度、实时性,对于数字媒体技术交互过程的改变具有重要的意义。该文首先从硬件角度分析基于虚拟现实技术的数字媒体交互采用的设备,包括计算机设备、头盔、手套、手柄、运动捕捉、模拟驾驶和全息现实等。其次从软件角度分析基于虚拟现实技术的数字媒体交互的设计流程和框架,包括虚拟现实软件平台、模拟和交互软件、内容开发工具等软件环境的支持等。性能测试实验结果显示,基于虚拟现实的数字媒体交互过程设计,最终用户使用满意度达到95%以上,实时性提高12%以上。

沉浸式体验在数字艺术展中的表达研究

随着科技的进步,人民生活水平在日渐提升。数字技术运用在了公众生活的各个领域,影响了公众的日常生活,成为公众生活不可缺少的部分。艺术领域的发展也出现了数字化趋势,沉浸式的观展方式日渐风靡。沉浸式的观看方式改变了传统艺术的叙事方式,强调观者的感受和能动性,解构了传统艺术的观看与审美方式。这种形式丰富了艺术的表达方式,为观者建构全新的审美体验。文章通过对沉浸式艺术展的解读,并结合经典案例分析其内在特征与目前现状,试图为未来沉浸式艺术的发展提供新思路和方式。

多重感受和反身的薄幕:一项对虚拟现实技术的生活体验研究

从媒介演化历史来看,虚拟现实(virtual reality,简称“VR”)是一种建立在技术层面上的个人体验。人类体验有着复杂的心理体验和体验结构,因而人类身心与VR情境发生互动后产生的体验可能远非“沉浸”可以完全囊括。VR体验是两个过程的合一:以身体为媒介而生的感受过程,以及“我”与“我”的感受发生互动的反身过程。在感受和反身的双重过程中,沉浸并非VR体验的唯一感受。沉浸既独立生成,又往往和非沉浸、无沉浸交织在一起,形成了融入、并置和搁置这三种体验结构和三种虚实关系。反身不仅构成了人类体验和技术之间的滑动界限,个体可以在亲历者、参与者和旁观者三种内隐身份上滑动,而且通过个体体验的更新而使得自我、社会、文化乃至文明处于反身建构的过程中,人类的生命时间由此循环向前。体验的反身及其建构特征意味着技术可以趋近但是无法抵达人类基本经验形式的原初地带。随着文化体验及文化实践活动越来越成为具有挑战性的适应性问题,立足于精微的人类反身体验以运用人类主体性,是理解技术和人类关系的一个角度。