Breaking the optical efficiency limit of virtual reality with a nonreciprocal polarization rotator

A catadioptric lens structure,also known as pancake lens,has been widely used in virtual reality(VR)displays to reduce the formfactor.However,the utilization of a half mirror(HM)to fold the optical path thrice leads to a significant optical loss.The theoretical maximum optical efficiency is merely 25%.To transcend this optical efficiency constraint while retaining the foldable characteristic inherent to traditional pancake optics,in this paper,we propose a theoretically lossless folded optical system to replace the HM with a nonreciprocal polarization rotator.In our feasibility demonstration experiment,we used a commercial Faraday rotator(FR)and reflective polarizers to replace the lossy HM.The theoretically predicted 100%efficiency can be achieved approximately by using two high-extinction-ratio reflective polarizers.In addition,we evaluated the ghost images using a micro-OLED panel in our imaging system.Indeed,the ghost images can be suppressed to undetectable level if the optics are with antireflection coating.Our novel pancake optical system holds great potential for revolutionizing next-generation VR displays with lightweight,compact formfactor,and low power consumption.

Towards engineering a portable platform for laparoscopic pre-training in virtual reality with haptic feedback

Background Laparoscopic surgery is a surgical technique in which special instruments are inserted through small incision holes inside the body.For some time,efforts have been made to improve surgical pre training through practical exercises on abstracted and reduced models.Methods The authors strive for a portable,easy to use and cost-effective Virtual Reality-based(VR)laparoscopic pre-training platform and therefore address the question of how such a system has to be designed to achieve the quality of today's gold standard using real tissue specimens.Current VR controllers are limited regarding haptic feedback.Since haptic feedback is necessary or at least beneficial for laparoscopic surgery training,the platform to be developed consists of a newly designed prototype laparoscopic VR controller with haptic feedback,a commercially available head-mounted display,a VR environment for simulating a laparoscopic surgery,and a training concept.Results To take full advantage of benefits such as repeatability and cost-effectiveness of VR-based training,the system shall not require a tissue sample for haptic feedback.It is currently calculated and visually displayed to the user in the VR environment.On the prototype controller,a first axis was provided with perceptible feedback for test purposes.Two of the prototype VR controllers can be combined to simulate a typical both-handed use case,e.g.,laparoscopic suturing.A Unity based VR prototype allows the execution of simple standard pre-trainings.Conclusions The first prototype enables full operation of a virtual laparoscopic instrument in VR.In addition,the simulation can compute simple interaction forces.Major challenges lie in a realistic real-time tissue simulation and calculation of forces for the haptic feedback.Mechanical weaknesses were identified in the first hardware prototype,which will be improved in subsequent versions.All degrees of freedom of the controller are to be provided with haptic feedback.To make forces tangible in the simulation,characteristic values need to be determined using real tissue samples.The system has yet to be validated by cross-comparing real and VR haptics with surgeons.

Virtual reality for preoperative patient education: Impact on satisfaction, usability, and burnout from the perspective of new nurses

BACKGROUND Traditional paper-based preoperative patient education is a struggle for new nurses and requires extensive training.In this situation,virtual reality technology can help the new nurses.Despite its potential benefits,there are studies on patient satisfaction but there is limited information on the usability of virtual reality(VR)technology for new nurses in giving preoperative education to patients.AIM To investigate the impact on satisfaction,usability,and burnout of a system using VR technology in preoperative patient education.METHODS The study involved 20 nurses from the plastic surgery ward and 80 patients admitted between April and May 2019.Each nurse taught four patients:Two using traditional verbal education and two using virtual reality.The System Usability Scale,After-Scenario Questionnaire,and Maslach Burnout Inventory(MBI)were employed to evaluate the impact of these education methods.RESULTS The VR education groups showed a statistically higher satisfaction than the traditional verbal education groups.Among the three subscales of the MBI,emotional exhaustion and personal accomplishment improved statistically significantly.VR was also better in terms of usability.CONCLUSION This study suggests VR enhances usability and reduces burnout in nurses,but further research is needed to assess its impact on depersonalization and objective measures like stress and heart rate.

Chemical simulation teaching system based on virtual reality and gesture interaction

Background Most existing chemical experiment teaching systems lack solid immersive experiences,making it difficult to engage students.To address these challenges,we propose a chemical simulation teaching system based on virtual reality and gesture interaction.Methods The parameters of the models were obtained through actual investigation,whereby Blender and 3DS MAX were used to model and import these parameters into a physics engine.By establishing an interface for the physics engine,gesture interaction hardware,and virtual reality(VR)helmet,a highly realistic chemical experiment environment was created.Using code script logic,particle systems,as well as other systems,chemical phenomena were simulated.Furthermore,we created an online teaching platform using streaming media and databases to address the problems of distance teaching.Results The proposed system was evaluated against two mainstream products in the market.In the experiments,the proposed system outperformed the other products in terms of fidelity and practicality.Conclusions The proposed system which offers realistic simulations and practicability,can help improve the high school chemistry experimental education.

Personalized assessment and training of neurosurgical skills in virtual reality:An interpretable machine learning approach

Background Virtual reality technology has been widely used in surgical simulators,providing new opportunities for assessing and training surgical skills.Machine learning algorithms are commonly used to analyze and evaluate the performance of participants.However,their interpretability limits the personalization of the training for individual participants.Methods Seventy-nine participants were recruited and divided into three groups based on their skill level in intracranial tumor resection.Data on the use of surgical tools were collected using a surgical simulator.Feature selection was performed using the Minimum Redundancy Maximum Relevance and SVM-RFE algorithms to obtain the final metrics for training the machine learning model.Five machine learning algorithms were trained to predict the skill level,and the support vector machine performed the best,with an accuracy of 92.41%and Area Under Curve value of 0.98253.The machine learning model was interpreted using Shapley values to identify the important factors contributing to the skill level of each participant.Results This study demonstrates the effectiveness of machine learning in differentiating the evaluation and training of virtual reality neurosurgical performances.The use of Shapley values enables targeted training by identifying deficiencies in individual skills.Conclusions This study provides insights into the use of machine learning for personalized training in virtual reality neurosurgery.The interpretability of the machine learning models enables the development of individualized training programs.In addition,this study highlighted the potential of explanatory models in training external skills.

Integrating Virtual Reality and Energy Analysis with BIM to Optimize Window-to-Wall Ratio and Building’s Orientation for Age-in-Place Design at the Conceptual Stage

This study unfolds an innovative approach aiming to address the critical role of building design in global energy consumption, focusing on optimizing the Window-to-Wall Ratio (WWR), since buildings account for approximately 30% of total energy consumed worldwide. The greatest contributors to energy expenditure in buildings are internal artificial lighting and heating and cooling systems. The WWR, determined by the proportion of the building’s glazed area to its wall area, is a significant factor influencing energy efficiency and minimizing energy load. This study introduces the development of a semi-automated computer model designed to offer a real-time, interactive simulation environment, fostering improving communication and engagement between designers and owners. The said model serves to optimize both the WWR and building orientation to align with occupants’ needs and expectations, subsequently reducing annual energy consumption and enhancing the overall building energy performance. The integrated model incorporates Building Information Modeling (BIM), Virtual Reality (VR), and Energy Analysis tools deployed at the conceptual design stage, allowing for the amalgamation of owners’ inputs in the design process and facilitating the creation of more realistic and effective design strategies.

Academic Stress Assessment Using Virtual Reality as an Educational Tool in Spine Surgery

Introduction: The evaluation of academic stress in medical students and residents is a topic of significant interest, given the considerable challenges they face during their learning process with traditional teaching methods. The use of technologies like virtual reality presents an opportunity to enhance their skills through simulations and training. The main objective of this study is to qualitatively assess the stress levels experienced by medical students and residents by integrating virtual reality into their current learning methods, aiming to improve their ability to manage stressors in their practice. Material and Methods: A questionnaire was conducted with 12 medical students and 12 Traumatology and orthopedics residents. The purpose of the questionnaire was to evaluate the levels of academic stress using the SISCO inventory. The stress levels were calculated by transforming average values into percentages, and the following criteria were assigned: 0 to 33% for Mild Stress, 34 to 66% for Moderate Stress, and 67 to 100% for Deep Stress. Then, a virtual reality class focused on spine surgery was provided. Both medical students and residents were trained using the Non Nocere SharpSurgeon software platform and Oculus Quest 2 virtual reality glasses. At the end of the session, a second questionnaire related to the practice with virtual reality was conducted with the same evaluation criteria and a comparative analysis was carried out. Results: 12 undergraduate students from Hospital Angeles Mexico, CDMX and 12 traumatology and orthopedics residents at Hospital Santa Fe, Bogota were evaluated. The students in CDMX reported an average qualitative stress of 28.50% during habitual practices, which decreased to an average of 14.67% after virtual reality practice. Residents in Bogotá experienced an average qualitative stress of 30.50% with their current learning methods but this reduced to an average of 13.92% after using virtual reality. These findings indicate that the use of virtual reality has a positive impact on reducing stress levels qualitatively. Conclusions: The use of virtual reality as a learning method for medical students and residents qualitatively improves stress levels. Further studies are required to define the potential uses of Virtual Reality to improve learning methods and emotional state in medical students and residents and for a quantitative assessment to validate the training as certified learning methods.

Research and Application of Caideng Model Rendering Technology for Virtual Reality

With the development of virtual reality (VR) technology, more and more industries are beginning to integrate with VR technology. In response to the problem of not being able to directly render the lighting effect of Caideng in digital Caideng scenes, this article analyzes the lighting model. It combines it with the lighting effect of Caideng scenes to design an optimized lighting model algorithm that fuses the bidirectional transmission distribution function (BTDF) model. This algorithm can efficiently render the lighting effect of Caideng models in a virtual environment. And using image optimization processing methods, the immersive experience effect on the VR is enhanced. Finally, a Caideng roaming interactive system was designed based on this method. The results show that the frame rate of the system is stable during operation, maintained above 60 fps, and has a good immersive experience.

Virtual reality tools for training in gastrointestinal endoscopy:A systematic review

BACKGROUND Virtual reality(VR)has emerged as an innovative technology in endoscopy training,providing a simulated environment that closely resembles real-life scenarios and offering trainees a valuable platform to acquire and enhance their endoscopic skills.This systematic review will critically evaluate the effectiveness and feasibility of VR-based training compared to traditional methods.AIM To evaluate the effectiveness and feasibility of VR-based training compared to traditional methods.By examining the current state of the field,this review seeks to identify gaps,challenges,and opportunities for further research and implementation of VR in endoscopic training.METHODS The study is a systematic review,following the guidelines for reporting systematic reviews set out by the PRISMA statement.A comprehensive search command was designed and implemented and run in September 2023 to identify relevant studies available,from electronic databases such as PubMed,Scopus,Cochrane,and Google Scholar.The results were systematically reviewed.RESULTS Sixteen articles were included in the final analysis.The total number of participants was 523.Five studies focused on both upper endoscopy and colonoscopy training,two on upper endoscopy training only,eight on colonoscopy training only,and one on sigmoidoscopy training only.Gastrointestinal Mentor virtual endoscopy simulator was commonly used.Fifteen reported positive results,indicating that VR-based training was feasible and acceptable for endoscopy learners.VR technology helped the trainees enhance their skills in manipulating the endoscope,reducing the procedure time or increasing the technical accuracy,in VR scenarios and real patients.Some studies show that the patient discomfort level decreased significantly.However,some studies show there were no significant differences in patient discomfort and pain scores between VR group and other groups.CONCLUSION VR training is effective for endoscopy training.There are several well-designed randomized controlled trials with large sample sizes,proving the potential of this innovative tool.Thus,VR should be more widely adopted in endoscopy training.Furthermore,combining VR training with conventional methods could be a promising approach that should be implemented in training.

Research on Visualization and Interactive Design of Plant Configuration Virtual Reality in the Context of Digitalization

This study aims to explore the application of digital technology in landscape design,focusing on the research of virtual reality visualization and interactive design in the process of plant configuration.Through an in-depth analysis of digital technology,the study outlines its important role in landscape design,especially in the application of plant configuration.The current application status of virtual reality technology in landscape design is discussed,as well as how interactive design can enhance user experience and participation.Furthermore,the achievements and challenges of digital technology in landscape design are summarized.Finally,it proposes future research directions and suggestions,aiming to provide new ideas and methods for practice and research in the field of landscape design and promote the further application and development of digital technology in landscape design.

Discussion on the Construction and Application of Virtual Reality-Based Curriculum Resources for Kindergarten Education

The construction of early childhood curriculum resources serves as a vital vehicle and precondition for the implementation of collective teaching activities in kindergartens.However,traditional curriculum resources based on graphic language or the linguistic descriptions of early childhood educators often fail to provide children with an immersive experience during collective teaching activities,leading to a lack of initiative and interest in learning.This paper discusses the methods for building a kindergarten curriculum resource library and,based on this foundation,employs virtual reality technology for three-dimensional modeling of the library to enrich the curriculum resources in kindergartens.Furthermore,this paper proposes to train early childhood educators in virtual reality technology to enhance their abilities to operate and utilize virtual reality equipment,which can emphasize the children’s central role in the learning process,better achieve educational goals,and improve teaching outcomes.

Review of Digital Campus Construction Led by Virtual Reality Technology

In recent years,the government has issued a series of documents to promote the construction of digital campuses.This initiative serves to encourage the deep integration of information technology and intelligent technology education and digital reform,the combination of virtual reality and campus management is the need for innovative thinking and economic and social development,and then better change our learning style and living environment.The construction of the digital campus is based on virtual reality technology,BIM,GIS,and three-dimensional modeling technology to provide an immersive platform for students,promote the integration of virtual reality technology and education,help teachers,students,and parents to understand all kinds of education information and resources,to achieve their interoperability.From the off-campus environment to the school teaching equipment,teachers to teaching quality certification,and learning,to extracurricular entertainment,opening ceremonies to graduation parties,to bring more efficient,convenient,and safe campus life for teachers,students,and staff in school,and break the traditional information restrictions.

Application Strategies of Virtual Reality Technology in the Teaching Design of Vocational Courses from the Perspective of Learning Transfer Theory

With the rapid development of virtual reality technology,it has been widely used in the field of education.It can promote the development of learning transfer,which is an effective method for learners to learn effectively.Therefore,this paper describes how to use virtual reality technology to achieve learning transfer in order to achieve teaching goals and improve learning efficiency.

Analysis of the Application Value of Virtual Reality Combined with Flipped Classroom Teaching Mode in Cardiopulmonary Resuscitation Teaching

Objective:To analyze the value of using virtual reality combined with the flipped classroom teaching model in teaching cardiopulmonary resuscitation(CPR).Methods:Two classes of our nursing program were randomly selected for the study from September 2022 to September 2023,Class A(52 students,conventional teaching method)and Class B(52 students,virtual reality combined with flipped classroom teaching mode).The assessment scores and independent learning ability scores of the students in the two classes were compared.Results:CPR theory and operation scores,passing rate,and independent learning ability scores of Class B were higher than those of Class A(P<0.05).Conclusion:the use of virtual reality combined with the flipped classroom teaching mode in CPR teaching is conducive to the improvement of students’assessment scores and independent learning ability.

融合VR-眼动的施工现场隐患识别视觉注意与搜索特征研究

为探究施工现场隐患识别视觉注意与搜索特征,提升识别绩效水平,融合虚拟现实(Virtual Reality,VR)和眼动追踪技术,开展VR施工场景内的隐患识别试验,收集不同隐患识别经验群体的眼动数据;运用统计学方法,对比分析累计注视时间、注视百分比等眼动指标的差异性,揭示隐患识别经验与注意力资源分配方式的内在联系;基于眼动轨迹匹配法,聚类首次视觉搜索轨迹,结合施工现场空间布局,探究隐患识别经验影响下搜索习惯的差异。结果表明:经验知识水平对隐患识别绩效具备驱动作用,但隐患专业度过低则会弱化经验知识的效果;被试的注意资源大多集中于具有视觉显著性特征的无关要素,仅有小部分分配于隐患,然而,具有较高经验知识水平的被试对隐患信息更加敏感,分配于隐患的注意资源占比更高;相较于新手组同一区域多次重复的搜索习惯,专家组大多采用某一区域的详细搜索再切换到下一区域的方式。

VR技术联合CBL教学在急诊住院医师规范化培训教学中的探索应用

目的 探讨虚拟现实(VR)技术联合基于案例的学习(CBL)在急诊教学中的应用效果。方法 选取2020年9月至2022年9月台州市第一人民医院40例规范化培训医师作为研究对象,采用随机数字表法将其分为实验组和传统组,每组20名。传统组采用情景模拟+讲授式教学,实验组采用VR技术联合CBL教学。比较两组理论、技能成绩及教学满意度的差异。结果 培训后,实验组学员的理论及操作考试成绩均高于传统组,差异均有统计学意义(t分别=2.58、2.38,P均<0.05)。在学习的主动性、培训模式的新颖性、提升学习效率、提升理论知识的理解、提升临床技能、加强临床思维、培训总体的满意度方面,实验组的教学满意度均高于传统组,差异均有统计学意义(t分别=3.13、3.33、2.25、2.73、2.27、2.37、2.96,P均<0.05)。实验组学员对VR课程的评分明显高于持中立态度的分值,差异有统计学意义(t=23.17,P<0.05)。结论 VR技术联合CBL教学法在急诊住院医师规范化培训教学中可以取得良好的教学效果和教学满意度,为医学教育提供了新的方法和途径。

VR技术在船舶分段装配实训教学中的应用

VR技术与传统教学的融合是现阶段教育教学的一个发展趋势。基于当前VR技术在实训教学中的现状,探讨VR技术在船舶分段装配仿真实训教学中的作用和意义,并具体分析了VR技术在船舶分段装配实训教学中的应用。通过调查分析证明了VR技术在船舶分段装配仿真实训教学中的应用效果,最后提出推进VR技术在船舶分段装配仿真实训教学中的具体操作建议。

基于VR技术的野外实践平台构建

传统野外实践受地域、交通、时间、天气等多重因素的制约,难以兼顾实践内容、成本及人员的安全。采集不同时间、不同地点的影像素材制作VR实景,叠加至电子地图并通过互联网发布,可实现实践对象空天地一体化的多尺度展示。基于VR技术构建与应用野外实践平台,拓展了野外实践的地域范围,同时降低教学成本和风险。VR实景的制作及发布所涉及的技术门槛低,节点的拓展性强,有利于提高野外实践教学资源共享效益,为全国性的仿真平台建设提供参考。

微晶磁性材料制备VR虚拟仿真实验的设计与实现

将虚拟仿真技术应用于磁学与磁性材料制备实验教学,设计了“一主线、四模块、四层次”的实验教学内容结构,建设了微晶磁性材料VR虚拟仿真实验项目.引入了唯象的教学思维,解决了原子磁矩和磁畴理论过于抽象的教学难题,1∶1还原了微晶磁性材料制备所涉及的设备和操作流程,解决了微晶磁性材料制备实验高成本、高危险的现实问题,弥补了高校物理实验教学中磁学相关实验较少的缺陷.

VR/AR-AdaptFace:面向虚拟现实与增强现实的自适应多模态面部替换模型

随着VR/AR技术的迅猛发展,用户对于沉浸式体验的需求日益增长。同时,虚拟人脸技术亦趋成熟。基于此,本文探索将高度拟真的虚拟人脸融入VR/AR,以增强用户体验的自然度与沉浸感。然而,在虚拟数字人领域,图像生成及换脸技术在VR/AR环境下仍遇诸多挑战,尤其是唇形合成模型在动态场景及多语言环境下的性能需进一步优化。为解决上述问题,本文提出VR/AR-AdaptFace模型,一个面向虚拟现实与增强现实的自适应多模态面部替换方案。该模型由两大模块构成:“文颜绘真”模块,采用先进的文本至图像转换技术和特定类别先验保存策略,优化虚拟人脸生成,并通过注意力机制大幅提升图像质量;“语唇映生”模块,依托强大的生成器、唇形同步判别器及视觉质量判别器,实现语音与唇形的精准同步,为VR/AR场景中的动态交互带来更加逼真的体验。