In recent years,the government has issued a series of documents to promote the construction of digital campuses.This initiative serves to encourage the deep integration of information technology and intelligent techno...In recent years,the government has issued a series of documents to promote the construction of digital campuses.This initiative serves to encourage the deep integration of information technology and intelligent technology education and digital reform,the combination of virtual reality and campus management is the need for innovative thinking and economic and social development,and then better change our learning style and living environment.The construction of the digital campus is based on virtual reality technology,BIM,GIS,and three-dimensional modeling technology to provide an immersive platform for students,promote the integration of virtual reality technology and education,help teachers,students,and parents to understand all kinds of education information and resources,to achieve their interoperability.From the off-campus environment to the school teaching equipment,teachers to teaching quality certification,and learning,to extracurricular entertainment,opening ceremonies to graduation parties,to bring more efficient,convenient,and safe campus life for teachers,students,and staff in school,and break the traditional information restrictions.展开更多
With the rapid development of virtual reality technology,it has been widely used in the field of education.It can promote the development of learning transfer,which is an effective method for learners to learn effecti...With the rapid development of virtual reality technology,it has been widely used in the field of education.It can promote the development of learning transfer,which is an effective method for learners to learn effectively.Therefore,this paper describes how to use virtual reality technology to achieve learning transfer in order to achieve teaching goals and improve learning efficiency.展开更多
This study comprehensively reviews the literature to deeply explore the role of computer science and internet technologies in addressing educational inequality and socio-psychological issues,with a particular focus on...This study comprehensively reviews the literature to deeply explore the role of computer science and internet technologies in addressing educational inequality and socio-psychological issues,with a particular focus on applications of 5G,artificial intelligence(AI),and augmented/virtual reality(AR/VR).By analyzing how these technologies are reshaping learning and their potential to ameliorate educational disparities,the study reveals challenges present in ensuring educational equity.The research methodology includes exhaustive reviews of applications of AI and machine learning,the Internet of Things and wearable technologies integration,big data analytics and data mining,and the effects of online platforms and social media on socio-psychological issues.Besides,the study discusses applications of these technologies in educational inequality and socio-psychological problem-solving through the lens of 5G,AI,and AR/VR,while also delineating challenges faced by these emerging technologies and future outlooks.The study finds that while computer science and internet technologies hold promise to bridge academic divides and address socio-psychological problems,the complexity of technology access and infrastructure,lack of digital literacy and skills,and critical ethical and privacy issues can impact widespread adoption and efficacy.Overall,the study provides a novel perspective to understand the potential of computer science and internet technologies in ameliorating educational inequality and socio-psychological issues,while pointing to new directions for future research.It also emphasizes the importance of cooperation among educational institutions,technology vendors,policymakers and researchers,and establishing comprehensive ethical guidelines and regulations to ensure the responsible use of these technologies.展开更多
In the context of Industry 4.0,a paradigm shift from traditional industrial manipulators to Collaborative Robots(CRs)is ongoing,with the latter serving ever more closely humans as auxiliary tools in many production pr...In the context of Industry 4.0,a paradigm shift from traditional industrial manipulators to Collaborative Robots(CRs)is ongoing,with the latter serving ever more closely humans as auxiliary tools in many production processes.In this scenario,continuous technological advancements offer new opportunities for further innovating robotics and other areas of next-generation industry.For example,6G could play a prominent role due to its human-centric view of the industrial domains.In particular,its expected dependability features will pave the way for new applications exploiting highly effective Digital Twin(DT)-and eXtended Reality(XR)-based telepresence.In this work,a novel application for the above technologies allowing two distant users to collaborate in the programming of a CR is proposed.The approach encompasses demanding data flows(e.g.,point cloud-based streaming of collaborating users and robotic environment),with network latency and bandwidth constraints.Results obtained by analyzing this approach from the viewpoint of network requirements in a setup designed to emulate 6G connectivity indicate that the expected performance of forthcoming mobile networks will make it fully feasible in principle.展开更多
Background A task assigned to space exploration satellites involves detecting the physical environment within a certain space.However,space detection data are complex and abstract.These data are not conducive for rese...Background A task assigned to space exploration satellites involves detecting the physical environment within a certain space.However,space detection data are complex and abstract.These data are not conducive for researchers'visual perceptions of the evolution and interaction of events in the space environment.Methods A time-series dynamic data sampling method for large-scale space was proposed for sample detection data in space and time,and the corresponding relationships between data location features and other attribute features were established.A tone-mapping method based on statistical histogram equalization was proposed and applied to the final attribute feature data.The visualization process is optimized for rendering by merging materials,reducing the number of patches,and performing other operations.Results The results of sampling,feature extraction,and uniform visualization of the detection data of complex types,long duration spans,and uneven spatial distributions were obtained.The real-time visualization of large-scale spatial structures using augmented reality devices,particularly low-performance devices,was also investigated.Conclusions The proposed visualization system can reconstruct the three-dimensional structure of a large-scale space,express the structure and changes in the spatial environment using augmented reality,and assist in intuitively discovering spatial environmental events and evolutionary rules.展开更多
This paper explores the transformative impact of virtual worlds, augmented reality (AR), and the metaverse in the healthcare sector. It delves into the ways these technologies are reshaping patient care, medical educa...This paper explores the transformative impact of virtual worlds, augmented reality (AR), and the metaverse in the healthcare sector. It delves into the ways these technologies are reshaping patient care, medical education, and research, while also addressing the challenges and opportunities they present. The paper highlights the potential benefits of these technologies and emphasizes the need for comprehensive regulatory frameworks and ethical guidelines to ensure responsible integration. Finally it outlines their transformative impact and discusses the challenges and opportunities they present for the future of healthcare provision.展开更多
The design process of the built environment relies on the collaborative effort of all parties involved in the project.During the design phase,owners,end users,and their representatives are expected to make the most cr...The design process of the built environment relies on the collaborative effort of all parties involved in the project.During the design phase,owners,end users,and their representatives are expected to make the most critical design and budgetary decisions-shaping the essential traits of the project,hence emerge the need and necessity to create and integrate mechanisms to support the decision-making process.Design decisions should not be based on assumptions,past experiences,or imagination.An example of the numerous problems that are a result of uninformed design decisions is“change orders”,known as the deviation from the original scope of work,which leads to an increase of the overall cost,and changes to the construction schedule of the project.The long-term aim of this inquiry is to understand the user’s behavior,and establish evidence-based control measures,which are actions and processes that can be implemented in practice to decrease the volume and frequency of the occurrence of change orders.The current study developed a foundation for further examination by proposing potential control measures,and testing their efficiency,such as integrating Virtual Reality(VR).The specific aim was to examine the effect of different visualization methods(i.e.,VR vs.construction drawings)on,(1)how well the subjects understand the information presented about the future/planned environment;(2)the subjects’perceived confidence in what the future environment will look like;(3)the likelihood of changing the built environment;(4)design review time;and(5)accuracy in reviewing and understanding the design.展开更多
Background: Augmented reality(AR) technology is used to reconstruct three-dimensional(3D) images of hepatic and biliary structures from computed tomography and magnetic resonance imaging data, and to superimpose the v...Background: Augmented reality(AR) technology is used to reconstruct three-dimensional(3D) images of hepatic and biliary structures from computed tomography and magnetic resonance imaging data, and to superimpose the virtual images onto a view of the surgical field. In liver surgery, these superimposed virtual images help the surgeon to visualize intrahepatic structures and therefore, to operate precisely and to improve clinical outcomes.Data Sources: The keywords "augmented reality", "liver", "laparoscopic" and "hepatectomy" were used for searching publications in the Pub Med database. The primary source of literatures was from peer-reviewed journals up to December 2016. Additional articles were identified by manual search of references found in the key articles.Results: In general, AR technology mainly includes 3D reconstruction, display, registration as well as tracking techniques and has recently been adopted gradually for liver surgeries including laparoscopy and laparotomy with video-based AR assisted laparoscopic resection as the main technical application. By applying AR technology, blood vessels and tumor structures in the liver can be displayed during surgery,which permits precise navigation during complex surgical procedures. Liver transformation and registration errors during surgery were the main factors that limit the application of AR technology.Conclusions: With recent advances, AR technologies have the potential to improve hepatobiliary surgical procedures. However, additional clinical studies will be required to evaluate AR as a tool for reducing postoperative morbidity and mortality and for the improvement of long-term clinical outcomes. Future research is needed in the fusion of multiple imaging modalities, improving biomechanical liver modeling,and enhancing image data processing and tracking technologies to increase the accuracy of current AR methods.展开更多
Product assembly simulation is considered as one of the key technologies in the process of complex product design and manufacturing.Virtual assembly realizes the assembly process design,verification,and optimization o...Product assembly simulation is considered as one of the key technologies in the process of complex product design and manufacturing.Virtual assembly realizes the assembly process design,verification,and optimization of complex products in the virtual environment,which plays an active and effective role in improving the assembly quality and efficiency of complex products.In recent years,augmented reality(AR)and digital twin(DT)technology have brought new opportunities and challenges to the digital assembly of complex products owing to their characteristics of virtual reality fusion and interactive control.This paper expounds the concept and connotation of AR,enumerates a typical AR assembly system structure,analyzes the key technologies and applications of AR in digital assembly,and notes that DT technology is the future development trend of intelligent assembly research.展开更多
Background Gesture is a basic interaction channel that is frequently used by humans to communicate in daily life. In this paper, we explore to use gesture-based approaches for target acquisition in virtual and augment...Background Gesture is a basic interaction channel that is frequently used by humans to communicate in daily life. In this paper, we explore to use gesture-based approaches for target acquisition in virtual and augmented reality. A typical process of gesture-based target acquisition is: when a user intends to acquire a target, she performs a gesture with her hands, head or other parts of the body, the computer senses and recognizes the gesture and infers the most possible target. Methods We build mental model and behavior model of the user to study two key parts of the interaction process. Mental model describes how user thinks up a gesture for acquiring a target, and can be the intuitive mapping between gestures and targets. Behavior model describes how user moves the body parts to perform the gestures, and the relationship between the gesture that user intends to perform and signals that computer senses. Results In this paper, we present and discuss three pieces of research that focus on the mental model and behavior model of gesture-based target acquisition in VR and AR. Conclusions We show that leveraging these two models, interaction experience and performance can be improved in VR and AR environments.展开更多
Current rates of mental illness are worrisome.Mental illness mainly affects females and younger age groups.The use of the internet to deliver mental health care has been growing since 2020 and includes the implementat...Current rates of mental illness are worrisome.Mental illness mainly affects females and younger age groups.The use of the internet to deliver mental health care has been growing since 2020 and includes the implementation of novel mental health treatments using virtual reality,augmented reality,and artificial intelligence.A new three dimensional digital environment,known as the metaverse,has emerged as the next version of the Internet.Artificial intelligence,augmented reality,and virtual reality will create fully immersive,experiential,and interactive online environments in the metaverse.People will use a unique avatar to do anything they do in their“real”lives,including seeking and receiving mental health care.In this opinion review,we reflect on how the metaverse could reshape how we deliver mental health treatment,its opportunities,and its challenges.展开更多
the rapid development of computer technology has accelerated the progress of construction technology, and the application of virtual reality technology has become more and more common, which has caused earth-shaking c...the rapid development of computer technology has accelerated the progress of construction technology, and the application of virtual reality technology has become more and more common, which has caused earth-shaking changes in the thinking and mode of traditional architectural design. It plays an important role in optimizing the construction design scheme and improving the science and rationality of the architectural design. In order to realize the effective application of virtual technology in the future architectural design, it is necessary to intensify the research on its application and give full play to its application value and advantages. This paper discusses and analyzes the application and realization of virtual reality technology in the future architectural design, and predicts its future application prospects.展开更多
Virtual tourism is the application of virtual reality technology in tourism industry,in which the key is to construct lifelike virtual environment.This paper introduces several main methods in producing virtual enviro...Virtual tourism is the application of virtual reality technology in tourism industry,in which the key is to construct lifelike virtual environment.This paper introduces several main methods in producing virtual environment,such as landform formation with the help of height field method,construction of complicated three-dimensional models in virtual environment through 3DS MAX,construction of lifelike tree models using Billboard technique and Cross Billboard technique,and adoption of texture mapping,LOD(level of detail),and collision testing technique to increase sense of reality in virtual environment.Finally a lifelike virtual tourism environment is realized under the context of Visual C++6.0 through OpenGL.展开更多
Mixed reality(MR)technology is a new digital holographic image technology,which appears in the field of graphics after virtual reality(VR)and augmented reality(AR)technology,a new interdisciplinary frontier.As a new g...Mixed reality(MR)technology is a new digital holographic image technology,which appears in the field of graphics after virtual reality(VR)and augmented reality(AR)technology,a new interdisciplinary frontier.As a new generation of technology,MR has attracted great attention of clinicians in recent years.The emergence of MR will bring about revolutionary changes in medical education training,medical research,medical communication,and clinical treatment.At present,MR technology has become the popular frontline information technology for medical applications.With the popularization of digital technology in the medical field,the development prospects of MR are inestimable.The purpose of this review article is to introduce the application of MR technology in the medical field and prospect its trend in the future.展开更多
The massive technological advancements around the world have created significant challenging competition among companies where each of the companies tries to attract the customers using different techniques. One of th...The massive technological advancements around the world have created significant challenging competition among companies where each of the companies tries to attract the customers using different techniques. One of the recent tech- niques is Augmented Reality (AR). The AR is a new technology which is capable of presenting possibilities that are difficult for other technologies to offer and meet. Nowadays, numerous augmented reality applications have been used in the industry of different kinds and disseminated all over the world. AR will really alter the way individuals view the world. The AR is yet in its initial phases of research and development at different colleges and high-tech institutes. Throughout the last years, AR apps became transportable and generally available on various devices. Besides, AR be- gins to occupy its place in our audio-visual media and to be used in various fields in our life in tangible and exciting ways such as news, sports and is used in many domains in our life such as electronic commerce, promotion, design, and business. In addition, AR is used to facilitate the learning whereas it enables students to access location-specific infor- mation provided through various sources. Such growth and spread of AR applications pushes organizations to compete one another, every one of them exerts its best to gain the customers. This paper provides a comprehensive study of AR including its history, architecture, applications, current challenges and future trends.展开更多
The paper elaborates the features and superiority of applying multimedia technology to aquatic organisms in a Science and Life Technology course. The augmented reality application of multimedia technology in aquatic o...The paper elaborates the features and superiority of applying multimedia technology to aquatic organisms in a Science and Life Technology course. The augmented reality application of multimedia technology in aquatic organisms’ instruction has its own features, teaching information capacity, interactive user interface. The paper concludes the superiority of Unity and Vuforia AR instruction from five perspectives;meanwhile, the paper elaborates its disadvantages. An AR-based instruction attitude questionnaire was conducted at the end of the experiment to obtain learners’ perspectives of the system. Learners in AR approach demonstrate higher motivation and concentrate their attention on the learning tasks. Learners showed more positive attitude in willingness to use the AR-based instruction to improve learning interests. This study provided insights for better understanding the design, theory and practice of e-learning through augmented reality technology.展开更多
Background Mixed-reality technologies,including virtual reality(VR)and augmented reality(AR),are considered to be promising potential tools for science teaching and learning processes that could foster positive emotio...Background Mixed-reality technologies,including virtual reality(VR)and augmented reality(AR),are considered to be promising potential tools for science teaching and learning processes that could foster positive emotions,motivate autonomous learning,and improve learning outcomes.Methods In this study,a technology-aided biological microscope learning system based on VR/AR is presented.The structure of the microscope is described in a detailed three-dimensional(3D)model,each component being represented with their topological interrelationships and associations among them being established.The interactive behavior of the model was specified,and a standard operating guide was compiled.The motion control of components was simulated based on collision detection.Combined with immersive VR equipment and AR technology,we developed a virtual microscope subsystem and a mobile virtual microscope guidance system.Results The system consisted of a VR subsystem and an AR subsystem.The focus of the VR subsystem was to simulate operating the microscope and associated interactive behaviors that allowed users to observe and operate the components of the 3D microscope model by means of natural interactions in an immersive scenario.The AR subsystem allowed participants to use a mobile terminal that took a picture of a microscope from a textbook and then displayed the structure and functions of the instrument,as well as the relevant operating guidance.This flexibly allowed students to use the system before or after class without time and space constraints.The system allowed users to switch between the VR and AR subsystems.Conclusions The system is useful for helping learners(especially K-12 students)to recognize a microscope's structure and grasp the required operational skills by simulating operations using an interactive process.In the future,such technology-assisted education would be a successful learning platform in an open learning space.展开更多
With the development of social science and technology,digital technology has been widely used in all walks of life.Especially in the field of medical education,the rational application of digital technology will creat...With the development of social science and technology,digital technology has been widely used in all walks of life.Especially in the field of medical education,the rational application of digital technology will create a simulated learning environment for students,which has a key impact on the improvement of medical education.This article is an analysis of the application of art and virtual reality in animal medical education.I hope that this analysis can play a certain role in improving the effect of today’s animal medical education,and provide a certain reference value for the reasonable application of digital technology and virtual reality technology in today’s animal medical education.展开更多
In 1981,Nanyang Technological Institute was established in Singapore to train engineers and accountants to keep up with the fast-growing economy of the country.In 1991,the institute was upgraded to Nanyang Technologic...In 1981,Nanyang Technological Institute was established in Singapore to train engineers and accountants to keep up with the fast-growing economy of the country.In 1991,the institute was upgraded to Nanyang Technological University(NTU).NTU holds the rank for world's top young university for six consecutive years according to the Quacquarelli Symonds(QS)world university ranking.Virtual Reality(VR)research began in NTU in the late 1990s.NTU's colleges,schools,institutes,and centers have contributed toward the excellence of VR research.This article briefly describes the VR research directions and activities in NTU.展开更多
As a new support platform of information technology for social development, virtual reality technology(VRT) has been widely used in many fields. Here, the concept and important features of VRT are summarized first. Th...As a new support platform of information technology for social development, virtual reality technology(VRT) has been widely used in many fields. Here, the concept and important features of VRT are summarized first. Then, the analysis requirement for VRT in design, display, operation and maintenance training, and state monitoring for aerospace products is elaborated. This is followed with a review of foreign and domestic policy planning of VRT, and their application in aerospace. Last, future development of VRT is discussed.展开更多
文摘In recent years,the government has issued a series of documents to promote the construction of digital campuses.This initiative serves to encourage the deep integration of information technology and intelligent technology education and digital reform,the combination of virtual reality and campus management is the need for innovative thinking and economic and social development,and then better change our learning style and living environment.The construction of the digital campus is based on virtual reality technology,BIM,GIS,and three-dimensional modeling technology to provide an immersive platform for students,promote the integration of virtual reality technology and education,help teachers,students,and parents to understand all kinds of education information and resources,to achieve their interoperability.From the off-campus environment to the school teaching equipment,teachers to teaching quality certification,and learning,to extracurricular entertainment,opening ceremonies to graduation parties,to bring more efficient,convenient,and safe campus life for teachers,students,and staff in school,and break the traditional information restrictions.
文摘With the rapid development of virtual reality technology,it has been widely used in the field of education.It can promote the development of learning transfer,which is an effective method for learners to learn effectively.Therefore,this paper describes how to use virtual reality technology to achieve learning transfer in order to achieve teaching goals and improve learning efficiency.
文摘This study comprehensively reviews the literature to deeply explore the role of computer science and internet technologies in addressing educational inequality and socio-psychological issues,with a particular focus on applications of 5G,artificial intelligence(AI),and augmented/virtual reality(AR/VR).By analyzing how these technologies are reshaping learning and their potential to ameliorate educational disparities,the study reveals challenges present in ensuring educational equity.The research methodology includes exhaustive reviews of applications of AI and machine learning,the Internet of Things and wearable technologies integration,big data analytics and data mining,and the effects of online platforms and social media on socio-psychological issues.Besides,the study discusses applications of these technologies in educational inequality and socio-psychological problem-solving through the lens of 5G,AI,and AR/VR,while also delineating challenges faced by these emerging technologies and future outlooks.The study finds that while computer science and internet technologies hold promise to bridge academic divides and address socio-psychological problems,the complexity of technology access and infrastructure,lack of digital literacy and skills,and critical ethical and privacy issues can impact widespread adoption and efficacy.Overall,the study provides a novel perspective to understand the potential of computer science and internet technologies in ameliorating educational inequality and socio-psychological issues,while pointing to new directions for future research.It also emphasizes the importance of cooperation among educational institutions,technology vendors,policymakers and researchers,and establishing comprehensive ethical guidelines and regulations to ensure the responsible use of these technologies.
基金funded by the European Commission through the H2020 project Hexa-X(Grant Agreement no.101015956).
文摘In the context of Industry 4.0,a paradigm shift from traditional industrial manipulators to Collaborative Robots(CRs)is ongoing,with the latter serving ever more closely humans as auxiliary tools in many production processes.In this scenario,continuous technological advancements offer new opportunities for further innovating robotics and other areas of next-generation industry.For example,6G could play a prominent role due to its human-centric view of the industrial domains.In particular,its expected dependability features will pave the way for new applications exploiting highly effective Digital Twin(DT)-and eXtended Reality(XR)-based telepresence.In this work,a novel application for the above technologies allowing two distant users to collaborate in the programming of a CR is proposed.The approach encompasses demanding data flows(e.g.,point cloud-based streaming of collaborating users and robotic environment),with network latency and bandwidth constraints.Results obtained by analyzing this approach from the viewpoint of network requirements in a setup designed to emulate 6G connectivity indicate that the expected performance of forthcoming mobile networks will make it fully feasible in principle.
文摘Background A task assigned to space exploration satellites involves detecting the physical environment within a certain space.However,space detection data are complex and abstract.These data are not conducive for researchers'visual perceptions of the evolution and interaction of events in the space environment.Methods A time-series dynamic data sampling method for large-scale space was proposed for sample detection data in space and time,and the corresponding relationships between data location features and other attribute features were established.A tone-mapping method based on statistical histogram equalization was proposed and applied to the final attribute feature data.The visualization process is optimized for rendering by merging materials,reducing the number of patches,and performing other operations.Results The results of sampling,feature extraction,and uniform visualization of the detection data of complex types,long duration spans,and uneven spatial distributions were obtained.The real-time visualization of large-scale spatial structures using augmented reality devices,particularly low-performance devices,was also investigated.Conclusions The proposed visualization system can reconstruct the three-dimensional structure of a large-scale space,express the structure and changes in the spatial environment using augmented reality,and assist in intuitively discovering spatial environmental events and evolutionary rules.
文摘This paper explores the transformative impact of virtual worlds, augmented reality (AR), and the metaverse in the healthcare sector. It delves into the ways these technologies are reshaping patient care, medical education, and research, while also addressing the challenges and opportunities they present. The paper highlights the potential benefits of these technologies and emphasizes the need for comprehensive regulatory frameworks and ethical guidelines to ensure responsible integration. Finally it outlines their transformative impact and discusses the challenges and opportunities they present for the future of healthcare provision.
文摘The design process of the built environment relies on the collaborative effort of all parties involved in the project.During the design phase,owners,end users,and their representatives are expected to make the most critical design and budgetary decisions-shaping the essential traits of the project,hence emerge the need and necessity to create and integrate mechanisms to support the decision-making process.Design decisions should not be based on assumptions,past experiences,or imagination.An example of the numerous problems that are a result of uninformed design decisions is“change orders”,known as the deviation from the original scope of work,which leads to an increase of the overall cost,and changes to the construction schedule of the project.The long-term aim of this inquiry is to understand the user’s behavior,and establish evidence-based control measures,which are actions and processes that can be implemented in practice to decrease the volume and frequency of the occurrence of change orders.The current study developed a foundation for further examination by proposing potential control measures,and testing their efficiency,such as integrating Virtual Reality(VR).The specific aim was to examine the effect of different visualization methods(i.e.,VR vs.construction drawings)on,(1)how well the subjects understand the information presented about the future/planned environment;(2)the subjects’perceived confidence in what the future environment will look like;(3)the likelihood of changing the built environment;(4)design review time;and(5)accuracy in reviewing and understanding the design.
基金supported by grants from the Mission Plan Program of Beijing Municipal Administration of Hospitals(SML20152201)Beijing Municipal Administration of Hospitals Clinical Medicine Development of Special Funding(ZYLX201712)+1 种基金the National Natural Science Foundation of China(81427803)Beijing Tsinghua Changgung Hospital Fund(12015C1039)
文摘Background: Augmented reality(AR) technology is used to reconstruct three-dimensional(3D) images of hepatic and biliary structures from computed tomography and magnetic resonance imaging data, and to superimpose the virtual images onto a view of the surgical field. In liver surgery, these superimposed virtual images help the surgeon to visualize intrahepatic structures and therefore, to operate precisely and to improve clinical outcomes.Data Sources: The keywords "augmented reality", "liver", "laparoscopic" and "hepatectomy" were used for searching publications in the Pub Med database. The primary source of literatures was from peer-reviewed journals up to December 2016. Additional articles were identified by manual search of references found in the key articles.Results: In general, AR technology mainly includes 3D reconstruction, display, registration as well as tracking techniques and has recently been adopted gradually for liver surgeries including laparoscopy and laparotomy with video-based AR assisted laparoscopic resection as the main technical application. By applying AR technology, blood vessels and tumor structures in the liver can be displayed during surgery,which permits precise navigation during complex surgical procedures. Liver transformation and registration errors during surgery were the main factors that limit the application of AR technology.Conclusions: With recent advances, AR technologies have the potential to improve hepatobiliary surgical procedures. However, additional clinical studies will be required to evaluate AR as a tool for reducing postoperative morbidity and mortality and for the improvement of long-term clinical outcomes. Future research is needed in the fusion of multiple imaging modalities, improving biomechanical liver modeling,and enhancing image data processing and tracking technologies to increase the accuracy of current AR methods.
基金the National Natural Science Foundation of China(51875517,51490663 and 51821093)and Key Research and Development Program of Zhejiang Province(2017C01045).
文摘Product assembly simulation is considered as one of the key technologies in the process of complex product design and manufacturing.Virtual assembly realizes the assembly process design,verification,and optimization of complex products in the virtual environment,which plays an active and effective role in improving the assembly quality and efficiency of complex products.In recent years,augmented reality(AR)and digital twin(DT)technology have brought new opportunities and challenges to the digital assembly of complex products owing to their characteristics of virtual reality fusion and interactive control.This paper expounds the concept and connotation of AR,enumerates a typical AR assembly system structure,analyzes the key technologies and applications of AR in digital assembly,and notes that DT technology is the future development trend of intelligent assembly research.
文摘Background Gesture is a basic interaction channel that is frequently used by humans to communicate in daily life. In this paper, we explore to use gesture-based approaches for target acquisition in virtual and augmented reality. A typical process of gesture-based target acquisition is: when a user intends to acquire a target, she performs a gesture with her hands, head or other parts of the body, the computer senses and recognizes the gesture and infers the most possible target. Methods We build mental model and behavior model of the user to study two key parts of the interaction process. Mental model describes how user thinks up a gesture for acquiring a target, and can be the intuitive mapping between gestures and targets. Behavior model describes how user moves the body parts to perform the gestures, and the relationship between the gesture that user intends to perform and signals that computer senses. Results In this paper, we present and discuss three pieces of research that focus on the mental model and behavior model of gesture-based target acquisition in VR and AR. Conclusions We show that leveraging these two models, interaction experience and performance can be improved in VR and AR environments.
基金Supported by Instituto de Salud CarlosⅢ(ISCⅢ),with group funds the Research Network on Chronicity,Primary Care and Health Promotion(RICAPPS,RD21/0016/0005)that is part of the Results-Oriented Cooperative Research Networks in Health(RICORS)(CarlosⅢHealth Institute),co-funded by the European Union“NextGeneration EU/PRTR”funds and with group funds Mental health research group in Primary Care(B17_23R),which is part of the Department of Innovation,Research,and University in the Government of Aragón(Spain).
文摘Current rates of mental illness are worrisome.Mental illness mainly affects females and younger age groups.The use of the internet to deliver mental health care has been growing since 2020 and includes the implementation of novel mental health treatments using virtual reality,augmented reality,and artificial intelligence.A new three dimensional digital environment,known as the metaverse,has emerged as the next version of the Internet.Artificial intelligence,augmented reality,and virtual reality will create fully immersive,experiential,and interactive online environments in the metaverse.People will use a unique avatar to do anything they do in their“real”lives,including seeking and receiving mental health care.In this opinion review,we reflect on how the metaverse could reshape how we deliver mental health treatment,its opportunities,and its challenges.
文摘the rapid development of computer technology has accelerated the progress of construction technology, and the application of virtual reality technology has become more and more common, which has caused earth-shaking changes in the thinking and mode of traditional architectural design. It plays an important role in optimizing the construction design scheme and improving the science and rationality of the architectural design. In order to realize the effective application of virtual technology in the future architectural design, it is necessary to intensify the research on its application and give full play to its application value and advantages. This paper discusses and analyzes the application and realization of virtual reality technology in the future architectural design, and predicts its future application prospects.
基金Supported by National Natural Science Foundation(40801124)Intellectual Innovation Project of Chinese Academy of Science(kzcx2-yw-224)~~
文摘Virtual tourism is the application of virtual reality technology in tourism industry,in which the key is to construct lifelike virtual environment.This paper introduces several main methods in producing virtual environment,such as landform formation with the help of height field method,construction of complicated three-dimensional models in virtual environment through 3DS MAX,construction of lifelike tree models using Billboard technique and Cross Billboard technique,and adoption of texture mapping,LOD(level of detail),and collision testing technique to increase sense of reality in virtual environment.Finally a lifelike virtual tourism environment is realized under the context of Visual C++6.0 through OpenGL.
文摘Mixed reality(MR)technology is a new digital holographic image technology,which appears in the field of graphics after virtual reality(VR)and augmented reality(AR)technology,a new interdisciplinary frontier.As a new generation of technology,MR has attracted great attention of clinicians in recent years.The emergence of MR will bring about revolutionary changes in medical education training,medical research,medical communication,and clinical treatment.At present,MR technology has become the popular frontline information technology for medical applications.With the popularization of digital technology in the medical field,the development prospects of MR are inestimable.The purpose of this review article is to introduce the application of MR technology in the medical field and prospect its trend in the future.
文摘The massive technological advancements around the world have created significant challenging competition among companies where each of the companies tries to attract the customers using different techniques. One of the recent tech- niques is Augmented Reality (AR). The AR is a new technology which is capable of presenting possibilities that are difficult for other technologies to offer and meet. Nowadays, numerous augmented reality applications have been used in the industry of different kinds and disseminated all over the world. AR will really alter the way individuals view the world. The AR is yet in its initial phases of research and development at different colleges and high-tech institutes. Throughout the last years, AR apps became transportable and generally available on various devices. Besides, AR be- gins to occupy its place in our audio-visual media and to be used in various fields in our life in tangible and exciting ways such as news, sports and is used in many domains in our life such as electronic commerce, promotion, design, and business. In addition, AR is used to facilitate the learning whereas it enables students to access location-specific infor- mation provided through various sources. Such growth and spread of AR applications pushes organizations to compete one another, every one of them exerts its best to gain the customers. This paper provides a comprehensive study of AR including its history, architecture, applications, current challenges and future trends.
文摘The paper elaborates the features and superiority of applying multimedia technology to aquatic organisms in a Science and Life Technology course. The augmented reality application of multimedia technology in aquatic organisms’ instruction has its own features, teaching information capacity, interactive user interface. The paper concludes the superiority of Unity and Vuforia AR instruction from five perspectives;meanwhile, the paper elaborates its disadvantages. An AR-based instruction attitude questionnaire was conducted at the end of the experiment to obtain learners’ perspectives of the system. Learners in AR approach demonstrate higher motivation and concentrate their attention on the learning tasks. Learners showed more positive attitude in willingness to use the AR-based instruction to improve learning interests. This study provided insights for better understanding the design, theory and practice of e-learning through augmented reality technology.
基金the National Key Research and Development Program of China(2018YFB1004905).
文摘Background Mixed-reality technologies,including virtual reality(VR)and augmented reality(AR),are considered to be promising potential tools for science teaching and learning processes that could foster positive emotions,motivate autonomous learning,and improve learning outcomes.Methods In this study,a technology-aided biological microscope learning system based on VR/AR is presented.The structure of the microscope is described in a detailed three-dimensional(3D)model,each component being represented with their topological interrelationships and associations among them being established.The interactive behavior of the model was specified,and a standard operating guide was compiled.The motion control of components was simulated based on collision detection.Combined with immersive VR equipment and AR technology,we developed a virtual microscope subsystem and a mobile virtual microscope guidance system.Results The system consisted of a VR subsystem and an AR subsystem.The focus of the VR subsystem was to simulate operating the microscope and associated interactive behaviors that allowed users to observe and operate the components of the 3D microscope model by means of natural interactions in an immersive scenario.The AR subsystem allowed participants to use a mobile terminal that took a picture of a microscope from a textbook and then displayed the structure and functions of the instrument,as well as the relevant operating guidance.This flexibly allowed students to use the system before or after class without time and space constraints.The system allowed users to switch between the VR and AR subsystems.Conclusions The system is useful for helping learners(especially K-12 students)to recognize a microscope's structure and grasp the required operational skills by simulating operations using an interactive process.In the future,such technology-assisted education would be a successful learning platform in an open learning space.
文摘With the development of social science and technology,digital technology has been widely used in all walks of life.Especially in the field of medical education,the rational application of digital technology will create a simulated learning environment for students,which has a key impact on the improvement of medical education.This article is an analysis of the application of art and virtual reality in animal medical education.I hope that this analysis can play a certain role in improving the effect of today’s animal medical education,and provide a certain reference value for the reasonable application of digital technology and virtual reality technology in today’s animal medical education.
文摘In 1981,Nanyang Technological Institute was established in Singapore to train engineers and accountants to keep up with the fast-growing economy of the country.In 1991,the institute was upgraded to Nanyang Technological University(NTU).NTU holds the rank for world's top young university for six consecutive years according to the Quacquarelli Symonds(QS)world university ranking.Virtual Reality(VR)research began in NTU in the late 1990s.NTU's colleges,schools,institutes,and centers have contributed toward the excellence of VR research.This article briefly describes the VR research directions and activities in NTU.
文摘As a new support platform of information technology for social development, virtual reality technology(VRT) has been widely used in many fields. Here, the concept and important features of VRT are summarized first. Then, the analysis requirement for VRT in design, display, operation and maintenance training, and state monitoring for aerospace products is elaborated. This is followed with a review of foreign and domestic policy planning of VRT, and their application in aerospace. Last, future development of VRT is discussed.