Avatars, as promising digital representations and service assistants of users in Metaverses, can enable drivers and passengers to immerse themselves in 3D virtual services and spaces of UAV-assisted vehicular Metavers...Avatars, as promising digital representations and service assistants of users in Metaverses, can enable drivers and passengers to immerse themselves in 3D virtual services and spaces of UAV-assisted vehicular Metaverses. However, avatar tasks include a multitude of human-to-avatar and avatar-to-avatar interactive applications, e.g., augmented reality navigation,which consumes intensive computing resources. It is inefficient and impractical for vehicles to process avatar tasks locally. Fortunately, migrating avatar tasks to the nearest roadside units(RSU)or unmanned aerial vehicles(UAV) for execution is a promising solution to decrease computation overhead and reduce task processing latency, while the high mobility of vehicles brings challenges for vehicles to independently perform avatar migration decisions depending on current and future vehicle status. To address these challenges, in this paper, we propose a novel avatar task migration system based on multi-agent deep reinforcement learning(MADRL) to execute immersive vehicular avatar tasks dynamically. Specifically, we first formulate the problem of avatar task migration from vehicles to RSUs/UAVs as a partially observable Markov decision process that can be solved by MADRL algorithms. We then design the multi-agent proximal policy optimization(MAPPO) approach as the MADRL algorithm for the avatar task migration problem. To overcome slow convergence resulting from the curse of dimensionality and non-stationary issues caused by shared parameters in MAPPO, we further propose a transformer-based MAPPO approach via sequential decision-making models for the efficient representation of relationships among agents. Finally, to motivate terrestrial or non-terrestrial edge servers(e.g., RSUs or UAVs) to share computation resources and ensure traceability of the sharing records, we apply smart contracts and blockchain technologies to achieve secure sharing management. Numerical results demonstrate that the proposed approach outperforms the MAPPO approach by around 2% and effectively reduces approximately 20% of the latency of avatar task execution in UAV-assisted vehicular Metaverses.展开更多
Current rates of mental illness are worrisome.Mental illness mainly affects females and younger age groups.The use of the internet to deliver mental health care has been growing since 2020 and includes the implementat...Current rates of mental illness are worrisome.Mental illness mainly affects females and younger age groups.The use of the internet to deliver mental health care has been growing since 2020 and includes the implementation of novel mental health treatments using virtual reality,augmented reality,and artificial intelligence.A new three dimensional digital environment,known as the metaverse,has emerged as the next version of the Internet.Artificial intelligence,augmented reality,and virtual reality will create fully immersive,experiential,and interactive online environments in the metaverse.People will use a unique avatar to do anything they do in their“real”lives,including seeking and receiving mental health care.In this opinion review,we reflect on how the metaverse could reshape how we deliver mental health treatment,its opportunities,and its challenges.展开更多
Non-face-to-face psychological counseling systems rely on network technologies to anonymize information regard-ing client identity.However,these systems often face challenges concerning voice data leaks and the subopt...Non-face-to-face psychological counseling systems rely on network technologies to anonymize information regard-ing client identity.However,these systems often face challenges concerning voice data leaks and the suboptimal communication of the client’s non-verbal expressions,such as facial cues,to the counselor.This study proposes a metaverse-based psychological counseling system designed to enhance client identity protection while ensuring efficient information delivery to counselors during non-face-to-face counseling.The proposed systemincorporates a voicemodulation function that instantlymodifies/masks the client’s voice to safeguard their identity.Additionally,it employs real-time client facial expression recognition using an ensemble of decision trees to mirror the client’s non-verbal expressions through their avatar in the metaverse environment.The system is adaptable for use on personal computers and smartphones,offering users the flexibility to access metaverse-based psychological counseling across diverse environments.The performance evaluation of the proposed system confirmed that the voice modulation and real-time facial expression replication consistently achieve an average speed of 48.32 frames per second or higher,even when tested on the least powerful smartphone configurations.Moreover,a total of 550 actual psychological counseling sessions were conducted,and the average satisfaction rating reached 4.46 on a 5-point scale.This indicates that clients experienced improved identity protection compared to conventional non-face-to-face metaverse counseling approaches.Additionally,the counselor successfully addressed the challenge of conveying non-verbal cues from clients who typically struggled with non-face-to-face psychological counseling.The proposed systemholds significant potential for applications in interactive discussions and educational activities in the metaverse.展开更多
López del Hoyo et al collections reported the meta verse based on the virtual reality,augmented reality and artificial intelligence could be used in the therapy of mental health,although there were still some cha...López del Hoyo et al collections reported the meta verse based on the virtual reality,augmented reality and artificial intelligence could be used in the therapy of mental health,although there were still some challenges.This manuscript reported that the meta verse is a prospective method to improve the prognosis of mental health problems.展开更多
Nowadays,theuse of Avatars that are unique digital depictions has increased by users to access Metaverse—a virtual reality environment—through multiple devices and for various purposes.Therefore,the Avatar and Metav...Nowadays,theuse of Avatars that are unique digital depictions has increased by users to access Metaverse—a virtual reality environment—through multiple devices and for various purposes.Therefore,the Avatar and Metaverse are being developed with a new theory,application,and design,necessitating the association of more personal data and devices of targeted users every day.This Avatar and Metaverse technology explosion raises privacy and security concerns,leading to cyber attacks.MV-Honeypot,or Metaverse-Honeypot,as a commercial off-the-shelf solution that can counter these cyber attack-causing vulnerabilities,should be developed.To fill this gap,we study user’s engagements with Avatars in Metaverse,analyze possible security vulnerabilities,and create a model named Simplified Avatar Relationship Association with Non-linear Gradient(SARANG)that draws the full diagram of infrastructure components and data flow through accessing Metaverse in this paper.We also determine the most significant threat for each component’s cyberattacks that will affect user data and Avatars.As a result,the commercial off-the-shelf(COTS)of the MV-Honeypot must be established.展开更多
The medical metaverse and digital twin are set to revolutionise healthcare.Like all emerging technologies their benefits must be weighed against their ethical and social,impacts.If we consider the advances of medical ...The medical metaverse and digital twin are set to revolutionise healthcare.Like all emerging technologies their benefits must be weighed against their ethical and social,impacts.If we consider the advances of medical technology as an expression of our values,such as the pursuit of knowledge,cures and healing,an ethical study allows us to align our values and steer the technology towards an agreed goal.However,to appreciate the long-term consequents of a technology,those consequences must be considered in the context of a society already shaped by that technology.This paper identifies the technologies currently shaping society and considers the ethical,and social consequences of the medical metaverse and digital twin in that future society.展开更多
The advent of immersive technologies such as the metaverse,extended reality,artificial intelligence,and blockchain offers novel possibilities to transform healthcare services.These innovations coincide with clinicians...The advent of immersive technologies such as the metaverse,extended reality,artificial intelligence,and blockchain offers novel possibilities to transform healthcare services.These innovations coincide with clinicians'aspirations to deliver more comprehensive,patient-centered care tailored to individuals singular needs and preferences.Integration of these emerging tools may confer opportunities for providers to engage patients through new modalities and expand their role.However,responsible implementation necessitates deliberation of ethical implications and steadfast adherence to foundational principles of compassion and interpersonal connection underpinning the profession.While the metaverse introduces new channels for social prescribing,this perspective advocates that its ultimate purpose should be strengthening,not supplanting,human relationships.We propose an ethical framework centered on respect for patients'dignity to guide integration of metaverse platforms into medical practice.This framework serves both to harness their potential benefits and mitigate risks of dehumanization or uncompassionate care.Our analysis maps the developing topology of metaverse-enabled care while upholding moral imperatives for medicine to promote healing relationships and human flourishing.展开更多
Recent rapid advancements in communication technology have brought forth the era of Web 3.0,representing a substantial transformation in the Internet landscape.This shift has led to the emergence of various decentrali...Recent rapid advancements in communication technology have brought forth the era of Web 3.0,representing a substantial transformation in the Internet landscape.This shift has led to the emergence of various decentralized metaverse applications that leverage blockchain as their underlying technology to enable users to exchange value directly from point to point.However,blockchains are blind to the real world,and smart contracts cannot directly access data from the external world.To address this limitation,the technology of oracles has been introduced to provide real-world data for smart contracts and other blockchain applications.In this paper,we focus on mitigating the risks associated with oracles providing corrupt or incorrect data.We propose a novel Web 3.0 architecture for the Metaverse based on the multiidentifier network(MIN),and its decentralized blockchain oracle model called Meta Oracle.The experimental results show that the proposed scheme can achieve minor time investment in return for significantly more reliable data and increased throughput.展开更多
The advent of the metaverse,including virtual reality,augmented reality,andartificial intelligence,is an undeniable issue that health care scientists need toupdate.It influences all fields of knowledge,interpersonal r...The advent of the metaverse,including virtual reality,augmented reality,andartificial intelligence,is an undeniable issue that health care scientists need toupdate.It influences all fields of knowledge,interpersonal relationships,andhealth.Regarding mental health since the post-coronavirus disease 2019 pandemic,it is necessary to consider and understand the potential,possibilities,weaknesses,and consequences arising from and provided by this new scenario.Due tothe increasing need for mental health monitoring and care,mental health treatmentsrequire in-depth training and preparation to achieve the maximum use of themetaverse advantages and possibilities.Currently,very little is known about theeffectiveness of remote mental health treatment,but it is certainly suggested thataccessibility and the characteristics associated with the use of metaverse technologiesmay represent new horizons for accessibility and approach tools,as long asmore studies are carried out and more evidence is collected to develop accurateguidelines,safe training,solve ethical concerns,and overcome limitations.展开更多
In the context of edge computing environments in general and the metaverse in particular,federated learning(FL)has emerged as a distributed machine learning paradigm that allows multiple users to collaborate on traini...In the context of edge computing environments in general and the metaverse in particular,federated learning(FL)has emerged as a distributed machine learning paradigm that allows multiple users to collaborate on training a shared machine learning model locally,eliminating the need for uploading raw data to a central server.It is perhaps the only training paradigm that preserves the privacy of user data,which is essential for computing environments as personal as the metaverse.However,the original FL architecture proposed is not scalable to a large number of user devices in the metaverse community.To mitigate this problem,hierarchical federated learning(HFL)has been introduced as a general distributed learning paradigm,inspiring a number of research works.In this paper,we present several types of HFL architectures,with a special focus on the three-layer client-edge-cloud HFL architecture,which is most pertinent to the metaverse due to its delay-sensitive nature.We also examine works that take advantage of the natural layered organization of three-layer client-edge-cloud HFL to tackle some of the most challenging problems in FL within the metaverse.Finally,we outline some future research directions of HFL in the metaverse.展开更多
This paper explores the transformative impact of virtual worlds, augmented reality (AR), and the metaverse in the healthcare sector. It delves into the ways these technologies are reshaping patient care, medical educa...This paper explores the transformative impact of virtual worlds, augmented reality (AR), and the metaverse in the healthcare sector. It delves into the ways these technologies are reshaping patient care, medical education, and research, while also addressing the challenges and opportunities they present. The paper highlights the potential benefits of these technologies and emphasizes the need for comprehensive regulatory frameworks and ethical guidelines to ensure responsible integration. Finally it outlines their transformative impact and discusses the challenges and opportunities they present for the future of healthcare provision.展开更多
The Metaverse,a three-dimensional(3D)virtual world network that includes social and economic interactions through virtual reality(VR)and augmented reality(AR)devices,has been recognized as a transformative concept in ...The Metaverse,a three-dimensional(3D)virtual world network that includes social and economic interactions through virtual reality(VR)and augmented reality(AR)devices,has been recognized as a transformative concept in a variety of fields,including education.As technology advances at a rapid pace,the potential of the Metaverse to revolutionize teaching and learning has become increasingly prominent.Particularly in English education,the Metaverse offers promising solutions to address the challenges of oral English education during the COVID-19 era.This paper explores the potential of the Metaverse in enhancing oral English education and highlights its future possibilities.Drawing from the realms of AR and VR,this paper also examines teaching approaches and strategies that integrate the Metaverse into oral English instruction.By leveraging the immersive and interactive nature of the Metaverse,educators or students can create engaging learning experiences that foster oral English communication skills.展开更多
Nanomaterial-based flexible sensors(NMFSs)can be tightly attached to the human skin or integrated with clothing to monitor human physiological information,provide medical data,or explore metaverse spaces.Nanomaterials...Nanomaterial-based flexible sensors(NMFSs)can be tightly attached to the human skin or integrated with clothing to monitor human physiological information,provide medical data,or explore metaverse spaces.Nanomaterials have been widely incorporated into flexible sensors due to their facile processing,material compatibility,and unique properties.This review highlights the recent advancements in NMFSs involving various nanomaterial frameworks such as nanoparticles,nanowires,and nanofilms.Different triggering interaction interfaces between NMFSs and metaverse/virtual reality(VR)applications,e.g.skin-mechanics-triggered,temperature-triggered,magnetically triggered,and neural-triggered interfaces,are discussed.In the context of interfacing physical and virtual worlds,machine learning(ML)has emerged as a promising tool for processing sensor data for controlling avatars in metaverse/VR worlds,and many ML algorithms have been proposed for virtual interaction technologies.This paper discusses the advantages,disadvantages,and prospects of NMFSs in metaverse/VR applications.展开更多
The realization of an interoperable and scalable virtual platform, currently known as the “metaverse,” is inevitable, but many technological challenges need to be overcome first. With the metaverse still in a nascen...The realization of an interoperable and scalable virtual platform, currently known as the “metaverse,” is inevitable, but many technological challenges need to be overcome first. With the metaverse still in a nascent phase, research currently indicates that building a new 3D social environment capable of interoperable avatars and digital transactions will represent most of the initial investment in time and capital. The return on investment, however, is worth the financial risk for firms like Meta, Google, and Apple. While the current virtual space of the metaverse is worth $6.30 billion, that is expected to grow to $84.09 billion by the end of 2028. But the creation of an entire alternate virtual universe of 3D avatars, objects, and otherworldly cityscapes calls for a new development pipeline and workflow. Existing 3D modeling and digital twin processes, already well-established in industry and gaming, will be ported to support the need to architect and furnish this new digital world. The current development pipeline, however, is cumbersome, expensive and limited in output capacity. This paper proposes a new and innovative immersive development pipeline leveraging the recent advances in artificial intelligence (AI) for 3D model creation and optimization. The previous reliance on 3D modeling software to create assets and then import into a game engine can be replaced with nearly instantaneous content creation with AI. While AI art generators like DALL-E 2 and DeepAI have been used for 2D asset creation, when combined with game engine technology, such as Unreal Engine 5 and virtualized geometry systems like Nanite, a new process for creating nearly unlimited content for immersive reality is possible. New processes and workflows, such as those proposed here, will revolutionize content creation and pave the way for Web 3.0, the metaverse and a truly 3D social environment.展开更多
基金supported in part by NSFC (62102099, U22A2054, 62101594)in part by the Pearl River Talent Recruitment Program (2021QN02S643)+9 种基金Guangzhou Basic Research Program (2023A04J1699)in part by the National Research Foundation, SingaporeInfocomm Media Development Authority under its Future Communications Research Development ProgrammeDSO National Laboratories under the AI Singapore Programme under AISG Award No AISG2-RP-2020-019Energy Research Test-Bed and Industry Partnership Funding Initiative, Energy Grid (EG) 2.0 programmeDesCartes and the Campus for Research Excellence and Technological Enterprise (CREATE) programmeMOE Tier 1 under Grant RG87/22in part by the Singapore University of Technology and Design (SUTD) (SRG-ISTD-2021- 165)in part by the SUTD-ZJU IDEA Grant SUTD-ZJU (VP) 202102in part by the Ministry of Education, Singapore, through its SUTD Kickstarter Initiative (SKI 20210204)。
文摘Avatars, as promising digital representations and service assistants of users in Metaverses, can enable drivers and passengers to immerse themselves in 3D virtual services and spaces of UAV-assisted vehicular Metaverses. However, avatar tasks include a multitude of human-to-avatar and avatar-to-avatar interactive applications, e.g., augmented reality navigation,which consumes intensive computing resources. It is inefficient and impractical for vehicles to process avatar tasks locally. Fortunately, migrating avatar tasks to the nearest roadside units(RSU)or unmanned aerial vehicles(UAV) for execution is a promising solution to decrease computation overhead and reduce task processing latency, while the high mobility of vehicles brings challenges for vehicles to independently perform avatar migration decisions depending on current and future vehicle status. To address these challenges, in this paper, we propose a novel avatar task migration system based on multi-agent deep reinforcement learning(MADRL) to execute immersive vehicular avatar tasks dynamically. Specifically, we first formulate the problem of avatar task migration from vehicles to RSUs/UAVs as a partially observable Markov decision process that can be solved by MADRL algorithms. We then design the multi-agent proximal policy optimization(MAPPO) approach as the MADRL algorithm for the avatar task migration problem. To overcome slow convergence resulting from the curse of dimensionality and non-stationary issues caused by shared parameters in MAPPO, we further propose a transformer-based MAPPO approach via sequential decision-making models for the efficient representation of relationships among agents. Finally, to motivate terrestrial or non-terrestrial edge servers(e.g., RSUs or UAVs) to share computation resources and ensure traceability of the sharing records, we apply smart contracts and blockchain technologies to achieve secure sharing management. Numerical results demonstrate that the proposed approach outperforms the MAPPO approach by around 2% and effectively reduces approximately 20% of the latency of avatar task execution in UAV-assisted vehicular Metaverses.
基金Supported by Instituto de Salud CarlosⅢ(ISCⅢ),with group funds the Research Network on Chronicity,Primary Care and Health Promotion(RICAPPS,RD21/0016/0005)that is part of the Results-Oriented Cooperative Research Networks in Health(RICORS)(CarlosⅢHealth Institute),co-funded by the European Union“NextGeneration EU/PRTR”funds and with group funds Mental health research group in Primary Care(B17_23R),which is part of the Department of Innovation,Research,and University in the Government of Aragón(Spain).
文摘Current rates of mental illness are worrisome.Mental illness mainly affects females and younger age groups.The use of the internet to deliver mental health care has been growing since 2020 and includes the implementation of novel mental health treatments using virtual reality,augmented reality,and artificial intelligence.A new three dimensional digital environment,known as the metaverse,has emerged as the next version of the Internet.Artificial intelligence,augmented reality,and virtual reality will create fully immersive,experiential,and interactive online environments in the metaverse.People will use a unique avatar to do anything they do in their“real”lives,including seeking and receiving mental health care.In this opinion review,we reflect on how the metaverse could reshape how we deliver mental health treatment,its opportunities,and its challenges.
基金supported by“Regional Innovation Strategy(RIS)”through the National Research Foundation of Korea(NRF)funded by the Ministry of Education(MOE)(2021RIS-004)supported by the Technology Development Program(S3230339)funded by the Ministry of SMEs and Startups(MSS,Korea).
文摘Non-face-to-face psychological counseling systems rely on network technologies to anonymize information regard-ing client identity.However,these systems often face challenges concerning voice data leaks and the suboptimal communication of the client’s non-verbal expressions,such as facial cues,to the counselor.This study proposes a metaverse-based psychological counseling system designed to enhance client identity protection while ensuring efficient information delivery to counselors during non-face-to-face counseling.The proposed systemincorporates a voicemodulation function that instantlymodifies/masks the client’s voice to safeguard their identity.Additionally,it employs real-time client facial expression recognition using an ensemble of decision trees to mirror the client’s non-verbal expressions through their avatar in the metaverse environment.The system is adaptable for use on personal computers and smartphones,offering users the flexibility to access metaverse-based psychological counseling across diverse environments.The performance evaluation of the proposed system confirmed that the voice modulation and real-time facial expression replication consistently achieve an average speed of 48.32 frames per second or higher,even when tested on the least powerful smartphone configurations.Moreover,a total of 550 actual psychological counseling sessions were conducted,and the average satisfaction rating reached 4.46 on a 5-point scale.This indicates that clients experienced improved identity protection compared to conventional non-face-to-face metaverse counseling approaches.Additionally,the counselor successfully addressed the challenge of conveying non-verbal cues from clients who typically struggled with non-face-to-face psychological counseling.The proposed systemholds significant potential for applications in interactive discussions and educational activities in the metaverse.
文摘López del Hoyo et al collections reported the meta verse based on the virtual reality,augmented reality and artificial intelligence could be used in the therapy of mental health,although there were still some challenges.This manuscript reported that the meta verse is a prospective method to improve the prognosis of mental health problems.
基金supported by the Institute of Information&Communications Technology Planning&Evaluation(IITP)(Project Nos.2022-0-00701,10%,RS-2023-00228996,10%,RS-2022-00165794,10%)the ICTR&DProgram of MSIT/IITP(ProjectNo.2021-0-01816,10%)a National Research Foundation of Korea(NRF)grant funded by the Korean Government(Project No.RS2023-00208460,60%).
文摘Nowadays,theuse of Avatars that are unique digital depictions has increased by users to access Metaverse—a virtual reality environment—through multiple devices and for various purposes.Therefore,the Avatar and Metaverse are being developed with a new theory,application,and design,necessitating the association of more personal data and devices of targeted users every day.This Avatar and Metaverse technology explosion raises privacy and security concerns,leading to cyber attacks.MV-Honeypot,or Metaverse-Honeypot,as a commercial off-the-shelf solution that can counter these cyber attack-causing vulnerabilities,should be developed.To fill this gap,we study user’s engagements with Avatars in Metaverse,analyze possible security vulnerabilities,and create a model named Simplified Avatar Relationship Association with Non-linear Gradient(SARANG)that draws the full diagram of infrastructure components and data flow through accessing Metaverse in this paper.We also determine the most significant threat for each component’s cyberattacks that will affect user data and Avatars.As a result,the commercial off-the-shelf(COTS)of the MV-Honeypot must be established.
文摘The medical metaverse and digital twin are set to revolutionise healthcare.Like all emerging technologies their benefits must be weighed against their ethical and social,impacts.If we consider the advances of medical technology as an expression of our values,such as the pursuit of knowledge,cures and healing,an ethical study allows us to align our values and steer the technology towards an agreed goal.However,to appreciate the long-term consequents of a technology,those consequences must be considered in the context of a society already shaped by that technology.This paper identifies the technologies currently shaping society and considers the ethical,and social consequences of the medical metaverse and digital twin in that future society.
文摘The advent of immersive technologies such as the metaverse,extended reality,artificial intelligence,and blockchain offers novel possibilities to transform healthcare services.These innovations coincide with clinicians'aspirations to deliver more comprehensive,patient-centered care tailored to individuals singular needs and preferences.Integration of these emerging tools may confer opportunities for providers to engage patients through new modalities and expand their role.However,responsible implementation necessitates deliberation of ethical implications and steadfast adherence to foundational principles of compassion and interpersonal connection underpinning the profession.While the metaverse introduces new channels for social prescribing,this perspective advocates that its ultimate purpose should be strengthening,not supplanting,human relationships.We propose an ethical framework centered on respect for patients'dignity to guide integration of metaverse platforms into medical practice.This framework serves both to harness their potential benefits and mitigate risks of dehumanization or uncompassionate care.Our analysis maps the developing topology of metaverse-enabled care while upholding moral imperatives for medicine to promote healing relationships and human flourishing.
基金supported by Shenzhen Fundamental Research Programs under Grant Nos.JCYJ20220531093206015,GXWD20201231165807007-20200807164903001,JCYJ20210324122013036,and JCYJ20190808155607340Guang Dong Prov.R&D Key Programs under Grant Nos.2019B010137001 and 2018B010124001+4 种基金Basic Research Enhancement Program of China under Grant No.2021-JCJQ-JJ-0483National Keystone R&D Program of China under Grant No.2017YFB0803204Natural Science Foundation of China under Grant No.61671001ZTE Industry-University-Institute Fund Project under Grant No.2019ZTE03-01HuaWei Funding under Grant No.TC20201222002。
文摘Recent rapid advancements in communication technology have brought forth the era of Web 3.0,representing a substantial transformation in the Internet landscape.This shift has led to the emergence of various decentralized metaverse applications that leverage blockchain as their underlying technology to enable users to exchange value directly from point to point.However,blockchains are blind to the real world,and smart contracts cannot directly access data from the external world.To address this limitation,the technology of oracles has been introduced to provide real-world data for smart contracts and other blockchain applications.In this paper,we focus on mitigating the risks associated with oracles providing corrupt or incorrect data.We propose a novel Web 3.0 architecture for the Metaverse based on the multiidentifier network(MIN),and its decentralized blockchain oracle model called Meta Oracle.The experimental results show that the proposed scheme can achieve minor time investment in return for significantly more reliable data and increased throughput.
文摘The advent of the metaverse,including virtual reality,augmented reality,andartificial intelligence,is an undeniable issue that health care scientists need toupdate.It influences all fields of knowledge,interpersonal relationships,andhealth.Regarding mental health since the post-coronavirus disease 2019 pandemic,it is necessary to consider and understand the potential,possibilities,weaknesses,and consequences arising from and provided by this new scenario.Due tothe increasing need for mental health monitoring and care,mental health treatmentsrequire in-depth training and preparation to achieve the maximum use of themetaverse advantages and possibilities.Currently,very little is known about theeffectiveness of remote mental health treatment,but it is certainly suggested thataccessibility and the characteristics associated with the use of metaverse technologiesmay represent new horizons for accessibility and approach tools,as long asmore studies are carried out and more evidence is collected to develop accurateguidelines,safe training,solve ethical concerns,and overcome limitations.
文摘In the context of edge computing environments in general and the metaverse in particular,federated learning(FL)has emerged as a distributed machine learning paradigm that allows multiple users to collaborate on training a shared machine learning model locally,eliminating the need for uploading raw data to a central server.It is perhaps the only training paradigm that preserves the privacy of user data,which is essential for computing environments as personal as the metaverse.However,the original FL architecture proposed is not scalable to a large number of user devices in the metaverse community.To mitigate this problem,hierarchical federated learning(HFL)has been introduced as a general distributed learning paradigm,inspiring a number of research works.In this paper,we present several types of HFL architectures,with a special focus on the three-layer client-edge-cloud HFL architecture,which is most pertinent to the metaverse due to its delay-sensitive nature.We also examine works that take advantage of the natural layered organization of three-layer client-edge-cloud HFL to tackle some of the most challenging problems in FL within the metaverse.Finally,we outline some future research directions of HFL in the metaverse.
文摘This paper explores the transformative impact of virtual worlds, augmented reality (AR), and the metaverse in the healthcare sector. It delves into the ways these technologies are reshaping patient care, medical education, and research, while also addressing the challenges and opportunities they present. The paper highlights the potential benefits of these technologies and emphasizes the need for comprehensive regulatory frameworks and ethical guidelines to ensure responsible integration. Finally it outlines their transformative impact and discusses the challenges and opportunities they present for the future of healthcare provision.
文摘The Metaverse,a three-dimensional(3D)virtual world network that includes social and economic interactions through virtual reality(VR)and augmented reality(AR)devices,has been recognized as a transformative concept in a variety of fields,including education.As technology advances at a rapid pace,the potential of the Metaverse to revolutionize teaching and learning has become increasingly prominent.Particularly in English education,the Metaverse offers promising solutions to address the challenges of oral English education during the COVID-19 era.This paper explores the potential of the Metaverse in enhancing oral English education and highlights its future possibilities.Drawing from the realms of AR and VR,this paper also examines teaching approaches and strategies that integrate the Metaverse into oral English instruction.By leveraging the immersive and interactive nature of the Metaverse,educators or students can create engaging learning experiences that foster oral English communication skills.
基金financially supported by China Scholarship Council(CSC)under the Grant CSC(No.202107585001)Jilin Provincial Science and Technology Program(Nos.20210101069JC and 20190702002GH)+2 种基金Science and Technology Program of Changchun(No.21ZGM18)‘111’Project of China(No.D17017)the Hong Kong Research Grants Council(Project Nos.11207222 and 11210819)for partially supporting this work。
文摘Nanomaterial-based flexible sensors(NMFSs)can be tightly attached to the human skin or integrated with clothing to monitor human physiological information,provide medical data,or explore metaverse spaces.Nanomaterials have been widely incorporated into flexible sensors due to their facile processing,material compatibility,and unique properties.This review highlights the recent advancements in NMFSs involving various nanomaterial frameworks such as nanoparticles,nanowires,and nanofilms.Different triggering interaction interfaces between NMFSs and metaverse/virtual reality(VR)applications,e.g.skin-mechanics-triggered,temperature-triggered,magnetically triggered,and neural-triggered interfaces,are discussed.In the context of interfacing physical and virtual worlds,machine learning(ML)has emerged as a promising tool for processing sensor data for controlling avatars in metaverse/VR worlds,and many ML algorithms have been proposed for virtual interaction technologies.This paper discusses the advantages,disadvantages,and prospects of NMFSs in metaverse/VR applications.
文摘The realization of an interoperable and scalable virtual platform, currently known as the “metaverse,” is inevitable, but many technological challenges need to be overcome first. With the metaverse still in a nascent phase, research currently indicates that building a new 3D social environment capable of interoperable avatars and digital transactions will represent most of the initial investment in time and capital. The return on investment, however, is worth the financial risk for firms like Meta, Google, and Apple. While the current virtual space of the metaverse is worth $6.30 billion, that is expected to grow to $84.09 billion by the end of 2028. But the creation of an entire alternate virtual universe of 3D avatars, objects, and otherworldly cityscapes calls for a new development pipeline and workflow. Existing 3D modeling and digital twin processes, already well-established in industry and gaming, will be ported to support the need to architect and furnish this new digital world. The current development pipeline, however, is cumbersome, expensive and limited in output capacity. This paper proposes a new and innovative immersive development pipeline leveraging the recent advances in artificial intelligence (AI) for 3D model creation and optimization. The previous reliance on 3D modeling software to create assets and then import into a game engine can be replaced with nearly instantaneous content creation with AI. While AI art generators like DALL-E 2 and DeepAI have been used for 2D asset creation, when combined with game engine technology, such as Unreal Engine 5 and virtualized geometry systems like Nanite, a new process for creating nearly unlimited content for immersive reality is possible. New processes and workflows, such as those proposed here, will revolutionize content creation and pave the way for Web 3.0, the metaverse and a truly 3D social environment.