Effects of virtual agents on interaction efficiency and environmental immersion in MR environments

Background Physical entity interactions in mixed reality(MR)environments aim to harness human capabilities in manipulating physical objects,thereby enhancing virtual environment(VEs)functionality.In MR,a common strategy is to use virtual agents as substitutes for physical entities,balancing interaction efficiency with environmental immersion.However,the impact of virtual agent size and form on interaction performance remains unclear.Methods Two experiments were conducted to explore how virtual agent size and form affect interaction performance,immersion,and preference in MR environments.The first experiment assessed five virtual agent sizes(25%,50%,75%,100%,and 125%of physical size).The second experiment tested four types of frames(no frame,consistent frame,half frame,and surrounding frame)across all agent sizes.Participants,utilizing a head mounted display,performed tasks involving moving cups,typing words,and using a mouse.They completed questionnaires assessing aspects such as the virtual environment effects,interaction effects,collision concerns,and preferences.Results Results from the first experiment revealed that agents matching physical object size produced the best overall performance.The second experiment demonstrated that consistent framing notably enhances interaction accuracy and speed but reduces immersion.To balance efficiency and immersion,frameless agents matching physical object sizes were deemed optimal.Conclusions Virtual agents matching physical entity sizes enhance user experience and interaction performance.Conversely,familiar frames from 2D interfaces detrimentally affect interaction and immersion in virtual spaces.This study provides valuable insights for the future development of MR systems.

The Trade-Off Between Performance and Security of Virtualized Trusted Execution Environment on Android

Nowadays,with the significant growth of the mobile market,security issues on the Android Operation System have also become an urgent matter.Trusted execution environment(TEE)technologies are considered an option for satisfying the inviolable property by taking advantage of hardware security.However,for Android,TEE technologies still contain restrictions and limitations.The first issue is that non-original equipment manufacturer developers have limited access to the functionality of hardware-based TEE.Another issue of hardware-based TEE is the cross-platform problem.Since every mobile device supports different TEE vendors,it becomes an obstacle for developers to migrate their trusted applications to other Android devices.A software-based TEE solution is a potential approach that allows developers to customize,package and deliver the product efficiently.Motivated by that idea,this paper introduces a VTEE model,a software-based TEE solution,on Android devices.This research contributes to the analysis of the feasibility of using a virtualized TEE on Android devices by considering two metrics:computing performance and security.The experiment shows that the VTEE model can host other software-based TEE services and deliver various cryptography TEE functions on theAndroid environment.The security evaluation shows that adding the VTEE model to the existing Android does not addmore security issues to the traditional design.Overall,this paper shows applicable solutions to adjust the balance between computing performance and security.

Stereoscopic Camera-Sensor Model for the Development of Highly Automated Driving Functions within a Virtual Test Environment

The need for efficient and reproducible development processes for sensor and perception systems is growing with their increased use in modern vehicles. Such processes can be achieved by using virtual test environments and virtual sensor models. In the context of this, the present paper documents the development of a sensor model for depth estimation of virtual three-dimensional scenarios. For this purpose, the geometric and algorithmic principles of stereoscopic camera systems are recreated in a virtual form. The model is implemented as a subroutine in the Epic Games Unreal Engine, which is one of the most common Game Engines. Its architecture consists of several independent procedures that enable a local depth estimation, but also a reconstruction of a whole three-dimensional scenery. In addition, a separate programme for calibrating the model is presented. In addition to the basic principles, the architecture and the implementation, this work also documents the evaluation of the model created. It is shown that the model meets specifically defined requirements for real-time capability and the accuracy of the evaluation. Thus, it is suitable for the virtual testing of common algorithms and highly automated driving functions.

The Use of Virtual Learning Environment in Chinese Higher Education

The paper analyzes the current condition of the use of virtual learning environment(VLE) in Zhejiang University of Chinese Medicine. It is indicated that students show a positive attitude toward this technology, but the use of it fails to meet students' perception. In light of this, recommendations are made with a view to enhance the use of VLE.

A Hierarchical Framework for Visualising and Simulating Supply Chains in Virtual Environments

This paper presents research into applying virtual environment (VE) technology to supply chain management (SCM). Our research work has employed virtual manufacturing environments to represent supply chain nodes to simulate processes and activities in supply chain management. This will enable those who are involved in these processes and activities to gain an intuitive understanding of them, so as to design robust supply chains and make correct decisions at the right time. A framework system and its hierarchical structure for visualising and simulating supply chains in virtual environments are reported and detailed in this paper.

Realization of Reconfigurable Virtual Environments for Virtual Testing

This paper presents the design and implementation of reconfigurable virtual environments (VEs) for virtual testing. It proposes a hybrid design approach that is derived from a so-called integration and composition of the reconfiguration strategy. The designing process has thus evolved from binding virtual objects using reconfiguration rules within the context of virtual testing scenarios. Therefore reconfigurable virtual environments are established with improved flexibility and scalability, tailored to a wide range of virtual testing applications. Those virtual environments integrate virtual testing scenarios, data acquisition, databases, rule mapping and application interfaces, which yield modular testing functions and an open-ended system architecture with a set of extensible interface tools to realize data exchange within reconfigurable VEs. This enables virtual testing scenarios to be reconfigured interactively based on real time data and communication between virtual environments and real environments. A virtual testing application has been implemented using reconfigurable VEs. Keywords Virtual environment - virtual testing - reconfigurable virtual reality Wenyan Wu graduated from Dalian University of Technology, China, with BSc and MSc in 1988 and 1991 respectively. She earned her PhD degree from University of Derby, UK, in 2002. She had taught and researched in Harbin Institute of Technology, China and De Montfort University, UK. She is currently a senior lecturer in simulation and virtual reality at Staffordshire University, UK. Her research interests include computer graphics, Virtual Reality and Augmented Reality system, advanced interface, modelling and simulation, distribution system.Zhengxu Zhao BSc, MSc, PhD, CEng, CITP, MBCS, full Professor in Applied Computing, Director of Virtual Reality Centre. He is also a Cheng Kong Scholar Project Professor in Virtual Reality Technology and Director of Virtual Reality Research Centre at the Southeast University, P R China. Professor Zhao’s research interests include computing graphics and VR systems, industrial process simulation, CIM and manufacturing management systems.

Generation and Control of Game Virtual Environment

In this paper, we present a framework for the generation and control of an Internet-based 3-dimensional game virtual environment that allows a character to navigate through the environment. Our framework includes 3-dimensional terrain mesh data processing, a map editor, scene processing, collision processing, and walkthrough control. We also define an environment-specific semantic information editor, which can be applied using specific location obtained from the real world. Users can insert text information related to the characters real position in the real world during navigation in the game virtual environment.

Geographical Information Visualization on a Panoramic Sphere in an Immersive Environment

In this paper,we propose a novel approach to visualizing global geographical information:a panoramic sphere in an immersive environment.The whole geographical surface can be observed through the rotating of heads as the viewpoint of the panoramic sphere is inside the sphere.We compared three approaches to visualizing the earth for rendering the geographical information in a virtual reality environment.On the tasks of terrestrial and marine geographical information,we compare the visualization effects on a)a globe,b)a flat map and c)a panoramic sphere.Terrestrial geographical information tasks include the area comparison and direction determination.Marine geographical information tasks contain the visualization of sea surface temperature and sea surface currents.For terrestrial geographical information tasks,the experimental results show that the panoramic sphere outperforms the globe and the flat map,with a higher average accuracy and a shorter time.On marine geographical information task,the panoramic sphere visualization is also superior to the flat map and the globe in an immersive environment for the sea surface temperature data and the sea surface current fields.In all three visualization experiments,the panoramic sphere is most preferred by the participants,particularly for global,transcontinental and transoceanic needs.

Creation and Evaluation of a Multi-sensory Virtual Assembly Environment

The multi-modal information presentation, integrated into the virtual environment （VE）, has potential for stimulating different senses, improving the user＇s impression of immersion, and increasing the amount of information that is accepted and processed by the user＇s perception system. The increase of the useful feedback information may reduce the user＇s cognitive load, thus enhancing the user＇s efficiency and performance while interacting with VEs. This paper presents our creation of a multi-sensory virtual assembly environment （VAE） and the evaluation of the effects of multi-sensory feedback on the usability. The VAE brings together complex technologies such as constraint-based assembly simulation, optical motion tracking technology, and real-time 3D sound generation technology around a virtual reality workbench and a common software platform. The usability evaluation is in terms of its three attributes： efficiency of use, user satisfaction, and reliability. These are addressed by using task completion times （TCTs）, questionnaires, and human performance error rates （HPERs）, respectively. Two assembly tasks have been used to perform the experiments, using sixteen participants. The outcomes showed that the multi-sensory feedback could improve the usability. They also indicated that the integrated feedback offered better usability than either feedback used in isolation. Most participants preferred the integrated feedback to either feedback （visual or auditory） or no feedback. The participants＇ comments demonstrated that nonrealistic or inappropriate feedback had negative effects on the usability, and easily made them feel frustrated. The possible reasons behind the outcomes are also analysed by using a unifying human computer interaction framework. The implications, concluded from the outcomes of this work, can serve as useful guidelines for improving VE system design and implementation.

A Mobile Agent-Based Prototype of HeterogeneousDistributed Virtual Environment Systems

Mobile agents provide a new method for the distributed computation. This paper presents the advantages of using mobile agents in a distributed virtual environment (DVE) system, and describes the architecture of heterogeneous computer's distributed virtual environment system (HCWES) designed to populate some mobile agents as well as stationary agents. Finally, the paper introduces how heterogeneous computer network communication is to be realized.

Using GIS Data to Build Informed Virtual Geographic Environments (IVGE)

In this paper, we propose a novel approach to automatically building Informed Virtual Geographic Environments (IVGE) using data provided by Geographic Information Systems (GIS). The obtained IVGE provides 2D and 3D geographic information for visualization and simulation purposes. Conventional VGE approaches are generally built upon a grid-based representation, raising the well-known problems of the lack of accuracy of the localized data and the difficulty to merge data with multiple semantics. On the contrary, our approach uses a topological model and provides an exact representation of GIS data, allowing an accurate geometrical exploitation. Moreover, our model can merge semantic information, even if spatially overlapping. In addition, the proposed IVGE contains spatial information which can be enhanced thanks to a geometric abstraction method. We illustrate this model with an application which automatically extracts the required data from standard GIS files and allows a user to navigate and retrieve information from the computed IVGE.

COLLISION AVOIDANCE DECISION-MAKING MODEL OF MULTI-AGENTS IN VIRTUAL DRIVING ENVIRONMENT WITH ANALYTIC HIERARCHY PROCESS

Collision avoidance decision-making models of multiple agents in virtual driving environment are studied. Based on the behavioral characteristics and hierarchical structure of the collision avoidance decision-making in real life driving, delphi approach and mathematical statistics method are introduced to construct pair-wise comparison judgment matrix of collision avoidance decision choices to each collision situation. Analytic hierarchy process （AHP） is adopted to establish the agents＇ collision avoidance decision-making model. To simulate drivers＇ characteristics, driver factors are added to categorize driving modes into impatient mode, normal mode, and the cautious mode. The results show that this model can simulate human＇s thinking process, and the agents in the virtual environment can deal with collision situations and make decisions to avoid collisions without intervention. The model can also reflect diversity and uncertainly of real life driving behaviors, and solves the multi-objective, multi-choice ranking priority problem in multi-vehicle collision scenarios. This collision avoidance model of multi-agents model is feasible and effective, and can provide richer and closer-to-life virtual scene for driving simulator, reflecting real-life traffic environment more truly, this model can also promote the practicality of driving simulator.

Study on the Agile Virtual Enterprise′s Organizing Form and Running Environment

In this paper, we begin with the swift changes in the knowledge economy time,analyze the implication of the agility, and consider the agile virtual enterprise as the mainorganizational form for the manufacturing enterprises to realize agility. We classify the agilevirtual enterprises into products alliance style and knowledge alliance style, and compares theirmain features and profit distribution models. As a result, we give four basic structures for thebuilding and running of the agile virtual enterprises.

An Intelligent Agent Based on Virtual Geographic Environment System

On the basis of previous work, this paper designs an intelligent agent based on virtual geographic environment (VGE) system that is characterized by huge data, rapid computation, multi\|user, multi\|thread and intelligence and issues challenges to traditional GIS models and algorithms. The new advances in software and hardware technology lay a reliable basis for system design, development and application.

Integration of Manufacturing Services into Virtual Environments over the Internet

Virtual reality (VR) is a rapidly developing technology that has a wide spectrum of industrial and commercial applications. Networked (distributed or shared) virtual environments (VE) are of growing interest to modern manufacturing industry; a dominating use of networked virtual manufacturing environments (VMEs) is on-line visualisation and collaborative control of 3D information. This has to be supported by real-time data transfer. To meet a broad range of common requirements for Internet-based VE communications, particularly for virtual manufacturing and collaborative design and control, this paper presents a networked virtual environment system that is designed to support networked virtual design and manufacturing. The system is implemented with manufacturing message specification (MMS) standards so as to integrate a range of manufacturing services into networked VEs over the Internet.

Architecture of HLA Based Distributed Virtual Geographic Environment

Integrating the theory of distributed virtual geographic environment (DVGE) and high level architecture(HLA), the architecture of DVGE based on HLA is designed. The data flow and the object models of the architecture are also discussed. The architecture basically meets the need of DVGE in real-time communication, distribution, collaboration, reusing and interoperation, expansion, and standard.

Machining process model based on virtual reality environment

Virtual manufacturing is fast becoming an affordable technology with wide-ranging applications in modern manufacturing. Its advantages over existing technology are primarily that users can visualize, feel involvement and interact with virtual representations of real world activities in real time. In this paper, a virtual cutting system is built which can simulate turning process, estimate tool wear and cutting force using artificial neural network etc. Using the simulated machining environment in virtual reality (VR), the user can practise and preview the operations for possible problems that might occur during implementation. This approach enables designers to evaluate and design feasible machining processes in a consistent manner as early as possible during the development process.

Forecasting display technique of human in network virtual environment

The simulation of human in the distributed virtual environment is different from the simulation of vehicle. Due to the human’s many joints, to implement the real time performance of the interaction between the virtual human and the environment, the quantity of information broadcasted in the network will be increased. So with the growing of the quantity of virtual human added to the network, the network burthen would augment rapidly. Therefore, for the simulation of virtual human this paper divides organically the motion parts of the body, which makes those body parts that often interact with the environment are described according to the joints while other parts are described according to the action information. Simultaneity, this paper adopts Dead Reckoning to reduce the quantity of information needed by maintaining the reality motion of virtual human. The experiment indicates that the forecasting display technique can efficiently reduce the network burthen and enhance the interaction of virtual human.

Generation of 3D Virtual Geographic Environment Based on Laser Scanning Technique

This paper demonstrates an experiment on the generation of 3D virtual geographic environment on the basis of experimental flight laser scanning data by a set of algorithms and methods that were developed to automatically interpret range images for extracting geo-spatial features and then to reconstruct geo-objects. The algorithms and methods for the interpretation and modeling of laser scanner data include triangulated-irregular-network (TIN)-based range image interpolation; mathematical-morphology (MM)-based range image filtering, feature extraction and range image segmentation, feature generalization and optimization, 3D objects reconstruction and modeling; computer-graphics (CG)-based visualization and animation of geographic virtual reality environment.