In the area of computer vision, deep learning has produced a variety of state-of-the-art models that rely on massive labeled data. However, collecting and annotating images from the real world is too demanding in term...In the area of computer vision, deep learning has produced a variety of state-of-the-art models that rely on massive labeled data. However, collecting and annotating images from the real world is too demanding in terms of labor and money investments, and is usually inflexible to build datasets with specific characteristics, such as small area of objects and high occlusion level. Under the framework of Parallel Vision, this paper presents a purposeful way to design artificial scenes and automatically generate virtual images with precise annotations.A virtual dataset named Parallel Eye is built, which can be used for several computer vision tasks. Then, by training the DPM(Deformable parts model) and Faster R-CNN detectors, we prove that the performance of models can be significantly improved by combining Parallel Eye with publicly available real-world datasets during the training phase. In addition, we investigate the potential of testing the trained models from a specific aspect using intentionally designed virtual datasets, in order to discover the flaws of trained models. From the experimental results, we conclude that our virtual dataset is viable to train and test the object detectors.展开更多
Virtual assembly is a Virtual Reality (VR) based engineering application which allows engineers to evaluate, analyze, and plan the assembly of mechanical systems. To model the virtual assembly process, new methodology...Virtual assembly is a Virtual Reality (VR) based engineering application which allows engineers to evaluate, analyze, and plan the assembly of mechanical systems. To model the virtual assembly process, new methodology must be applied. Based on the idea that the virtual assembly system is an event driven system, the interactive behavior and information model is proposed to describe the dynamic process of virtual assembly. Definition of the object-oriented model of virtual assembly is put forward.展开更多
This paper discusses smart body sensor objects （BSOs）, including their networking and internetworking. Smartness can be incorpo-rated into BSOs by embedding virtualization, predictive analytics, and proactive comput...This paper discusses smart body sensor objects （BSOs）, including their networking and internetworking. Smartness can be incorpo-rated into BSOs by embedding virtualization, predictive analytics, and proactive computing and communications capabilities. A few use cases including the relevant privacy and protocol requirements are also presented. General usage and deployment eti-quette along with the relevant regulatory implications are then discussed.展开更多
Background Social distancing is an effective way to reduce the spread of the SARS-CoV-2 virus.Many students and researchers have already attempted to use computer vision technology to automatically detect human beings...Background Social distancing is an effective way to reduce the spread of the SARS-CoV-2 virus.Many students and researchers have already attempted to use computer vision technology to automatically detect human beings in the field of view of a camera and help enforce social distancing.However,because of the present lockdown measures in several countries,the validation of computer vision systems using large-scale datasets is a challenge.Methods In this paper,a new method is proposed for generating customized datasets and validating deep-learning-based computer vision models using virtual reality(VR)technology.Using VR,we modeled a digital twin(DT)of an existing office space and used it to create a dataset of individuals in different postures,dresses,and locations.To test the proposed solution,we implemented a convolutional neural network(CNN)model for detecting people in a limited-sized dataset of real humans and a simulated dataset of humanoid figures.Results We detected the number of persons in both the real and synthetic datasets with more than 90%accuracy,and the actual and measured distances were significantly correlated(r=0.99).Finally,we used intermittent-layer-and heatmap-based data visualization techniques to explain the failure modes of a CNN.Conclusions A new application of DTs is proposed to enhance workplace safety by measuring the social distance between individuals.The use of our proposed pipeline along with a DT of the shared space for visualizing both environmental and human behavior aspects preserves the privacy of individuals and improves the latency of such monitoring systems because only the extracted information is streamed.展开更多
In order to study the constructing technology of virtual production line, the structure model of virtual production line was presented, and the object oriented technique was used to establish its basic classes and re...In order to study the constructing technology of virtual production line, the structure model of virtual production line was presented, and the object oriented technique was used to establish its basic classes and relevant models, including solid model, behavior model and object oriented Petri net based control model, and based on this, the constructing of virtual production line was realized. The application proved that the virtual production line had many good characteristics, such as visualization, interaction, multi layer and reusability, and it's an efficient tool of analyzing and modeling for layout planning and rapidly reconfiguring of production line.展开更多
There are several motivations, such as mobility, cost, and secu- rity, that are behind the trend of traditional desktop users transi- tioning to thin-client-based virtual desktop clouds （VDCs）. Such a trend has led ...There are several motivations, such as mobility, cost, and secu- rity, that are behind the trend of traditional desktop users transi- tioning to thin-client-based virtual desktop clouds （VDCs）. Such a trend has led to the rising importance of human-centric performance modeling and assessment within user communities that are increasingly making use of desktop virtualization. In this paper, we present a novel reference architecture and its eas- ily deployable implementation for modeling and assessing objec- tive user quality of experience （QoE） in VDCs. This architec- ture eliminates the need for expensive, time-consuming subjec- tive testing and incorporates finite-state machine representa- tions for user workload generation. It also incorporates slow-mo- tion benchmarking with deep-packet inspection of application task performance affected by QoS variations. In this way, a ＂composite-quality＂ metric model of user QoE can be derived. We show how this metric can be customized to a particular user group profile with different application sets and can be used to a） identify dominant performance indicators and troubleshoot bottlenecks and b） obtain both absolute and relative objective user QoE measurements needed for pertinent selection of thin-client encoding configurations in VDCs. We validate our composite-quality modeling and assessment methodology by us- ing subjective and objective user QoE measurements in a re- al-world VDC called VDPilot, which uses RDP and PCoIP thin-client protocols. In our case study, actual users are pres- ent in virtual classrooms within a regional federated university system.展开更多
Through the analysis and comparison of shortcomings and advantages of existing technologies on object modeling in 3D applications,we propose a new modeling method for virtual scene based on multi-view image sequence t...Through the analysis and comparison of shortcomings and advantages of existing technologies on object modeling in 3D applications,we propose a new modeling method for virtual scene based on multi-view image sequence to model irregular objects efficiently in 3D application.In 3D scene,this method can get better visual effect by tracking the viewer's real-time perspective position and projecting the photos from different perspectives dynamically.The philosophy of design,the steps of development and some other relevant topics are discussed in details,and the validity of the algorithm is analyzed.The results demonstrate that this method represents more superiority on simulating irregular objects by applying it to the modeling of virtual museum.展开更多
Studies the design of distributed virtual environments （DVEs） for tele-multi-robotics. The proposed design, incorporating two models （ distributlon-supported model and VE-supported model）, attempts to represent co...Studies the design of distributed virtual environments （DVEs） for tele-multi-robotics. The proposed design, incorporating two models （ distributlon-supported model and VE-supported model）, attempts to represent common functionality, communication issues, and requirements found in multi-operator DVEs. The distribution-supported model concentrates on the introduction of computer-supported collaborative work （CSCW） to realize the coordination of multi-operators, while the VE-supported model concentrates on the utilization of an object-oriented approach to strengthen the expandability and robustness of the system. Finally, the configuration anti running environments of the system are given.展开更多
The efficient and reliable human centered design of products and processes is a major goal in manufacturing industries for numerous human factors must be taken into account during the entire life cycle of products. A ...The efficient and reliable human centered design of products and processes is a major goal in manufacturing industries for numerous human factors must be taken into account during the entire life cycle of products. A multi-agents intelligent design system is presented for manufacturing process simulation and products＇ ergonomic analysis. In virtual design environment, the virtual human with high-level intelligence performs tasks＇ operation autonomously and shows optimum posture configuration with ergonomic assessment results in real time. The functions are realized by intelligent agents architecture based on a modem approach derived from fuzzy multi-objects decision-making theory. A case study is presented to demonstrate the feasibility of the suggested methodology.展开更多
It is now possible to organize globally while worki ng locally: Information technologies like e-mail, the Internet, and video confere ncing to the desktop permit tight coordination of geographically dispersed worke rs...It is now possible to organize globally while worki ng locally: Information technologies like e-mail, the Internet, and video confere ncing to the desktop permit tight coordination of geographically dispersed worke rs across time zones and cultures. Companies are not limited to physical locatio ns for providing products and services. Networked information systems are allowi ng companies to coordinate their geographically distributed capabilities as virt ual organizations. In order for organizations to succeed, they must be able to r espond with agility in a geographically dispersed environment. The core for a vi rtual organization to increase the utilization rate of resources to the maxi mum and to make full use of the transient market opportunities lies in how to br ing the potential of information technology into play. Based on the philosophy o f agile manufacturing, this paper analyses the basic concepts and connotation of Virtual Organization Information systems(VOIS). VOIS is an information system composed of some independent information subsystems that are autonomous, collab orative and belong to umpty organizations respectively. VOIS support the operati on of virtual organization, and automate the information flow across organizatio nal boundaries. Such systems have capabilities as rapid construction, quick oper ation, and agile reengineering and swift adaptability. Differences between VOIS and traditional enterprise information systems are analyzed. On the basis of ana lyzing the structure of VOIS, an abstract hierarchical structure of VOIS is prop osed using object-oriented method. Reengineering ideology and methods of VOIS a re also explored in light of the three layers structure.展开更多
In recent years, power generation using renewable energy sources has been increasing as a solution to the global warning problem. Wind power generation can generate electricity day and night, and it is relatively more...In recent years, power generation using renewable energy sources has been increasing as a solution to the global warning problem. Wind power generation can generate electricity day and night, and it is relatively more efficient among the renewable energy sources. The penetration level of variable-speed wind turbines continues to increase. The interconnected wind turbines, however, have no inertia and no synchronous power. Such devices can have a serious impact on the transient stability of the power grid system. One solution to stabilize such grid with renewable energy sources is to provide emulated inertia and synchronizing power. We have proposed an optimal design method of current control for virtual synchronous generators. This paper proposes an optimal control method that can follow the virtual generator model under constrains. As a result, it is shown that the proposed system can suppress the peak of the output of semiconductor device under instantaneous output voltage drop.展开更多
基金supported by the National Natural Science Foundation of China(61533019,71232006)
文摘In the area of computer vision, deep learning has produced a variety of state-of-the-art models that rely on massive labeled data. However, collecting and annotating images from the real world is too demanding in terms of labor and money investments, and is usually inflexible to build datasets with specific characteristics, such as small area of objects and high occlusion level. Under the framework of Parallel Vision, this paper presents a purposeful way to design artificial scenes and automatically generate virtual images with precise annotations.A virtual dataset named Parallel Eye is built, which can be used for several computer vision tasks. Then, by training the DPM(Deformable parts model) and Faster R-CNN detectors, we prove that the performance of models can be significantly improved by combining Parallel Eye with publicly available real-world datasets during the training phase. In addition, we investigate the potential of testing the trained models from a specific aspect using intentionally designed virtual datasets, in order to discover the flaws of trained models. From the experimental results, we conclude that our virtual dataset is viable to train and test the object detectors.
文摘Virtual assembly is a Virtual Reality (VR) based engineering application which allows engineers to evaluate, analyze, and plan the assembly of mechanical systems. To model the virtual assembly process, new methodology must be applied. Based on the idea that the virtual assembly system is an event driven system, the interactive behavior and information model is proposed to describe the dynamic process of virtual assembly. Definition of the object-oriented model of virtual assembly is put forward.
文摘This paper discusses smart body sensor objects （BSOs）, including their networking and internetworking. Smartness can be incorpo-rated into BSOs by embedding virtualization, predictive analytics, and proactive computing and communications capabilities. A few use cases including the relevant privacy and protocol requirements are also presented. General usage and deployment eti-quette along with the relevant regulatory implications are then discussed.
文摘Background Social distancing is an effective way to reduce the spread of the SARS-CoV-2 virus.Many students and researchers have already attempted to use computer vision technology to automatically detect human beings in the field of view of a camera and help enforce social distancing.However,because of the present lockdown measures in several countries,the validation of computer vision systems using large-scale datasets is a challenge.Methods In this paper,a new method is proposed for generating customized datasets and validating deep-learning-based computer vision models using virtual reality(VR)technology.Using VR,we modeled a digital twin(DT)of an existing office space and used it to create a dataset of individuals in different postures,dresses,and locations.To test the proposed solution,we implemented a convolutional neural network(CNN)model for detecting people in a limited-sized dataset of real humans and a simulated dataset of humanoid figures.Results We detected the number of persons in both the real and synthetic datasets with more than 90%accuracy,and the actual and measured distances were significantly correlated(r=0.99).Finally,we used intermittent-layer-and heatmap-based data visualization techniques to explain the failure modes of a CNN.Conclusions A new application of DTs is proposed to enhance workplace safety by measuring the social distance between individuals.The use of our proposed pipeline along with a DT of the shared space for visualizing both environmental and human behavior aspects preserves the privacy of individuals and improves the latency of such monitoring systems because only the extracted information is streamed.
文摘In order to study the constructing technology of virtual production line, the structure model of virtual production line was presented, and the object oriented technique was used to establish its basic classes and relevant models, including solid model, behavior model and object oriented Petri net based control model, and based on this, the constructing of virtual production line was realized. The application proved that the virtual production line had many good characteristics, such as visualization, interaction, multi layer and reusability, and it's an efficient tool of analyzing and modeling for layout planning and rapidly reconfiguring of production line.
基金supported by VMware and the National Science Foundation under award numbers CNS-1050225 and CNS-1205658
文摘There are several motivations, such as mobility, cost, and secu- rity, that are behind the trend of traditional desktop users transi- tioning to thin-client-based virtual desktop clouds （VDCs）. Such a trend has led to the rising importance of human-centric performance modeling and assessment within user communities that are increasingly making use of desktop virtualization. In this paper, we present a novel reference architecture and its eas- ily deployable implementation for modeling and assessing objec- tive user quality of experience （QoE） in VDCs. This architec- ture eliminates the need for expensive, time-consuming subjec- tive testing and incorporates finite-state machine representa- tions for user workload generation. It also incorporates slow-mo- tion benchmarking with deep-packet inspection of application task performance affected by QoS variations. In this way, a ＂composite-quality＂ metric model of user QoE can be derived. We show how this metric can be customized to a particular user group profile with different application sets and can be used to a） identify dominant performance indicators and troubleshoot bottlenecks and b） obtain both absolute and relative objective user QoE measurements needed for pertinent selection of thin-client encoding configurations in VDCs. We validate our composite-quality modeling and assessment methodology by us- ing subjective and objective user QoE measurements in a re- al-world VDC called VDPilot, which uses RDP and PCoIP thin-client protocols. In our case study, actual users are pres- ent in virtual classrooms within a regional federated university system.
文摘Through the analysis and comparison of shortcomings and advantages of existing technologies on object modeling in 3D applications,we propose a new modeling method for virtual scene based on multi-view image sequence to model irregular objects efficiently in 3D application.In 3D scene,this method can get better visual effect by tracking the viewer's real-time perspective position and projecting the photos from different perspectives dynamically.The philosophy of design,the steps of development and some other relevant topics are discussed in details,and the validity of the algorithm is analyzed.The results demonstrate that this method represents more superiority on simulating irregular objects by applying it to the modeling of virtual museum.
文摘Studies the design of distributed virtual environments （DVEs） for tele-multi-robotics. The proposed design, incorporating two models （ distributlon-supported model and VE-supported model）, attempts to represent common functionality, communication issues, and requirements found in multi-operator DVEs. The distribution-supported model concentrates on the introduction of computer-supported collaborative work （CSCW） to realize the coordination of multi-operators, while the VE-supported model concentrates on the utilization of an object-oriented approach to strengthen the expandability and robustness of the system. Finally, the configuration anti running environments of the system are given.
文摘The efficient and reliable human centered design of products and processes is a major goal in manufacturing industries for numerous human factors must be taken into account during the entire life cycle of products. A multi-agents intelligent design system is presented for manufacturing process simulation and products＇ ergonomic analysis. In virtual design environment, the virtual human with high-level intelligence performs tasks＇ operation autonomously and shows optimum posture configuration with ergonomic assessment results in real time. The functions are realized by intelligent agents architecture based on a modem approach derived from fuzzy multi-objects decision-making theory. A case study is presented to demonstrate the feasibility of the suggested methodology.
文摘It is now possible to organize globally while worki ng locally: Information technologies like e-mail, the Internet, and video confere ncing to the desktop permit tight coordination of geographically dispersed worke rs across time zones and cultures. Companies are not limited to physical locatio ns for providing products and services. Networked information systems are allowi ng companies to coordinate their geographically distributed capabilities as virt ual organizations. In order for organizations to succeed, they must be able to r espond with agility in a geographically dispersed environment. The core for a vi rtual organization to increase the utilization rate of resources to the maxi mum and to make full use of the transient market opportunities lies in how to br ing the potential of information technology into play. Based on the philosophy o f agile manufacturing, this paper analyses the basic concepts and connotation of Virtual Organization Information systems(VOIS). VOIS is an information system composed of some independent information subsystems that are autonomous, collab orative and belong to umpty organizations respectively. VOIS support the operati on of virtual organization, and automate the information flow across organizatio nal boundaries. Such systems have capabilities as rapid construction, quick oper ation, and agile reengineering and swift adaptability. Differences between VOIS and traditional enterprise information systems are analyzed. On the basis of ana lyzing the structure of VOIS, an abstract hierarchical structure of VOIS is prop osed using object-oriented method. Reengineering ideology and methods of VOIS a re also explored in light of the three layers structure.
文摘In recent years, power generation using renewable energy sources has been increasing as a solution to the global warning problem. Wind power generation can generate electricity day and night, and it is relatively more efficient among the renewable energy sources. The penetration level of variable-speed wind turbines continues to increase. The interconnected wind turbines, however, have no inertia and no synchronous power. Such devices can have a serious impact on the transient stability of the power grid system. One solution to stabilize such grid with renewable energy sources is to provide emulated inertia and synchronizing power. We have proposed an optimal design method of current control for virtual synchronous generators. This paper proposes an optimal control method that can follow the virtual generator model under constrains. As a result, it is shown that the proposed system can suppress the peak of the output of semiconductor device under instantaneous output voltage drop.
