Driving a vehicle is one of the most common daily yet hazardous tasks. One of the great interests in recent research is to characterize a driver’s behaviors through the use of a driving simulation. Virtual reality te...Driving a vehicle is one of the most common daily yet hazardous tasks. One of the great interests in recent research is to characterize a driver’s behaviors through the use of a driving simulation. Virtual reality technology is now a promising alternative to the conventional driving simulations since it provides a more simple, secure and user-friendly environment for data collection. The driving simulator was used to assist novice drivers in learning how to drive in a very calm environment since the driving is not taking place on an actual road. This paper provides new insights regarding a driver’s behavior, techniques and adaptability within a driving simulation using virtual reality technology. The theoretical framework of this driving simulation has been designed using the Unity3D game engine (5.4.0f3 version) and programmed by the C# programming language. To make the driving simulation environment more realistic, the HTC Vive Virtual reality headset, powered by Steamvr, was used. 10 volunteers ranging from ages 19 - 37 participated in the virtual reality driving experiment. Matlab R2016b was used to analyze the data obtained from experiment. This research results are crucial for training drivers and obtaining insight on a driver’s behavior and characteristics. We have gathered diverse results for 10 drivers with different characteristics to be discussed in this study. Driving simulations are not easy to use for some users due to motion sickness, difficulties in adopting to a virtual environment. Furthermore, results of this study clearly show the performance of drivers is closely associated with individual’s behavior and adaptability to the driving simulator. Based on our findings, it can be said that with a VR-HMD (Virtual Reality-Head Mounted Display) Driving Simulator enables us to evaluate a driver’s “performance error”, “recognition errors” and “decision error”. All of which will allow researchers and further studies to potentially establish a method to increase driver safety or alleviate “driving errors”.展开更多
The head mounted display （HMD） is widely used in virtual reality technology. In common HMD, however, the binocular disparity is set to an equal fixed value in the entire range of view. Such HMD systems have several ...The head mounted display （HMD） is widely used in virtual reality technology. In common HMD, however, the binocular disparity is set to an equal fixed value in the entire range of view. Such HMD systems have several shortcomings when used for wide views. In this study, in order to realize a natural stereo sensation of HMD with wide view, we measure the characteristics of binocular stereo perception and binocular light perception. Results show that both the stereoacuity and light sensitivity decrease as the retina＇s eccentricity increases from fovea to periphery. However, the decrease of the stereoacuity is more rapid than that of the light sensitivity. These results suggest that the binocular disparity at the peripheral field should be small, otherwise double images would be observed instead of a stereo view. Based on the results we develop a relative binocular stereoacuity model which can be applied for the design of HMD systems with wide view.展开更多
Background Virtual Reality(VR)technologies have advanced fast and have been applied to a wide spectrum of sectors in the past few years.VR can provide an immersive experience to users by generating virtual images and ...Background Virtual Reality(VR)technologies have advanced fast and have been applied to a wide spectrum of sectors in the past few years.VR can provide an immersive experience to users by generating virtual images and displaying the virtual images to the user with a head-mounted display(HMD)which is a primary component of VR.Normally,an HMD contains a list of hardware components,e.g.,housing pack,micro LCD display,microcontroller,optical lens,etc.Settings of VR HMD to accommodate the user's inter-pupil distance(IPD)and the user's eye focus power are important for the user's experience with VR.Methods Although various methods have been developed towards IPD and focus adjustments for VR HMD,the increased cost and complexity impede the possibility for users who wish to assemble their own VR HMD for various purposes,e.g.,DIY teaching,etc.In our paper,we present a novel design towards building a customizable and adjustable HMD for VR in a cost-effective manner.Modular design methodology is adopted,and the VR HMD can be easily printed with 3D printers.The design also features adjustable IPD and variable distance between the optical lens and the display.It can help to mitigate the vergence and accommodation conflict issue.Results A prototype of the customizable and adjustable VR HMD has been successfully built up with off-the-shelf components.A VR software program running on Raspberry Pi board has been developed and can be utilized to show the VR effects.A user study with 20 participants is conducted with positive feedback on our novel design.Conclusions Modular design can be successfully applied for building up VR HMD with 3D printing.It helps to promote the wide application of VR at affordable costs while featuring flexibility and adjustability.展开更多
In order to develop the core chip supporting binocular stereo displays for head mounted display （HMD） and glasses-TV, a very large scale integrated （VISI） design scheme is proposed by using a pipeline architecture...In order to develop the core chip supporting binocular stereo displays for head mounted display （HMD） and glasses-TV, a very large scale integrated （VISI） design scheme is proposed by using a pipeline architecture for 3D display processing chip （HMD100）. Some key techniques including stereo display processing and high precision video scaling based bicubic interpolation, and their hardware implementations which improve the image quality are presented. The proposed HMD100 chip is verified by the field-programmable gate array （FPGA）. As one of innovative and high integration SoC chips, HMD100 is designed by a digital and analog mixed circuit. It can support binocular stereo display, has better scaling effect and integration. Hence it is applicable in virtual reality （VR）, 3D games and other microdisplay domains.展开更多
In this paper, a mobile assistance-system is described which supports users in performing manual working tasks in the context of assembling complex products. The assistance system contains a head-worn display for the ...In this paper, a mobile assistance-system is described which supports users in performing manual working tasks in the context of assembling complex products. The assistance system contains a head-worn display for the visualization of information relevant for the workflow as well as a video camera to acquire the scene. This paper is focused on the interaction of the user with this system and describes work in progress and initial results from an industrial application scenario. We present image-based methods for robust recognition of static and dynamic hand gestures in realtime. These methods are used for an intuitive interaction with the assistance-system. The segmentation of the hand based on color information builds the basis of feature extraction for static and dynamic gestures. For the static gestures, the activation of particular sensitive regions in the camera image by the user’s hand is used for interaction. An HMM classifier is used to extract dynamic gestures depending on motion parameters determined based on the optical flow in the camera image.展开更多
Underground urban expressways are a possibility for solving many existing transportation-related problems, such as traffic congestion in high density areas and the division of neighborhoods due to elevated roadways. H...Underground urban expressways are a possibility for solving many existing transportation-related problems, such as traffic congestion in high density areas and the division of neighborhoods due to elevated roadways. However, they may also pose high risks regarding traffic safety. Therefore, it is important for a pre-analysis of traffic safety to be made. This paper describes recent efforts to develop a driving simulation system, MOVIC-T4, for traffic safety analysis of underground urban expressways. In order to develop a small portable simulator, a small-sized motion-base with two-degrees-of-freedom is used to duplicate acceleration cueing together with a head-mounted-display （HMD） for the visual system. An overview of this system is given and the reliability of driving data obtained from the experiments using MOVIC-T4 is discussed through a validation study using field driving data. The results of validation indicate that the perceived speed distance headway, and physiological data in the simulator show the almost same trend as that in the real world, but larger decelerations tend to be produced in the simulator.展开更多
Design and tolerance of a new head up display’s projector system is reported. It is based on laser-micro display modules. We designed optical diffraction limited modules and some of our novelties were compactness, us...Design and tolerance of a new head up display’s projector system is reported. It is based on laser-micro display modules. We designed optical diffraction limited modules and some of our novelties were compactness, using common material and spherical lenses in optical design, easy and economical manufacturing process, uniform intensity and minimum aberrations of final image, economical and repairable designed system. Projector magnification is 10.0X and diagonal of image plane is 76.2 mm. ZEMAX software is employed for optical design and tolerance.展开更多
Augmented reality is widely used in aeronautics and is a developing concept within surgery. In this pilot study, we developed an application for use on Google Glass optical head-mounted display to train urology reside...Augmented reality is widely used in aeronautics and is a developing concept within surgery. In this pilot study, we developed an application for use on Google Glass optical head-mounted display to train urology residents in how to place an inflatable penile prosthesis. We use the phrase Augmented Reality Assisted Surgery to describe this novel application of augmented reality in the setting of surgery. The application demonstrates the steps of the surgical procedure of inflatable penile prosthesis placement. It also contains software that allows for detection of interest points using a camera feed from the optical head-mounted display to enable faculty to interact with residents during placement of the penile prosthesis. Urology trainees and faculty who volunteered to take part in the study were given time to experience the technology in the operative or perioperative setting and asked to complete a feedback survey. From 30 total participants using a lO-point scale, educational usefulness was rated 8.6, ease of navigation was rated 7.6, likelihood to use was rated 7.4, and distraction in operating room was rated 4.9. When stratified between trainees and faculty, trainees found the technology more educationally useful, and less distracting. Overall, 81% of the participants want this technology in their residency program, and 93% see this technology in the operating room in the future. Further development of this technology is warranted before full release, and further studies are necessary to better characterize the effectiveness of Augmented Reality Assisted Surgery in urologic surgical training.展开更多
文摘Driving a vehicle is one of the most common daily yet hazardous tasks. One of the great interests in recent research is to characterize a driver’s behaviors through the use of a driving simulation. Virtual reality technology is now a promising alternative to the conventional driving simulations since it provides a more simple, secure and user-friendly environment for data collection. The driving simulator was used to assist novice drivers in learning how to drive in a very calm environment since the driving is not taking place on an actual road. This paper provides new insights regarding a driver’s behavior, techniques and adaptability within a driving simulation using virtual reality technology. The theoretical framework of this driving simulation has been designed using the Unity3D game engine (5.4.0f3 version) and programmed by the C# programming language. To make the driving simulation environment more realistic, the HTC Vive Virtual reality headset, powered by Steamvr, was used. 10 volunteers ranging from ages 19 - 37 participated in the virtual reality driving experiment. Matlab R2016b was used to analyze the data obtained from experiment. This research results are crucial for training drivers and obtaining insight on a driver’s behavior and characteristics. We have gathered diverse results for 10 drivers with different characteristics to be discussed in this study. Driving simulations are not easy to use for some users due to motion sickness, difficulties in adopting to a virtual environment. Furthermore, results of this study clearly show the performance of drivers is closely associated with individual’s behavior and adaptability to the driving simulator. Based on our findings, it can be said that with a VR-HMD (Virtual Reality-Head Mounted Display) Driving Simulator enables us to evaluate a driver’s “performance error”, “recognition errors” and “decision error”. All of which will allow researchers and further studies to potentially establish a method to increase driver safety or alleviate “driving errors”.
文摘The head mounted display （HMD） is widely used in virtual reality technology. In common HMD, however, the binocular disparity is set to an equal fixed value in the entire range of view. Such HMD systems have several shortcomings when used for wide views. In this study, in order to realize a natural stereo sensation of HMD with wide view, we measure the characteristics of binocular stereo perception and binocular light perception. Results show that both the stereoacuity and light sensitivity decrease as the retina＇s eccentricity increases from fovea to periphery. However, the decrease of the stereoacuity is more rapid than that of the light sensitivity. These results suggest that the binocular disparity at the peripheral field should be small, otherwise double images would be observed instead of a stereo view. Based on the results we develop a relative binocular stereoacuity model which can be applied for the design of HMD systems with wide view.
基金Supported by the Computing Science Program jointly offered by Singapore Institute of Technology and University of Glasgow.
文摘Background Virtual Reality(VR)technologies have advanced fast and have been applied to a wide spectrum of sectors in the past few years.VR can provide an immersive experience to users by generating virtual images and displaying the virtual images to the user with a head-mounted display(HMD)which is a primary component of VR.Normally,an HMD contains a list of hardware components,e.g.,housing pack,micro LCD display,microcontroller,optical lens,etc.Settings of VR HMD to accommodate the user's inter-pupil distance(IPD)and the user's eye focus power are important for the user's experience with VR.Methods Although various methods have been developed towards IPD and focus adjustments for VR HMD,the increased cost and complexity impede the possibility for users who wish to assemble their own VR HMD for various purposes,e.g.,DIY teaching,etc.In our paper,we present a novel design towards building a customizable and adjustable HMD for VR in a cost-effective manner.Modular design methodology is adopted,and the VR HMD can be easily printed with 3D printers.The design also features adjustable IPD and variable distance between the optical lens and the display.It can help to mitigate the vergence and accommodation conflict issue.Results A prototype of the customizable and adjustable VR HMD has been successfully built up with off-the-shelf components.A VR software program running on Raspberry Pi board has been developed and can be utilized to show the VR effects.A user study with 20 participants is conducted with positive feedback on our novel design.Conclusions Modular design can be successfully applied for building up VR HMD with 3D printing.It helps to promote the wide application of VR at affordable costs while featuring flexibility and adjustability.
文摘In order to develop the core chip supporting binocular stereo displays for head mounted display （HMD） and glasses-TV, a very large scale integrated （VISI） design scheme is proposed by using a pipeline architecture for 3D display processing chip （HMD100）. Some key techniques including stereo display processing and high precision video scaling based bicubic interpolation, and their hardware implementations which improve the image quality are presented. The proposed HMD100 chip is verified by the field-programmable gate array （FPGA）. As one of innovative and high integration SoC chips, HMD100 is designed by a digital and analog mixed circuit. It can support binocular stereo display, has better scaling effect and integration. Hence it is applicable in virtual reality （VR）, 3D games and other microdisplay domains.
文摘In this paper, a mobile assistance-system is described which supports users in performing manual working tasks in the context of assembling complex products. The assistance system contains a head-worn display for the visualization of information relevant for the workflow as well as a video camera to acquire the scene. This paper is focused on the interaction of the user with this system and describes work in progress and initial results from an industrial application scenario. We present image-based methods for robust recognition of static and dynamic hand gestures in realtime. These methods are used for an intuitive interaction with the assistance-system. The segmentation of the hand based on color information builds the basis of feature extraction for static and dynamic gestures. For the static gestures, the activation of particular sensitive regions in the camera image by the user’s hand is used for interaction. An HMM classifier is used to extract dynamic gestures depending on motion parameters determined based on the optical flow in the camera image.
基金Supported by Ministry of Land, Infrastructure and Transport, Japan Society of the Promotion of Science and Mitsui Sumitomo Insurance Welfare Foundation
文摘Underground urban expressways are a possibility for solving many existing transportation-related problems, such as traffic congestion in high density areas and the division of neighborhoods due to elevated roadways. However, they may also pose high risks regarding traffic safety. Therefore, it is important for a pre-analysis of traffic safety to be made. This paper describes recent efforts to develop a driving simulation system, MOVIC-T4, for traffic safety analysis of underground urban expressways. In order to develop a small portable simulator, a small-sized motion-base with two-degrees-of-freedom is used to duplicate acceleration cueing together with a head-mounted-display （HMD） for the visual system. An overview of this system is given and the reliability of driving data obtained from the experiments using MOVIC-T4 is discussed through a validation study using field driving data. The results of validation indicate that the perceived speed distance headway, and physiological data in the simulator show the almost same trend as that in the real world, but larger decelerations tend to be produced in the simulator.
文摘Design and tolerance of a new head up display’s projector system is reported. It is based on laser-micro display modules. We designed optical diffraction limited modules and some of our novelties were compactness, using common material and spherical lenses in optical design, easy and economical manufacturing process, uniform intensity and minimum aberrations of final image, economical and repairable designed system. Projector magnification is 10.0X and diagonal of image plane is 76.2 mm. ZEMAX software is employed for optical design and tolerance.
文摘Augmented reality is widely used in aeronautics and is a developing concept within surgery. In this pilot study, we developed an application for use on Google Glass optical head-mounted display to train urology residents in how to place an inflatable penile prosthesis. We use the phrase Augmented Reality Assisted Surgery to describe this novel application of augmented reality in the setting of surgery. The application demonstrates the steps of the surgical procedure of inflatable penile prosthesis placement. It also contains software that allows for detection of interest points using a camera feed from the optical head-mounted display to enable faculty to interact with residents during placement of the penile prosthesis. Urology trainees and faculty who volunteered to take part in the study were given time to experience the technology in the operative or perioperative setting and asked to complete a feedback survey. From 30 total participants using a lO-point scale, educational usefulness was rated 8.6, ease of navigation was rated 7.6, likelihood to use was rated 7.4, and distraction in operating room was rated 4.9. When stratified between trainees and faculty, trainees found the technology more educationally useful, and less distracting. Overall, 81% of the participants want this technology in their residency program, and 93% see this technology in the operating room in the future. Further development of this technology is warranted before full release, and further studies are necessary to better characterize the effectiveness of Augmented Reality Assisted Surgery in urologic surgical training.
