增强半虚拟现实座舱技术

Augmented semi-virtual reality cockpit technology

为提高半虚拟现实座舱中用户视觉真实感与人-座舱交互性能,提出了一种增强半虚拟现实座舱技术,将手图像实时融合到虚拟座舱环境中,使用户能实时看到自己的真实手。通过肤色检测算法实时分割摄像机采集图像,应用改进的自适应加权立体匹配算法与视图变形算法对图像进行视点校正,通过虚实匹配与虚实融合将手图像无缝融合到虚拟环境中,为用户提供增强虚拟环境中的可视化图像。测试结果表明:增强半虚拟现实座舱技术方案中触觉与视觉反馈真实,在头盔式虚拟环境中用户交互能点击到的最小方块边长为8mm。采用增强半虚拟现实技术方案完成座舱内典型交互动作的时间比传统数据手套方案与半虚拟交互方案平均分别降低约50%与18%,极大提高了人-座舱交互性能,可有效增强虚拟现实座舱系统实用性,并降低开发成本。

In order to enhance the visual sense of users and the interaction performance of human-cockpit system in the semi-virtual reality cockpit system,an augmented semi-virtual reality cockpit technolgy was presented,which incorporated a realistic view of hand into the virtual environments and made user see his own real hand in real time.The captured images by using camera were real-time segmented by skin color detecting algorithm.The segmented foreground images were rectified by using adaptive weighted stereo matching algorithm and view morphing algorithm.Hand images were seamlessly integrated into virtual environment by using virtual-real matching and virtual-real fusion methods,which can provide user with the visual images in augmented virtual environment.Experimental result shows that augmented semi-virtual reality cockpit technology make users feel true for the feedback of touch and vision.The smallest side length of the square clicked by users is 8 mm in head-mounted virtual environment.In augmented semi-virtual reality cockpit system,the average interaction time decreases by about 50% and 18% compared with traditional data glove method and semi-virtual reality method.The technolgy effectively improves the human-cockpit interaction performance of the system,enhances its practicability,and its developed cost decreases.1 tab,11 figs,22 refs.