基于指尖触控的互动投影系统

Fingertip Touch-based Interactive Projection System

随着人机交互技术的不断发展,互动投影技术的应用逐渐广泛。该技术通过摄像机等传感器技术感知周围场景动态并结合投影的显示功能实现交互的方式,如增强现实、结构光编码、三维重建等。基于触控的互动投影技术在未来的嵌入式人机交互系统中具有广阔的前景。文章基于单目摄像机与投影仪系统实现能够在任意平面徒手触摸的交互。系统的功能主要通过前景区域分割、指尖点的定位以及触摸检测三个步骤来实现。与目前相关领域的研究文献进行的对比实验证明,所提算法在稳定性、准确性以及实时性等方面具有一定优势。

Recently, with the development of human-computer interaction, interactive projection technologies have been used more and more extensively, which is able to perceive the ambient behavior by using additional sensors and corresponding projected contents for interacting, such as augmented reality, structured light coding, and 3D reconstruction. Touch-sensitive interactive projection has achieved broad prospects on embedded human-machine system in the future. This paper aims at realizing bare-hand touch interaction on arbitrary surfaces by means of a camera and a projector. The performance of this system can be achieved through three steps, foreground extraction, fingertip detection and touch detection. Extensive experiments are presented to show the accurate and robust performance of our approach.