摘要
近些年,基于视觉的手部跟踪与手势识别一直是人机交互和计算机视觉等领域的研究热点。传统方法主要是使用单目或多目RGB摄像头等设备获得手部位置、方向等信息,但RGB摄像头易受到复杂背景、光照变化、纹理的限制,导致其准确性、实时性和鲁棒性都较差。随着可获得场景深度信息的家用RGB-Depth(RGB-D)摄像头的发展和上市,可以利用深度信息较好地克服上述环境问题。首先定义了一个基于RGB-D摄像头的3D交互空间,根据深度信息将手部区域从复杂背景、多变的光照条件下进行分割;然后提出了一种基于深度摄像头的手指识别和跟踪方法,该方法基于手部轮廓对人手及手指进行识别和跟踪;最后通过对手指位置和轨迹的跟踪进行手势识别,从而实现人机交互。对提出的方法进行的实验验证了它的准确性、实时性和鲁棒性。
In recent decades, visual interpretation of finger and hand gestures has been an attractive direction in both computer vision and human-computer interaction areas. Traditional methods use a monocular RGB camera or multiple RGB cameras to get hand information. But it is limited by clustered backgrounds,lighting conditions, textures and other environment factors, which makes the accuracy, robustness and efficiency cannot satisfy real-time interactions. With the coming of consumer-level RGB-D camera, above limitations can be overcame with depth data got from a RGB-D camera. We first defineed a 3D interaction space with the RGB-D camera and segmented the hand region from backgrounds with the help of depth information. Then we proposed a real-time finger recognition and tracking approach using a depth camera which mainly use the contour of hands. At last, the human-computer interaction was achieved with the position and trajectory of fingers from the above method. Based on the proposed method, we designed several experiments. The results validate the accuracy,effectiveness and robustness of our approach.
出处
《计算机科学》
CSCD
北大核心
2014年第10期50-52,61,共4页
Computer Science
基金
国家自然科学基金创新研究群体项目(61121001)
高等学校博士学科点专项科研基金(20120005130002)
国家杰出青年科学基金项目:网络环境中多媒体计算(60925010)资助
关键词
手指跟踪
手势识别
计算机视觉
人机交互
RGB-D摄像头
Finger tracking,Gesture recognition,Human-computer interaction,Computer vision,RGB-D camera