基于人体骨骼和深度图像信息的指尖检测方法

A fingertip detection method based on human skeleton and depth image information

针对复杂环境下的指尖检测,从手部图像分割和指尖检测方法两方面进行改进,提出了一种基于人体骨骼和深度图像信息的指尖检测方法。首先采用Kinect获取人体骨骼和深度图像信息,通过人体骨骼信息锁定目标用户,利用锁定用户的手部节点位置从深度图像中提取手部区域图像;然后从手部骨架中搜索骨架端点,提出局部最优查找方法对轮廓凸包计算结果进行优化;最后结合手部轮廓特征找到指尖位置。实验结果表明,该方法具有良好的检测效果,满足实时性要求,能够实现复杂环境下的鲁棒检测。

Aiming at fingertip detection in a complex environment, from the two aspects of hand image segmentation and fingertip detection, a fingertip detection method based on human skeleton and depth image information is proposed. Firstly, Kinect is used to obtain the human skeleton and depth im- age information, the objective user is locked by the human skeleton information, and then the hand joint position of the locked user is used to extract the hand area image from the depth image. Secondly, the skeleton endpoints are searched from the hand skeleton, and the local optimal search method is proposed to optimize the results of contour convex hull computation. Finally, the fingertip position is found by combining the feature of hand contour. The experimental results show that the proposed method has good detection effect, meets the real-time requirements and can realize robust detection in a complex en- vironment.