基于深度图像的指尖和掌心特征提取方法

Feature detection method of fingertip and palm based on depth image

针对在其他肤色和重叠物干扰下手势分割出现偏差的问题,提出深度数据和骨骼追踪实现准确手势分割。结合凸缺陷的最小外接圆、平均值、最大内切圆三种不同的掌心提取方法来提高不同手势下掌心和掌心区域半径的精确度,通过提取出指尖弧并结合凸包来得到拟指尖集,再通过3步过滤来得到准确的指尖。实验中对6种手势进行了4种变换情况下的检验,其中翻转、平行、重叠的识别率都高于90%,倾斜和偏转分别超过70°、60°时准确度明显下降。实验结果表明了该方法在多种真实手势场景下具有较高的准确率。

To solve the gesture segmentation deviation problem under the interference of other skins and overlapping objects, a method of using depth data and skeleton tracking to segment gesture accurately was proposed. The minimum circumscribed circle, the average and the maximal inscribed circle of convexity defect, were combined to improve the detection of palm and the palm region＇s radius of various gesture. A fingertip candidate set was got through integrating the finger arc with convex hull, then real fingertips were obtained with three-step filtering. Six gestures have been tested in four transform cases, the recognition rate of flip, parallel, overlapping are all higher than 90% but the rate decreases obviously when tilting more than 70 degree and yawing more than 60 degree. The experimental results show that the accuracy of the proposed method is high in a variety of real scenes.