基于深度信息的指尖检测-跟踪-监督算法

Fingertip detecting-tracking-supervising algorithm based on depth information

针对快速准确识别手指并实时跟踪手指的问题,提出了基于Kinect深度信息的指尖检测-跟踪-监督算法。检测部分主要为利用深度数据实现指尖的识别,并结合指尖检测结果与卡尔曼滤波确定出指尖的稳定状态。跟踪部分主要为将检测部分得到指尖的稳定状态作为初始条件,并使用具有监督环节的快速判别尺寸空间跟踪算法实现对指尖的实时跟踪,在对每一帧的指尖运动实时跟踪的同时,监督环节对每一帧的指尖实时跟踪结果进行监督,通过与指尖的特征进行匹配,矫正跟踪结果发生偏差的点,来提高跟踪结果的准确性,从而保证整个系统具有较强的鲁棒性。本文对指尖检测识别与跟踪进行了多组实验,均能够准确的检测识别出指尖,并能稳定的实时跟踪指尖的位置。实验结果表明该方法具有较强的鲁棒性与准确性。

To recognize and track fingertip quickly and accurately,one kind of fingertip detecting-tracking-supervising algorithm based on Kinect depth information is proposed.The detection process mainly uses the depth data to realize the fingertip recognition.The fingertip detection result is combined with Kalman filter to determine the steady state of the fingertip.The tracking process mainly takes the steady state of the fingertip in detection process as the initial condition.Fast discriminatiwe scale space tracking algorithm is adopted as the supervising process to realize the real-time tracking of the fingertip.During tracking the movement of the fingertips of each frame in real time,the supervising process supervises the real-time tracking results of the fingertips in each frame.By matching the features of the fingertips to correct the deviation of the tracking results,the accuracy of the tracking results can be improved.Hence,the robustness of the whole system can be realized.In this paper,multiple sets of experiments have been implemented on fingertip detection,recognition and tracking.Both of them can accurately detect fingertips and track the movement of fingertips in real time.Experimental results show that the proposed method has strong robustness and accuracy.