多点触控的沙画手势识别

Sand painting gesture recognition based on multi-touch

针对多点触控手势间接指令问题,提出了基于多点触控的沙画手势识别系统,该识别系统由时间、空间、形状信息控制。提出一种手势图形建模方法,测量手势的笔划之间的空间和时间关系。采用聚类算法标记手势图形中笔划的形状信息作为局部形状特征;利用基准方法 HBF49特征提取全局形状特征。通过一组有10种不同多点触控的沙画手势的数据集评估基于多点触控的沙画手势识别系统,使用图嵌入方法和SVM分类进行手势识别,识别的准确率达到94.75%。实验结果证明,此研究对完成基于多点触控的沙画虚拟系统有重要作用。

Aiming at the problems of multi-touch gesture indirect command, a sand painting gesture recognition systembased on multi-touch has been presented, which is controlled by temporal, spatial and shape information. Firstly, a gesturegraphic modeling method is proposed to measure the spatial and temporal relationship between the gesture strokes. Then,the clustering algorithm is used to mark the shape information of the strokes in the gesture graph as the local shape featureand the benchmarking tool HBF49 is used to extract the global shape feature. Finally, the sand painting gesture recognitionsystem based on multi-touch is evaluated by a collection of data with 10 different multi-touch sand painting gestures, usingthe graph embedding method and SVM classifier to identify gestures, achieving a recognition rate of 94.75%. The experimentsshow that the research plays an important role in completing the sand painting virtual system based on multi-touch.