实时动态手势动作分割与研究

Real-Time Dynamic Gesture Segmentation and Research

地面指挥员的手势动作是航空指挥动作中重要的一部分。针对目前手势分割时效性不高、短序列分割不准确等问题,提出实时动态手势动作分割方法。利用OpenPose提取手部关键点位置信息,计算手指顶点与基点的角度特征及长度特征序列,通过滑动窗口提取得到子序列,将子序列的均值与前一子序列均值作差,利用阈值法,从子序列中寻找满足阈值条件的点,即为序列分割点。构建了手势指令数据库,通过所提方法与人工标注的分割点进行比较得出:所提方法分割较为准确,准确率均达到90%以上且时效性较高。

The gestures of the ground commander are an important part of the air command movement.In view of the current low timeliness of gesture segmentation and inaccurate short sequence segmentation this paper proposes a real-time dynamic gesture segmentation method.Firstly OpenPose is used to extract the key position information of the hand calculate the angular feature and length feature sequence of the hand vertex and base point extract the subsequence through the sliding window and compare the mean of the subsequence with the mean of the previous subsequence.The threshold method is used to find a point that satisfies the threshold condition from the subsequence i.e.the sequence division point.This paper constructs a database of gesture instructions.Compared with that of manual annotation the segmentation of the proposed method is more accurate and the accuracy is above 90%with high timeliness.