手势手语力效分析

LMA Approach in Person-Independent Sign Language Recognition

在非特定人手语识别研究中,数据差异性带来的矛盾已使其成为一个亟待分析的问题.从人体运动学、语言学等角度对手语理解,是解决差异性矛盾进而推动非特定人手语识别的有效途径.文章以运动观测科学规则,特别是拉班的力效理论为基础,归纳了造成手语数据差异的因素,提出了手势手语力效要素的定义和描述方法;继而给出了非特定人手语数据的归整策略,规整后的数据用于训练与识别.在多种实验环境下进行的评估结果表明,识别的效果得到了明显的提升.

In the research of singer independent sign language recognition, the contradiction brought about by the difference among data has made this difference an imperative problem to be analyzed. To understand sign language from the perspectives of human kinematics and linguistics is helpful to remove the individuality of various signers, at the same time ensuring the common characters of sign language words; this is an effective way to tackle the contradiction brought about by these differences. Based on the principles of movement observation science, especially the effort theory in LMA, taking into consideration the structurality of sign language, the paper describes and defines each dimension of effort in sign; then normalize sign language data of unspecific person to some extent, the normalized data is to be used in training and recognition. This method has been assessed under multiple experiment environments and been proved to greatly improve the recognition results.