基于流形假设的骨架序列动作识别算法

Skeleton-based action recognition by manifold assumption

骨架数据是通过对动作的空间几何位置进行编码获取,可以避免冗余背景信息的干扰,是动作识别领域常用的数据类型之一.现有骨架数据的动作识别主要分为经典的骨架数据表征和基于深度学习的骨架动作识别应用.相较于传统欧氏度量下的识别方法,流形为更好地研究非线性结构提供了重要数学工具.然而,目前仍缺乏利用流形假设对骨架数据进行动作识别的相关总结.因此,从骨架表示、轨迹时间对齐、动作序列表征以及动作分类4个关键步骤出发,系统地总结了基于流形假设的动作识别工作,对比了各项工作在基准数据集上的表现.最后,根据当前动作识别工作的发展趋势,对流形假设在动作识别方向上的进一步改进进行了展望.

Skeletal data are obtained by encoding the spatial geometric position of the action,which can prevent the interference of redundant background information.It is one of the commonly used data types in the field of action recognition.The existing review of action recognition related to skeletal data is mainly divided into the classical skeletal data representation and the application of skeletal action recognition based on deep learning.Compared with the action recognition methods based on the traditional Euclidean metric,manifolds provide an important mathematical tool for a better study of nonlinear structures.However,there is still a lack of summaries about action recognition from skeletal data using the manifold assumption.Therefore,starting from the four steps of skeleton representation—trajectory temporal alignment,action sequence characterization,and action classification—this article systematically summarizes the action recognition work based on the manifold assumption,and compares the performance of each work on the benchmark datasets.Finally,according to the current development trend of action recognition,further improvement of the manifold assumption in the direction of action recognition is prospected.