基于MCL的多速率点云动作识别

MCL based multi-rate point cloud action recognition

针对体素数据会占用大量的内存空间且单网络可提取的动作信息有限的问题,提出了基于MCL的多速率点云动作识别模型。首先,优化了点云数据预处理方法,使点云数据的总体大小减少1/2;其次,提出了基于MCL的多速率点云动作识别模型,以MCL框架为主体结构,引入置信度损失函数和广义蒸馏,通过置信度损失来确定知识蒸馏时的“教师”及“学生”网络;对“教师”网络进行广义蒸馏,对“学生”网络进行指导,实现了不同速率网络之间的信息融合。对该模型在公开的MMActvity数据集和Pantomime数据集上的性能表现进行了评估,分别得到91.3%和95.2%的准确率,实验结果验证了该模型的有效性。

To address the issues of voxel data occupying a large amount of memory space and limited action information that can be extracted by a single network,multiple choice learning(MCL)based multi-rate point cloud action recognition model is proposed.Firstly,the preprocessing method of point cloud data is optimized,reducing the overall size of the point cloud data by half.Secondly,an MCL-based multi-rate point cloud action recognition model is introduced,which takes the MCL framework as the main structure and incorporates confidence loss fuction and generalized distillation.The confidence loss is used to determine the“teacher”and“student”networks during knowledge distillation.The“teacher”network is subjected to generalized distillation to guide the“student”network,enabling information fusion between networks operating at different rates.This model was evaluated on the publicly available MMActvity dataset and Pantomime dataset,achieving accuracies of 91.3%and 95.2%,respectively.The experimental results validate the effectiveness of the proposed model.