融合头部姿态和面部表情的互动式活体检测

Interactive liveness detection combining with head pose and facial expression

为了阻挡人脸识别系统中的照片及视频攻击,提出了一种将头部姿态和面部表情融合的互动式活体检测算法。首先,对VGGNet的卷积核数目、网络层数、正则化等进行了调整优化,构建了一个多层卷积的头部姿态估计网络;其次,引入全局平均池化、局部响应归一化和卷积替代池化等方法对VGGNet进行改进,构建了一个表情识别网络;最后,融合上述两个网络实现了互动式活体检测系统,对用户发出随机指令实时完成活体检测。实验结果表明,所提出的头部姿态估计网络和表情识别网络分别在CAS-PEAL-R1数据集和CK+数据集上取得了99.87%和99.60%的准确率,而活体检测系统的综合准确率达到了96.70%,运行速度达到了每秒20~28帧,在实际应用中泛化能力突出。

In order to prevent photo and video attacks in the face recognition system,an interactive liveness detection algorithm was proposed which combines the head pose and facial expression.Firstly,the number of convolution kernels,network layers,and regularization of VGGNet were adjusted and optimized,and a multi-layer convolutional head pose estimation network was constructed.Secondly,the methods such as global average pooling,local response normalization and convolutional replacement pooling were introduced to improve VGGNet and build an expression recognition network.Finally,the above two networks were fused to realize an interactive liveness detection system,which sends random instructions to users to complete liveness detection in real time.The experimental results show that the proposed head pose estimation network and expression recognition network achieve 99.87%and 99.60%accuracy on CAS-PEAL-R1 dataset and CK+dataset respectively,and the liveness detection system has the comprehensive accuracy reached 96.70%,the running speed reaches 20-28 frames per second,which make the generalization ability of the system outstanding in the practical application.