基于超分辨率重建的强压缩深度伪造视频检测

Super-resolution Reconstruction Detection Method for DeepFake Hard Compressed Videos

经典的深度伪造(DeepFake)视频检测方法一般使用卷积神经网络进行检测,但在强压缩深度伪造换脸视频数据集上表现较差,并会对真实数据做出大量误检测。针对这个问题,该文提出一种基于超分辨率重建的强压缩深度伪造视频检测方法。该方法基于深度神经网络检测模型,通过融入超分辨率重建技术,恢复强压缩视频所损失的空间与时间信息,进而提升对强压缩视频的检测准确率。使用FaceForensics++及DFDC数据集进行实验,针对强压缩的深度伪造视频,该方法较ResNet50提高了单帧以及视频的测试准确率,有效缓解强压缩真实视频的误检测问题。

The forensics methods of DeepFake video generally use convolution neural networks.However,these methods perform poorly on hard compressed DeepFake datasets and make a large number of false detections on real data.To solve the problem above,a method of hard compressed DeepFake video detection based on deep neural network model is proposed,which improves the detection accuracy of hard compressed video by incorporating super-resolution reconstruction technology and recovering the loss of the spatial and temporal information during hard compression.Experiments are performed with the FaceForensics++Datasets and DFDC(the DeepFake Detection Challenge)Datasets for hard compressed DeepFake video,which improve the test accuracy of single frame and video compared to ResNet50,and effectively alleviate the problem of false detection of real video with hard compression.