Face forgery detection is drawing ever-increasing attention in the academic community owing to security concerns.Despite the considerable progress in existing methods,we note that:Previous works overlooked finegrain f...Face forgery detection is drawing ever-increasing attention in the academic community owing to security concerns.Despite the considerable progress in existing methods,we note that:Previous works overlooked finegrain forgery cues with high transferability.Such cues positively impact the model’s accuracy and generalizability.Moreover,single-modality often causes overfitting of the model,and Red-Green-Blue(RGB)modal-only is not conducive to extracting the more detailed forgery traces.We propose a novel framework for fine-grain forgery cues mining with fusion modality to cope with these issues.First,we propose two functional modules to reveal and locate the deeper forged features.Our method locates deeper forgery cues through a dual-modality progressive fusion module and a noise adaptive enhancement module,which can excavate the association between dualmodal space and channels and enhance the learning of subtle noise features.A sensitive patch branch is introduced on this foundation to enhance the mining of subtle forgery traces under fusion modality.The experimental results demonstrate that our proposed framework can desirably explore the differences between authentic and forged images with supervised learning.Comprehensive evaluations of several mainstream datasets show that our method outperforms the state-of-the-art detection methods with remarkable detection ability and generalizability.展开更多
The human face is a valuable biomarker of aging,but the collection and use of its image raise significant privacy concerns.Here we present an approach for facial data masking that preserves age-related features using ...The human face is a valuable biomarker of aging,but the collection and use of its image raise significant privacy concerns.Here we present an approach for facial data masking that preserves age-related features using coordinate-wise monotonic transformations.We first develop a deep learning model that estimates age directly from non-registered face point clouds with high accuracy and generalizability.We show that the model learns a highly indistinguishable mapping using faces treated with coordinate-wise monotonic transformations,indicating that the relative positioning of facial information is a low-level biomarker of facial aging.Through visual perception tests and computational3D face verification experiments,we demonstrate that transformed faces are significantly more difficult to perceive for human but not for machines,except when only the face shape information is accessible.Our study leads to a facial data protection guideline that has the potential to broaden public access to face datasets with minimized privacy risks.展开更多
A novel face verification algorithm using competitive negative samples is proposed.In the algorithm,the tested face matches not only with the claimed client face but also with competitive negative samples,and all the ...A novel face verification algorithm using competitive negative samples is proposed.In the algorithm,the tested face matches not only with the claimed client face but also with competitive negative samples,and all the matching scores are combined to make a final decision.Based on the algorithm,three schemes,including closestnegative-sample scheme,all-negative-sample scheme,and closest-few-negative-sample scheme,are designed.They are tested and compared with the traditional similaritybased verification approach on several databases with different features and classifiers.Experiments demonstrate that the three schemes reduce the verification error rate by 25.15%,30.24%,and 30.97%,on average,respectively.展开更多
针对如何实现只有单训练样本情况下人脸认证,提出基于稀疏扩展字典学习的代价敏感单样本人脸认证方法。首先学习一种可将训练样本和一般训练集结合起来的投影方式来构造适合训练样本的稀疏扩展字典,而并非独立地利用一般训练集直接构造...针对如何实现只有单训练样本情况下人脸认证,提出基于稀疏扩展字典学习的代价敏感单样本人脸认证方法。首先学习一种可将训练样本和一般训练集结合起来的投影方式来构造适合训练样本的稀疏扩展字典,而并非独立地利用一般训练集直接构造扩展字典,从而更好地解决单训练样本不能涵盖测试条件变化的问题;其次通过稀疏表示分类得到与测试样本最相似的训练样本,然后对测试样本和该训练样本分别提取HOG特征,根据距离准则计算相似度判断是否在阈值范围内;最终实现在光照、表情变化情况下的单训练样本人脸鲁棒认证。该方法分别在AR、CMU-PIE和Extended Yale B 3个公共人脸数据库上进行实验,均取得较满意的结果,验证了该方法的可行性和有效性。展开更多
基金This study is supported by the Fundamental Research Funds for the Central Universities of PPSUC under Grant 2022JKF02009.
文摘Face forgery detection is drawing ever-increasing attention in the academic community owing to security concerns.Despite the considerable progress in existing methods,we note that:Previous works overlooked finegrain forgery cues with high transferability.Such cues positively impact the model’s accuracy and generalizability.Moreover,single-modality often causes overfitting of the model,and Red-Green-Blue(RGB)modal-only is not conducive to extracting the more detailed forgery traces.We propose a novel framework for fine-grain forgery cues mining with fusion modality to cope with these issues.First,we propose two functional modules to reveal and locate the deeper forged features.Our method locates deeper forgery cues through a dual-modality progressive fusion module and a noise adaptive enhancement module,which can excavate the association between dualmodal space and channels and enhance the learning of subtle noise features.A sensitive patch branch is introduced on this foundation to enhance the mining of subtle forgery traces under fusion modality.The experimental results demonstrate that our proposed framework can desirably explore the differences between authentic and forged images with supervised learning.Comprehensive evaluations of several mainstream datasets show that our method outperforms the state-of-the-art detection methods with remarkable detection ability and generalizability.
基金supported by the National Natural Science Foundation of China(92049302,92374207,32088101,32330017)the National Key Research and Development Program of China(2020YFA0804000)。
文摘The human face is a valuable biomarker of aging,but the collection and use of its image raise significant privacy concerns.Here we present an approach for facial data masking that preserves age-related features using coordinate-wise monotonic transformations.We first develop a deep learning model that estimates age directly from non-registered face point clouds with high accuracy and generalizability.We show that the model learns a highly indistinguishable mapping using faces treated with coordinate-wise monotonic transformations,indicating that the relative positioning of facial information is a low-level biomarker of facial aging.Through visual perception tests and computational3D face verification experiments,we demonstrate that transformed faces are significantly more difficult to perceive for human but not for machines,except when only the face shape information is accessible.Our study leads to a facial data protection guideline that has the potential to broaden public access to face datasets with minimized privacy risks.
基金supported by the National Natural Science Foundation of China (No.69972024)the National High Technology Research and Development Program of China (No.2001A4114081).
文摘A novel face verification algorithm using competitive negative samples is proposed.In the algorithm,the tested face matches not only with the claimed client face but also with competitive negative samples,and all the matching scores are combined to make a final decision.Based on the algorithm,three schemes,including closestnegative-sample scheme,all-negative-sample scheme,and closest-few-negative-sample scheme,are designed.They are tested and compared with the traditional similaritybased verification approach on several databases with different features and classifiers.Experiments demonstrate that the three schemes reduce the verification error rate by 25.15%,30.24%,and 30.97%,on average,respectively.
文摘针对如何实现只有单训练样本情况下人脸认证,提出基于稀疏扩展字典学习的代价敏感单样本人脸认证方法。首先学习一种可将训练样本和一般训练集结合起来的投影方式来构造适合训练样本的稀疏扩展字典,而并非独立地利用一般训练集直接构造扩展字典,从而更好地解决单训练样本不能涵盖测试条件变化的问题;其次通过稀疏表示分类得到与测试样本最相似的训练样本,然后对测试样本和该训练样本分别提取HOG特征,根据距离准则计算相似度判断是否在阈值范围内;最终实现在光照、表情变化情况下的单训练样本人脸鲁棒认证。该方法分别在AR、CMU-PIE和Extended Yale B 3个公共人脸数据库上进行实验,均取得较满意的结果,验证了该方法的可行性和有效性。
