Home

Awesome

Awesome Comprehensive Deepfake Detection Awesome

This repository provides a comprehensive investigation of advanced single-modal and multi-modal deepfake detection elaborated in the following survey.

<p align="center" style="font-size:20px;"> <h2>Evolving from Single-modal to Multi-modal Facial Deepfake Detection: A Survey <a href="https://arxiv.org/pdf/2406.06965"><img src='https://img.shields.io/badge/arXiv-PDF-red?style=flat&logo=arXiv&logoColor=red' alt='arXiv PDF'></a> </h2> </p> <p align="center"> <a href="https://pinglmlcv.github.io/pingliu264/">Ping Liu<sup>1</sup></a> , Qiqi Tao<sup>2</sup> , <a href="https://joeyzhouty.github.io/">Joey Tianyi Zhou<sup>2,3</sup></a> </p> <p align="center"> <sup>1</sup><a href="https://www.unr.edu/cse">University of Nevada, Reno</a><br> <sup>2</sup><a href="https://www.a-star.edu.sg/cfar/home">Centre for Frontier AI Research (CFAR), A*STAR</a><br> <sup>3</sup><a href="https://www.catos.sg/"> Centre for Advanced Technologies in Online Safety (CATOS)</a> </p>

If you believe there are additional works that should be included in our list, please do not hesitate to send us an email (pingl@unr.edu/tao.qiqi@outlook.com/zhouty@cfar.a-star.edu.sg) or raise an issue. Your suggestions and comments are invaluable to ensuring the completeness and accuracy of our resource.

Content



Relevant Surveys

Deepfake/AIGC Generation and Detection

[arxiv 2024] Deepfake Generation and Detection: A Benchmark and Survey Paper Project

[arxiv 2024] Detecting Multimedia Generated by Large AI Models: A Survey Paper Project

[ECAI 2023] GAN-generated Faces Detection: A Survey and New Perspectives Paper

[NeurIPS 2023] DeepfakeBench: A Comprehensive Benchmark of Deepfake Detection Paper Project

[arxiv 2023] Deepfake detection: A comprehensive study from the reliability perspective Paper

[IJCV 2022] Countering Malicious DeepFakes: Survey, Battleground, and Horizon Paper Project

Multi-modal Fact-checking

[EMNLP 2023] Multimodal automated fact-checking: A survey Paper


Facial Deepfake Datasets

Single-modal GAN-generated Datasets

DatasetYearTaskManipulated Modality# of real videos# of fake videosPaperLink
FaceForensics++(FF++)2019ClassificationVisual1,0004,000FaceForensics++: Learning to Detect Manipulated Facial ImagesDownload
DFD2019ClassificationVisual3633,068Contributing data to deepfake detection researchDownload
DFFD2020ClassificationVisual1,0003,000On the Detection of Digital Face ManipulationDownload
FaceShifter2020ClassificationVisual-1,000FaceShifter: Towards High Fidelity And Occlusion Aware Face SwappingDownload
DFDC2020ClassificationVisual23,654104,500The DeepFake Detection Challenge (DFDC) DatasetDownload
Celeb-DF2020ClassificationVisual5905,639Celeb-df: A large-scale challenging dataset for deepfake forensicsDownload
DeeperForensics-1.02020ClassificationVisual50,00010,000DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery DetectionDownload
WildDeepfake2020ClassificationVisual3,8053,509WildDeepfake: A Challenging Real-World Dataset for Deepfake DetectionDownload
KoDF2020ClassificationVisual62,166175,776KoDF: A Large-scale Korean DeepFake Detection DatasetDownload
FFIW_10k2021Classification & Spatial GroundingVisual10,00010,000Face Forensics in the WildDownload
ForgeryNet2021Classification & Spatial Grounding & Temporal GroundingVisual99,63012,1617Forgerynet: A versatile benchmark for comprehensive forgery analysisDownload
DF-Platter2023ClassificationVisual133,260132,496DF-Platter: Multi-Face Heterogeneous Deepfake DatasetDownload

Single-modal Diffusion-generated Datasets

DatasetYearTaskManipulated Modality# of real images# of fake imagesPaperLink
DeepFakeFace2023ClassificationVisual30,00090,000Robustness and Generalizability of Deepfake Detection: A Study with Diffusion ModelsDownload
DiFF2024ClassificationVisual23,661537,466Diffusion Facial Forgery DetectionDownload
DiffusionFace2024ClassificationVisual30,000600,000DiffusionFace: Towards a Comprehensive Dataset for Diffusion-Based Face Forgery AnalysisDownload
DiffusionDB-Face2024ClassificationVisual94,12024,794Diffusion DeepfakeDownload
JourneyDB-Face2024ClassificationVisual94,12087,833Diffusion DeepfakeDownload

Multi-modal Audio-Visual Datasets

DatasetYearTaskManipulated Modality# of real videos# of fake videosPaperLink
FakeAVCeleb2021ClassificationVisual & Audio50019,500FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake DatasetDownload
TMC2022Classification & Temporal GroundingVisual & Audio2,5634,380Trusted Media Challenge Dataset and User Study-
LAV-DF2022Classification & Temporal GroundingVisual & Audio36,43199,873Do You Really Mean That? Content Driven Audio-Visual Deepfake Dataset and Multimodal Method for Temporal Forgery LocalizationDownload
DefakeAVMiT2023ClassificationVisual & Audio5406,480AVoiD-DF: Audio-Visual Joint Learning for Detecting Deepfake-
AV-Deepfake1M2023Classification & Temporal GroundingVisual & Audio286,721860,039AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake DatasetDownload
MMDFD2023ClassificationVisual & Audio & Text1,5005,000MMDFD- A Multimodal Custom Dataset for Deepfake Detection-
PolyGlotFake2024ClassificationVisual & Audio & Text76614,472PolyGlotFake: A Novel Multilingual and Multimodal DeepFake DatasetDownload

Multi-modal Text-Visual Datasets

DatasetYearTaskManipulated Modality# of real image-text pairs# of fake image-text pairsPaperLink
DGM42023Classification & Spatial Grounding & Text GroundingVisual & Text77,426152,574DGM4: Detecting and Grounding Multi-Modal Media Manipulation and BeyondDownload

Single-modal (Visual) Deepfake Detection

Passive Detection

Naive Detection

Visual Artifacts
  1. [CVPR 2024] Rethinking the Up-Sampling Operations in CNN-based Generative Network for Generalizable Deepfake Detection Paper
  2. [CVPR 2024] LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake Detection Paper
  3. [arXiv 2024] Data-Independent Operator: A Training-Free Artifact Representation Extractor for Generalizable Deepfake Detection Paper
  4. [arXiv 2024] A Single Simple Patch is All You Need for AI-generated Image Detection Paper
  5. [arXiv 2024] GenFace: A Large-Scale ed Face Forgery Benchmark and Cross Appearance-Edge Learning Paper
  6. [TMM 2023] GLFF: Global and Local Feature Fusion for AI-synthesized Image Detection Paper
  7. [CVPRW 2023] Intriguing properties of synthetic images: from generative adversarial networks to diffusion models Paper
  8. [arXiv 2023] Diffusion Noise Feature: Accurate and Fast Generated Image Detection Paper
  9. [CVPR 2021] Multi-attentional Deepfake Detection Paper
  10. [CVPR 2020] Global Texture Enhancement for Fake Face Detection In the Wild Paper
  11. [ICCV 2019] FaceForensics++: Learning to Detect Manipulated Facial Images Paper
  12. [WIFS 2018] Mesonet: a compact facial video forgery detection network Paper
Consistencies-based
  1. [arXiv 2024] Generalizing Deepfake Video Detection with Plug-and-Play: Video-Level Blending and Spatiotemporal Adapter Tuning Paper
  2. [arXiv 2024] UniForensics: Face Forgery Detection via General Facial Representation Paper
  3. [arXiv 2024] Learning Natural Representation for Face Forgery Video Detection Paper
  4. [IJCV 2024] Learning Spatiotemporal Inconsistency via Thumbnail Layout for Face Deepfake Detection Paper
  5. [CVPR 2024] Exploiting Style Latent Flows for Generalizing Deepfake Video Detection Paper
  6. [arxiv 2024] Compressed Deepfake Video Detection Based on 3D Spatiotemporal Trajectories Paper
  7. [AAAI 2023] Noise based deepfake detection via multi-head relative-interaction Paper
  8. [ICCV 2023] TALL: Thumbnail Layout for Deepfake Video Detection Paper
  9. [CVPR 2023] AltFreezing for More General Video Face Forgery Detection Paper
  10. [TCSVT 2023] MRE-Net: Multi-Rate Excitation Network for Deepfake Video Detection Paper
  11. [WACV 2023] TI2Net: Temporal Identity Inconsistency Network for Deepfake Detection Paper
  12. [ACM MM Asia 2022] Latent pattern sensing: Deepfake video detection via predictive representation learning Paper
  13. [CVPR 2021] Lips don’t lie: A generalisable and robust approach to face forgery detection Paper
  14. [ICCV 2021] Exploring Temporal Coherence for More General Video Face Forgery Detection Paper
  15. [ACM MM 2020] DeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythms Paper
  16. [WIFS 2018] In Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking Paper

Advanced Detection

Input Level
Data Augmentation
  1. [arXiv 2024] Towards General Deepfake Detection with Dynamic Curriculum Paper
  2. [ECCV 2024] Fake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detection Paper
  3. [arXiv 2024] Can We Leave Deepfake Data Behind in Training Deepfake Detector? Paper
  4. [arXiv 2024] ED4: Explicit Data-level Debiasing for Deepfake Detection Paper
  5. [arXiv 2024] FSBI: Deepfakes Detection with Frequency Enhanced Self-Blended Images Paper
  6. [arXiv 2024] FreqBlender: Enhancing DeepFake Detection by Blending Frequency Knowledge Paper
  7. [ICCV 2023] SeeABLE: Soft Discrepancies and Bounded Contrastive Learning for Exposing Deepfakes Paper
  8. [arXiv 2023] Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detection Paper
  9. [CVPR 2022] Detecting Deepfakes with Self-Blended Images Paper
  10. [CVPR 2022] Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detection Paper
  11. [CVPR 2021] Representative Forgery Mining for Fake Face Detecti Paper
  12. [ICCV 2021] Learning Self-Consistency for Deepfake Detection Paper
Frequency-space Based
  1. [arXiv 2024] HARNESSING WAVELET TRANSFORMATIONS FOR GENERALIZABLE DEEPFAKE FORGERY DETECTION Paper
  2. [arXiv 2024] Multiple Contexts and Frequencies Aggregation Network for Deepfake Detection Paper
  3. [AAAI 2024] Frequency-Aware Deepfake Detection: Improving Generalizability through Frequency Space Learning Paper
  4. [ICASSP 2024] Frequency Masking for Universal Deepfake Detection Paper
  5. [CVPR 2023] Dynamic Graph Learning with Content-guided Spatial-Frequency Relation Reasoning for Deepfake Detection Paper
  6. [AAAI 2022] FrePGAN: Robust Deepfake Detection Using Frequency-level Perturbations Paper
  7. [AAAI 2022] ADD: Frequency Attention and Multi-View based Knowledge Distillation to Detect Low-Quality Compressed Deepfake Images Paper
  8. [CVPR 2021] Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domain Paper
  9. [CVPR 2021] Generalizing Face Forgery Detection with High-frequency Features Paper
  10. [CVPR 2021] Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detection Paper
  11. [AAAI 2021] Local Relation Learning for Face Forgery Detection Paper
  12. [ECCV 2020] Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Clues Paper
Model Level
Transformer-based
  1. [TMM 2024] DIP: Diffusion Learning of Inconsistency Pattern for General DeepFake Detection Paper
  2. [arXiv 2024] FakeFormer: Efficient Vulnerability-Driven Transformers for Generalisable Deepfake Detection Paper
  3. [arXiv 2024] HARNESSING WAVELET TRANSFORMATIONS FOR GENERALIZABLE DEEPFAKE FORGERY DETECTION Paper
  4. [arXiv 2024] Face Forgery Detection with Elaborate Backbone Paper
  5. [arXiv 2024] Standing on the Shoulders of Giants: Reprogramming Visual-Language Model for General Deepfake Detection Paper
  6. [arXiv 2024] Guided and Fused: Efficient Frozen CLIP-ViT with Feature Guidance and Multi-Stage Feature Fusion for Generalizable Deepfake Detection Paper
  7. [arXiv 2024] Open-Set Deepfake Detection: A Parameter-Efficient Adaptation Method with Forgery Style Mixture Paper
  8. [arXiv 2024] A Timely Survey on Vision Transformer for Deepfake Detection Paper
  9. [arXiv 2024] Exploring Self-Supervised Vision Transformers for Deepfake Detection: A Comparative Analysis Paper
  10. [arXiv 2024] Mixture of Low-rank Experts for Transferable AI-Generated Image Detection Paper
  11. [arXiv 2024] MoE-FFD: Mixture of Experts for Generalized and Parameter-Efficient Face Forgery Detection Paper
  12. [CVPR 2023] AUNet: Learning Relations Between Action Units for Face Forgery Detection Paper
  13. [ACM MM 2023] UMMAFormer: A Universal Multimodal-adaptive Transformer Framework for Temporal Forgery Localization Paper
  14. [ICCVW 2023] Undercover Deepfakes: Detecting Fake Segments in Video Paper
  15. [arXiv 2023] DeepFake-Adapter: Dual-Level Adapter for DeepFake Detection Paper
  16. [MIPR 2023] Enhancing General Face Forgery Detection via Vision Transformer with Low-Rank Adaptation Paper
VLM-based
  1. [arXiv 2024] ForgeryGPT: Multimodal Large Language Model For Explainable Image Forgery Detection and Localization Paper
  2. [ACCV 2024] DPL: Cross-quality DeepFake Detection via Dual Progressive Learning Paper
  3. [WACV 2025] DeCLIP: Decoding CLIP representations for deepfake localization Paper
  4. [arXiv 2024] X2-DFD: A FRAMEWORK FOR EXPLAINABLE AND EXTENDABLE DEEPFAKE DETECTION Paper
  5. [arXiv 2024] MFCLIP: Multi-modal Fine-grained CLIP for Generalizable Diffusion Face Forgery Detection Paper
  6. [arXiv 2024] FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistant Paper
  7. [arXiv 2024] C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detection Paper
  8. [arXiv 2024] GM-DF: Generalized Multi-Scenario Deepfake Detection Paper
  9. [arXiv 2024] Towards More General Video-based Deepfake Detection through Facial Feature Guided Adaptation for Foundation Model Paper
  10. [arXiv 2024] FakeBench: Uncover the Achilles' Heels of Fake Images with Large Multimodal Models Paper
  11. [CVPR Workshop 2024] Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensics Paper
  12. [arXiv 2024] SHIELD: An Evaluation Benchmark for Face Spoofing and Forgery Detection with Multimodal Large Language Models Paper
  13. [arXiv 2024] Common Sense Reasoning for Deep Fake Detection Paper
  14. [ACM ICMRW 2024] Towards Quantitative Evaluation of Explainable AI Methods for Deepfake Detection Paper
  15. [arxiv 2023] Forgery-aware Adaptive Vision Transformer for Face Forgery Detection Paper
  16. [arXiv 2023] Towards General Visual-Linguistic Face Forgery Detection Paper
Learning Level
Advanced Loss
  1. [ToMM 2024] Domain-invariant and Patch-discriminative Feature Learning for General Deepfake Detection Paper
  2. [ICME 2023] Domain-Invariant Feature Learning for General Face Forgery Detection Paper
  3. [ICDM 2023] Concentric Ring Loss for Face Forgery Detection Paper
Disentangled Representation
  1. [arXiv 2024] Capture Artifacts via Progressive Disentangling and Purifying Blended Identities for Deepfake Detection Paper
  2. [CVPR 2024] Preserving Fairness Generalization in Deepfake Detection Paper
  3. [arXiv 2024] Decoupling Forgery Semantics for Generalizable Deepfake Detection Paper
  4. [arXiv 2023] Improving Cross-dataset Deepfake Detection with Deep Information Decomposition Paper
  5. [ICCV 2023] UCF: Uncovering Common Features for Generalizable Deepfake Detection Paper
  6. [ECCV 2022] Exploring Disentangled Content Information for Face Forgery Detection Paper
Reconstruction
  1. [CVPR 2023] MARLIN: Masked Autoencoder for facial video Representation LearnINg Paper
  2. [CVPR 2022] End-to-End Reconstruction-Classification Learning for Face Forgery Detection Paper
  3. [IJCAI 2021] Beyond the Spectrum: Detecting Deepfakes via Re-Synthesis Paper
  4. [CVPRW 2020] OC-FakeDect: Classifying Deepfakes Using One-class Variational Autoencoder Paper
Manipulation Localization
  1. [CVPR 2024] EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protection Paper
  2. [WACV 2024] Weakly-supervised deepfake localization in diffusion-generated images Paper
  3. [arXiv 2024] Delocate: Detection and Localization for Deepfake Videos with Randomly-Located Tampered Traces Paper
  4. [CVPR 2023] MaLP: Manipulation Localization Using a Proactive Scheme Paper
  5. [CVPR 2023] Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalization Paper
  6. [ACM MM 2023] Locate and Verify: A Two-Stream Network for Improved Deepfake Detection Paper
  7. [CVPR 2020] Face X-ray for More General Face Forgery Detection Paper
  8. [CVPR 2020] On the Detection of Digital Face Manipulation Paper
Identity Discrepancy
  1. [NeurIPS 2024] DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusion Paper
  2. [CVPR 2023] Implicit Identity Driven Deepfake Face Swapping Detection Paper
  3. [CVPR 2022] Protecting Celebrities from DeepFake with Identity Consistency Transformer Paper
  4. [TPAMI 2021] DeepFake Detection Based on Discrepancies Between Faces and Their Context Paper
  5. [ICCV 2021] ID-Reveal: Identity-aware DeepFake Video Detection Paper
Knowledge Distillation
  1. [arXiv 2023] DomainForensics: Exposing Face Forgery across Domains via Bi-directional Adaptation Paper
  2. [AAAI 2022] ADD: Frequency Attention and Multi-View based Knowledge Distillation to Detect Low-Quality Compressed Deepfake Images Paper
  3. [ACM MM 2021] CoReD: Generalizing Fake Media Detection with Continual Representation using Distillation Paper
  4. [CVPRW 2021] FReTAL: Generalizing Deepfake Detection using Knowledge Distillation and Representation Learning Paper
  5. [Journal of Mathematical Imaging and Vision 2015] Sliced and Radon Wasserstein Barycenters of Measures Paper
Fine-grained Prediction
  1. [arXiv 2024] Semantics-Oriented Multitask Learning for DeepFake Detection: A Joint Embedding Approach Paper
  2. [ToMM 2024] Mastering Deepfake Detection: A Cutting-Edge Approach to Distinguish GAN and Diffusion-Model Images Paper
  3. [CVPR 2023] Hierarchical Fine-Grained Image Forgery Detection and Localization Paper
  4. [ICCV 2023] Controllable Guide-Space for Generalizable Face Forgery Detection Paper
Diffusion Model Detection
  1. [arXiv 2024] On the Effectiveness of Dataset Alignment for Fake Image Detection Paper
  2. [CVPR 2024] LaRE^2: Latent Reconstruction Error Based Method for Diffusion-Generated Image Detection Paper
  3. [VISAPP 2024] Towards the Detection of Diffusion Model Deepfakes Paper
  4. [arXiv 2024] Diffusion Facial Forgery Detection Paper
  5. [ICCV 2023] DIRE for Diffusion-Generated Image Detection Paper
  6. [ICASSP 2023] On the detection of synthetic images generated by diffusion models Paper
  7. [ICCVW 2023] Detecting Images Generated by Deep Diffusion Models using their Local Intrinsic Dimensionality Paper
  8. [ICMLW 2023] Exposing the Fake: Effective Diffusion-Generated Images Detection Paper
Sequential Deepfake Detection
  1. [ECCV 2022] Detecting and Recovering Sequential DeepFake Manipulation Paper
  2. [arXiv 2023] Robust Sequential DeepFake Detection Paper
  3. [CVPR 2024] Contrastive Learning for DeepFake Classification and Localization via Multi-Label Ranking Paper
  4. [TIFS 2024] Multi-Collaboration and Multi-Supervision Network for Sequential Deepfake Detection Resources Paper
  5. [Transactions on Consumer Electronics 2024] Detecting Sequential Deepfake Manipulation via Spectral With Pyramid Attention in Consumer IoT Paper

Proactive Detection

Proactive Methods for GANs

  1. [arXiv 2024] ID-Guard: A Universal Framework for Combating Facial Manipulation via Breaking Identification Paper
  2. [IJCAI 2024] Are Watermarks Bugs for Deepfake Detectors? Rethinking Proactive Forensics Paper
  3. [TIFS 2024] Dual Defense: Adversarial, Traceable, and Invisible Robust Watermarking against Face Swapping Paper
  4. [CVPR 2023] MaLP: Manipulation Localization Using a Proactive Scheme Paper
  5. [ACM MM 2023] SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake Detection Paper
  6. [arXiv 2023] Feature Extraction Matters More: Universal Deepfake Disruption through Attacking Ensemble Feature Extractors Paper
  7. [arXiv 2023] Robust Identity Perceptual Watermark Against Deepfake Face Swapping Paper
  8. [CVPR 2022] Proactive Image Manipulation Detection Paper
  9. [ICLR 2022] Responsible Disclosure of Generative Models Using Scalable Fingerprinting Paper
  10. [ECCV 2022] TAFIM: Targeted Adversarial Attacks against Facial Image Manipulations Paper
  11. [AAAI 2022] CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating Deepfake Paper
  12. [IJCAI 2022] Anti-Forgery: Towards a Stealthy and Robust DeepFake Disruption Attack via Adversarial Perceptual-aware Perturbations Paper
  13. [AAAI 2021] Initiative Defense against Facial Manipulation Paper
  14. [CVPRW 2020] Disrupting Deepfakes: Adversarial Attacks Against Conditional Image Translation Networks and Facial Manipulation Systems Paper
  15. [WACVW 2020] Disrupting Image-Translation-Based DeepFake Algorithms with Adversarial Attacks Paper

Proactive Methods for Diffusion Models

  1. [ICLR 2024] DIAGNOSIS: Detecting Unauthorized Data Usages in Text-to-image Diffusion Models Paper
  2. [NeurIPSW 2024] DiffusionShield: A Watermark for Data Copyright Protection against Generative Diffusion Models Paper
  3. [ICCV 2023] The Stable Signature: Rooting Watermarks in Latent Diffusion Models Paper
  4. [TPS-ISA 2023] Invisible Watermarking for Audio Generation Diffusion Models Paper
  5. [arXiv 2023] A Recipe for Watermarking Diffusion Models Paper
  6. [arXiv 2023] LEAT: Towards Robust Deepfake Disruption in Real-World Scenarios via Latent Ensemble Attack Paper

Multi-modal Deepfake Detection

Audio-Visual Deepfake Detection

Independent Learning

  1. [Applied Soft Computing 2023] AVFakeNet: A unified end-to-end Dense Swin deep learning model for audio–visual​ deepfakes detection Paper
  2. [APSIPA ASC 2022] Multimodal Forgery Detection Using Ensemble Learning Paper
  3. [ICCV 2021] Joint Audio-Visual Deepfake Detection Paper
  4. [ACM MMW 2021] Evaluation of an Audio-Video Multimodal Deepfake Dataset using Unimodal and Multimodal Detectors Paper

Joint Learning

Intermediate Fusion
Cross-Attention
  1. [BMVC 2024] Detecting Audio-Visual Deepfakes with Fine-Grained Inconsistencies Paper
  2. [arXiv 2024] Contextual Cross-Modal Attention for Audio-Visual Deepfake Detection and Localization Paper
  3. [TIFS 2023] AVoiD-DF: Audio-Visual Joint Learning for Detecting Deepfake Paper
  4. [arXiv 2022] An Audio-Visual Attention Based Multimodal Network for Fake Talking Face Videos Detection Paper
  5. [ICCV 2021] Joint Audio-Visual Deepfake Detection Paper
Late Fusion
Concatenation & Addition
  1. [arXiv 2024] Integrating Audio-Visual Features for Multimodal Deepfake Detection Paper
  2. [arXiv 2024] AVT2-DWF: Improving Deepfake Detection with Audio-Visual Fusion and Dynamic Weighting Strategies Paper
  3. [Image Communication 2023] Magnifying multimodal forgery clues for Deepfake detection Paper
  4. [arXiv 2023] DF-TransFusion: Multimodal Deepfake Detection via Lip-Audio Cross-Attention and Facial Self-Attention Paper
  5. [DICTA 2022] Do You Really Mean That? Content Driven Audio-Visual Deepfake Dataset and Multimodal Method for Temporal Forgery Localization Paper
  6. [APSIPA ASC 2022] Multimodal Forgery Detection Using Ensemble Learning Paper
  7. [ACM MMW 2021] Evaluation of an Audio-Video Multimodal Deepfake Dataset using Unimodal and Multimodal Detectors Paper
Attention
  1. [ICASSP 2024] Cross-Modality and Within-Modality Regularization for Audio-Visual DeepFake Detection Paper
  2. [arXiv 2024] AVT2-DWF: Improving Deepfake Detection with Audio-Visual Fusion and Dynamic Weighting Strategies Paper
  3. [arXiv 2023] MIS-AVoiDD: Modality Invariant and Specific Representation for Audio-Visual Deepfake Detection Paper
MLP Mixer Layer
  1. [CVPRW 2023] Multimodaltrace: Deepfake Detection using Audiovisual Representation Learning Paper
Multi-task Strategy
  1. [ICME 2024] Explicit Correlation Learning for Generalizable Cross-Modal Deepfake Detection Paper
  2. [TIFS 2023] AVoiD-DF: Audio-Visual Joint Learning for Detecting Deepfake Paper
  3. [CVPRW 2023] Multimodaltrace: Deepfake Detection using Audiovisual Representation Learning Paper
  4. [arXiv 2024] Integrating Audio-Visual Features for Multimodal Deepfake Detection Paper
  5. [ICCV 2021] Joint Audio-Visual Deepfake Detection Paper
Regularization
  1. [ICASSP 2024] Cross-Modality and Within-Modality Regularization for Audio-Visual DeepFake Detection Paper
  2. [TIFS 2023] AVoiD-DF: Audio-Visual Joint Learning for Detecting Deepfake Paper
  3. [Image Communication 2023] Magnifying multimodal forgery clues for Deepfake detection Paper
  4. [arXiv 2023] MIS-AVoiDD: Modality Invariant and Specific Representation for Audio-Visual Deepfake Detection Paper

Matching-based Learning

  1. [ICIP 2024] Statistics-aware Audio-visual Deepfake Detector Paper
  2. [ToMM 2023] Voice-Face Homogeneity Tells Deepfake Paper
  3. [arXiv 2023] Unsupervised Multimodal Deepfake Detection Using Intra- and Cross-Modal Inconsistencies Paper

Others

  1. [CVPR 2024] AVFF: Audio-Visual Feature Fusion for Video Deepfake Detection Paper
  2. [CVPR 2023] Self-Supervised Video Forensics by Audio-Visual Anomaly Detection Paper
  3. [ToMM 2023] Multimodal Neurosymbolic Approach for Explainable Deepfake Detection Paper
  4. [TCSVT 2023] PVASS-MDD: Predictive Visual-audio Alignment Self-supervision for Multimodal Deepfake Detection Paper
  5. [CVPRW 2023] Audio-Visual Person-of-Interest DeepFake Detection Paper

Visual-Text Deepfake Detection

  1. [TPAMI 2024] Detecting and Grounding Multi-Modal Media Manipulation and Beyond Paper
  2. [ICASSP 2024] Exploiting Modality-Specific Features For Multi-Modal Manipulation Detection And Grounding Paper
  3. [ICME 2024] Counterfactual Explanations for Face Forgery Detection via Adversarial Removal of Artifacts Paper
  4. [arXiv 2023] Unified Frequency-Assisted Framework for Detecting and Grounding Multi-Modal Manipulation Paper
  5. [CVPR 2023] Detecting and Grounding Multi-Modal Media Manipulation Paper

Challenge

  1. [ACM MM 2024] 1M-Deepfakes Detection Challenge Paper

Trustworthy Deepfake Detection

Adversarial Attack

  1. [ECCVW 2024] Exploring Strengths and Weaknesses of Super-Resolution Attack in Deepfake Detection Paper
  2. [arXiv 2024] Adversarial Magnification to Deceive Deepfake Detection through Super Resolution Paper
  3. [AAAI 2024] TraceEvader: Making DeepFakes More Untraceable via Evading the Forgery Model Attribution Paper
  4. [ICASSP 2024] AdvShadow: Evading DeepFake Detection via Adversarial Shadow Attack Paper
  5. [CVPR 2023] Evading Forensic Classifiers with Attribute-Conditioned Adversarial Faces Paper
  6. [ICCV 2023] Frequency-aware GAN for Adversarial Manipulation Generation Paper
  7. [TCSVT 2023] Dodging DeepFake Detection via Implicit Spatial-Domain Notch Filtering Paper
  8. [arXiv 2023] Exploring Decision-based Black-box Attacks on Face Forgery Detection Paper
  9. [arXiv 2023] Exploring Decision-based Black-box Attacks on Face Forgery Detection Paper
  10. [arXiv 2023] AVA: Inconspicuous Attribute Variation-based Adversarial Attack bypassing DeepFake Detection Paper
  11. [arXiv 2023] Turn Fake into Real: Adversarial Head Turn Attacks Against Deepfake Detection Paper
  12. [CVPR 2022] Exploring Frequency Adversarial Attacks for Face Forgery Detection Paper
  13. [WDCW 2022] Evaluating Robustness of Sequence-based Deepfake Detector Models by Adversarial Perturbation Paper
  14. [ICIP 2021] Imperceptible Adversarial Examples for Fake Image Detection Paper
  15. [CVPRW2021] Adversarial Threats to DeepFake Detection: A Practical Perspective Paper
  16. [WACV 2021] Adversarial Deepfakes: Evaluating Vulnerability of Deepfake Detectors to Adversarial Examples Paper
  17. [CVPRW 2020] Evading Deepfake-Image Detectors with White- and Black-Box Attacks Paper
  18. [ECCVW 2020] Adversarial Attack on Deepfake Detection Using RL Based Texture Patches Paper
  19. [IJCNN 2020] Adversarial Perturbations Fool Deepfake Detectors Paper

Backdoor Attack

  1. [ICLR 2024] Poisoned Forgery Face: Towards Backdoor Attacks on Face Forgery Detection Paper
  2. [arXiv 2024] Is It Possible to Backdoor Face Forgery Detection with Natural Triggers? Paper
  3. [BigDIA 2023] Real is not True: Backdoor Attacks Against Deepfake Detection Paper

Discrepancy Minimization

  1. [AAAI 2024] Spectrum Translation for Refinement of Image Generation (STIG) Based on Contrastive Learning and Spectral Filter Profile Paper
  2. [WACVW 2024] On the Vulnerability of DeepFake Detectors to Attacks Generated by Denoising Diffusion Models Paper
  3. [CVPR 2023] Evading DeepFake Detectors via Adversarial Statistical Consistency Paper
  4. [IEEE Transactions on Dependable and Secure Computing 2023] Making DeepFakes More Spurious: Evading Deep Face Forgery Detection via Trace Removal Attack Paper
  5. [CVPR 2022] Think Twice Before Detecting GAN-generated Fake Images from their Spectral Domain Imprints Paper
  6. [ACM MM 2022] Defeating DeepFakes via Adversarial Visual Reconstruction Paper
  7. [CVPR 2021] Exploring Adversarial Fake Images on Face Manifold Paper
  8. [ACM MM 2020] FakePolisher: Making DeepFakes More Detection-Evasive by Shallow Reconstruction Paper
  9. [arXiv 2020] FakeRetouch: Evading DeepFakes Detection via the Guidance of Deliberate Noise Paper

Defense Strategies

  1. [WACV 2024] D4: Detection of Adversarial Diffusion Deepfakes Using Disjoint Ensembles Paper
  2. [TIFS 2024] DF-RAP: A Robust Adversarial Perturbation for Defending Against Deepfakes in Real-World Social Network Scenarios Paper
  3. [ICMM 2024] Adversarially Robust Deepfake Detection via Adversarial Feature Similarity Learning Paper
  4. [arXiv 2024] XAI-Based Detection of Adversarial Attacks on Deepfake Detectors Paper
  5. [FG 2023] FaceGuard: A Self-Supervised Defense Against Adversarial Face Images Paper
  6. [IEEE Symposium Series on Computational Intelligence 2022] Adversarially Robust Deepfake Video Detection Paper
  7. [Journal of Electronic Imaging 2021] EnsembleDet: ensembling against adversarial attack on deepfake detection Paper
  8. [arXiv 2021] Adversarially robust deepfake media detection using fused convolutional neural network predictions Paper

Efficient Deepfake Detection

  1. [arXiv 2024] Real-Time Deepfake Detection in the Real-World Paper
  2. [CVPR 2024 DFAD Workshop] Faster than lies: Real-time deepfake detection using binary neural networks Paper

Privacy-aware Deepfake Detection

  1. [arXiv 2024] Federated Face Forgery Detection Learning with Personalized Representation Paper
  2. [TIFS 2023] FedForgery: generalized face forgery detection with residual federated learning Paper
  3. [2022 IEEE 24th International Workshop on Multimedia Signal Processing (MMSP)] Deepfake Detection with Data Privacy Protection Paper