Home

Awesome

CORE: COnsistent REpresentation Learning for Face Forgery Detection, CVPRW 22

paper

framework

Dependencies

conda create -n CORE python=3.7
conda activate CORE
conda install pytorch torchvision cudatoolkit=11.3 -c pytorch
pip install -r requirements

Data pre-processing

Some errors that crop real faces in manipulated videos occur whether select the biggest or highest detection probability face by MTCNN, especially when there are two characters in a video. We solved the problem by using the provided video mask in FF++.

Please run python prep_w_mask.py --src-root Your_source_directory --dst-root Your_destination_directory --fake-type Deepfakes[Face2Face, FaceSwap, NeuralTextures, DeepFakeDetection, real]

Quickstart

You can reproduced the in-dataset results in Tab.1 using the following three commands:

<img src="tab1.png" width = "400"/>

For the cross-dataset results in Tab.8, three commands are as follows:

<img src="tab8.png" width = "400"/>

Thanks

  1. We used RFM data augmentations, https://github.com/crywang/RFM
  2. We used DFDC_selim data augmentations, https://github.com/selimsef/dfdc_deepfake_challenge
  3. We modify xception model to output feature, https://github.com/tstandley/Xception-PyTorch

Citation

@InProceedings{Ni_2022_CVPR,
    author    = {Ni, Yunsheng and Meng, Depu and Yu, Changqian and Quan, Chengbin and Ren, Dongchun and Zhao, Youjian},
    title     = {CORE: COnsistent REpresentation Learning for Face Forgery Detection},
    booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
    month     = {June},
    year      = {2022},
    pages     = {12-21}
}