Awesome
GenerativeFaceCompletion
Matcaffe implementation of our CVPR17 paper on face completion.
<img src='face_completion.png' width=800> In each panel from left to right: original face, masked input, completion result.Setup
- We use the caffe-for-cudnn-v2.5.48. Please refer Caffe for more installation details.
- Basically, you need to first modify the MATLAB_DIR in Makefile.config and then run the following commands for a successful compilation:
make all -j4
make matcaffe
Training
-
Follow the DCGAN to prepare the data (CelebA). The only differece is that the face we cropped is of size 128x128. Please modify Line 10 in their crop_celebA.lua file. We use the standard train&test split of the CelebA dataset.
-
Modify the training data path in ./matlab/FaceCompletion_training/GFC_caffeinit.m file.
-
Download our face parsing model Model_parsing and put it under ./matlab/FaceCompletion_training/model/ folder.
-
We provide an initial model that is only trained with the reconstruction loss, as a good start point for the subsequent GAN training. Please download it and put it under ./matlab/FaceCompletion_training/model/ folder.
-
Run ./matlab/FaceCompletion_training/demo_GFC_training.m for training.
Testing
- Download our face completion model Model_G and put it under ./matlab/FaceCompletion_testing/model/ folder.
- Run ./matlab/FaceCompletion_testing/demo_face128.m for completion. TestImages are from the CelebA test dataset.
Citation
@inproceedings{GFC-CVPR-2017,
author = {Li, Yijun and Liu, Sifei and Yang, Jimei and Yang, Ming-Hsuan},
title = {Generative Face Completion},
booktitle = {IEEE Conference on Computer Vision and Pattern Recognition},
year = {2017}
}