Home

Awesome

Graphonomy: Universal Human Parsing via Graph Transfer Learning

This repository contains the code for the paper:

Graphonomy: Universal Human Parsing via Graph Transfer Learning ,Ke Gong, Yiming Gao, Xiaodan Liang, Xiaohui Shen, Meng Wang, Liang Lin.

Environment and installation

Getting Started

Data Preparation

# symlink the Pascal-Person-Part dataset for example
ln -s /path_to_Pascal_Person_Part/* data/datasets/pascal/
/Graphonomy
  /data
    /datasets
      /pascal
        /JPEGImages
        /list
        /SegmentationPart
      /CIHP_4w
        /Images
        /lists
        ...  

Inference

We provide a simply script to get the visualization result on the CIHP dataset using trained models as follows :

# Example of inference
python exp/inference/inference.py  \
--loadmodel /path_to_inference_model \
--img_path ./img/messi.jpg \
--output_path ./img/ \
--output_name /output_file_name

Training

Transfer learning

  1. Download the Pascal pretrained model(available soon).
  2. Run the sh train_transfer_cihp.sh.
  3. The results and models are saved in exp/transfer/run/.
  4. Evaluation and visualization script is eval_cihp.sh. You only need to change the attribute of --loadmodel before you run it.

Universal training

  1. Download the pretrained model and store in /data/pretrained_model/.
  2. Run the sh train_universal.sh.
  3. The results and models are saved in exp/universal/run/.

Testing

If you want to evaluate the performance of a pre-trained model on PASCAL-Person-Part or CIHP val/test set, simply run the script: sh eval_cihp/pascal.sh. Specify the specific model. And we provide the final model that you can download and store it in /data/pretrained_model/.

Models

Pascal-Person-Part trained model

ModelGoogle CloudBaidu Yun
Graphonomy(CIHP)DownloadAvailable soon

CIHP trained model

ModelGoogle CloudBaidu Yun
Graphonomy(PASCAL)DownloadAvailable soon

Universal trained model

ModelGoogle CloudBaidu Yun
UniversalDownloadAvailable soon

Todo:

Citation

@inproceedings{Gong2019Graphonomy,
author = {Ke Gong and Yiming Gao and Xiaodan Liang and Xiaohui Shen and Meng Wang and Liang Lin},
title = {Graphonomy: Universal Human Parsing via Graph Transfer Learning},
booktitle = {CVPR},
year = {2019},
}

Contact

if you have any questions about this repo, please feel free to contact gaoym9@mail2.sysu.edu.cn.

Related work