Home

Awesome

Three-D Safari: Learning to Estimate Zebra Pose, Shape, and Texture from Images "In the Wild"

Silvia Zuffi<sup>1</sup>, Angjoo Kanazawa<sup>2</sup>, Tanya Berger-Wolf<sup>3</sup>, Michael J. Black<sup>4</sup>

<sup>1</sup>IMATI-CNR, Milan, Italy, <sup>2</sup>University of California, Berkeley, <sup>3</sup>University of Illinois at Chicago, <sup>4</sup>Max Planck Institute for Intelligent Systems, Tuebingen, Germany

In ICCV 2019

alt text

<p align="center"> <img src="https://github.com/silviazuffi/smalst/blob/master/docs/zebra_video.gif"> </p>

paper

suppmat

Requirements

Installation

Note that the following warning has been issued: "Pillow before 8.1.1 allows attackers to cause a denial of service (memory consumption) because the reported size of a contained image is not properly checked for an ICO container, and thus an attempted memory allocation can be very large."

Setup virtualenv

virtualenv venv_smalst
source venv_smalst/bin/activate
pip install -U pip
deactivate
source venv_smalst/bin/activate
pip install -r requirements.txt

Install Neural Mesh Renderer and Perceptual loss

cd external;
bash install_external.sh

Install SMPL model

download the SMPL model and create a directory smpl_webuser under the smalst/smal_model directory

Download data

The test and validation data are images collected in The Great Grevy's Rally 2018

Place the downloaded network pred_net_186.pth in the folder cachedir/snapshots/smal_net_600/

Usage

See the script in smalst/script directory for training and testing

Notes

The code in this repository is widely based on the project https://github.com/akanazawa/cmr

Citation

If you use this code please cite

@inproceedings{Zuffi:ICCV:2019,
  title = {Three-D Safari: Learning to Estimate Zebra Pose, Shape, and Texture from Images "In the Wild"},
  author = {Zuffi, Silvia and Kanazawa, Angjoo and Berger-Wolf, Tanya and Black, Michael J.},
  booktitle = {International Conference on Computer Vision},
  month = oct,
  year = {2019},
  month_numeric = {10}
}