Awesome
Learning Neural Volumetric Representations of Dynamic Humans in Minutes
Project Page | Video | Paper | Data
Learning Neural Volumetric Representations of Dynamic Humans in Minutes
Chen Geng*, Sida Peng*, Zhen Xu*, Hujun Bao, Xiaowei Zhou (* denotes equal contribution)
CVPR 2023
Installation
See here.
Reproducing results in the paper
We provide two scripts to help reproduce the results shown in the paper.
After installing the environment and the dataset, for evaluation on the ZJU-MoCap dataset, run:
sh scripts/eval_zjumocap.sh
For evaluation on the MonoCap dataset, run:
sh scripts/eval_monocap.sh
Evaluation on ZJU-MoCap
Let's take "377" as an example.
Training on ZJU-MoCap can be done by running.
export name=377
python train_net.py --cfg_file configs/inb/inb_${name}.yaml exp_name inb_${name} gpus ${GPUS}
Evaluation can be done by running:
export name=377
python run.py --type evaluate --cfg_file configs/inb/inb_${name}.yaml exp_name inb_${name} gpus ${GPUS}
Evaluation on MonoCap
Let's take "lan" as an example.
Training on Monocap can be done by running:
export name=lan
python train_net.py --cfg_file configs/inb/inb_${name}.yaml exp_name inb_${name} gpus ${GPUS}
Evaluation can be done by running:
export name=lan
python run.py --type evaluate --cfg_file configs/inb/inb_${name}.yaml exp_name inb_${name} gpus ${GPUS}
TODO List
This repository currently serves as the release of the technical paper's implementation and will undergo future updates (planned below) to enhance user-friendliness. We warmly welcome and appreciate any contributions.
- Instruction on running on custom datasets (Kudos to @tian42chen!!)
- Add support for further acceleration using CUDA
- Add a Google Colab notebook demo
Bibtex
If you find the repo useful for your research, please consider citing our paper:
@inproceedings{instant_nvr,
title={Learning Neural Volumetric Representations of Dynamic Humans in Minutes},
author={Chen Geng and Sida Peng and Zhen Xu and Hujun Bao and Xiaowei Zhou},
booktitle={CVPR},
year={2023}
}