Awesome

HiFi4G Dataset

The dataset of the paper "HiFi4G: High-Fidelity Human Performance Rendering via Compact Gaussian Splatting".

HiFi4G: High-Fidelity Human Performance Rendering via Compact Gaussian Splatting

Yuheng Jiang, Zhehao Shen, Penghao Wang, Zhuo Su, Yu Hong, Yingliang Zhang, Jingyi Yu, Lan Xu.

CVPR 2024

[Project Page] [Paper Link] [Dataset Link]

Description

We have currently uploaded 6 sample cases of data with different people and diverse motions. Meanwhile, 3 single-frame data have been uploaded as examples, which you can access without signing the license agreement.

To run algorithms on single-frame data, you need to move the calibration files. For image_white under instant-ngp format, rename the frame folder to images and move transforms.json to the same directory as images. For image_white_undistortion in colmap format, rename the frame folder to images and move the sparse/0 folder to the same directory as images.

The overall file structure is as follows:

├── image_white
│    ├── %d                - The frame number, starts from 0.
│    │   └──%d.png         - Masked RGB images for each view. view number starts from 0.
│    └── transforms.json   - Camera extrinsics and intrinsics in NGP format.
│
├── image_white_undistortion
│    ├── %d                - The frame number, starts from 0.
│    │   └──%d.png         - Undistorted maksed RGB images for each view. view number starts from 0.
│    └── colmap/sparse/0   - Camera extrinsics and intrinsics in Gaussian Splatting format.

Download our dataset

The dataset is publicly accessible at Link. It is authorized for non-commercial use only. For commercial use, please contact Yuheng Jiang (jiangyh2@shanghaitech.edu.cn) and cc Lan Xu(xulan1@shanghaitech.edu.cn) to obtain necessary permissions.

Citation

If you use this dataset for your research, please cite our paper:

@InProceedings{Jiang_2024_CVPR,
 author = {Jiang, Yuheng and Shen, Zhehao and Wang, Penghao and Su, Zhuo and Hong, Yu and Zhang, Yingliang and Yu, Jingyi and Xu, Lan}, 
 title = {HiFi4G: High-Fidelity Human Performance Rendering via Compact Gaussian Splatting}, 
 booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)}, 
 month = {June}, 
 year = {2024}, 
 pages = {19734-19745} 
 }