Awesome
Simulated garment dataset for virtual try-on
This repository contains the dataset used in the following papers:
-
Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-On (CVPR 2021) [Project website] [Video]
-
Learning-Based Animation of Clothing for Virtual Try-On (Eurographics 2019) [Project website] [Video]
Dataset
The data is generated used a modified version of ARCSim and sequences from the CMU Motion Capture Database converted to SMPL format in SURREAL. Each simulated sequence is stored as a .pkl file that contains the following data:
| Key | Description | Dimension |
|---|---|---|
| shapes | SMPL shape coefficients | [num_frames, 10] |
| poses | SMPL pose coefficients | [num_frames, 75] |
| vertices | Vertices of the simulated garment | [num_frames, num_vertices, 3] |
| faces | Faces of the garment | [num_faces, 3] |
| sequence | Sequence identifier | |
| subject | Subject identifier | |
| conf | ARCSim configuration |
Sequences
The dataset contains a diverse selection of motions:
| Motion | Sequence ID |
|---|---|
| Walking | 07_02, 91_62, 91_33, 91_36, 91_19, 91_12, 76_11, 73_09, 46_01, 111_14, 105_05, 104_17 |
| Running | 128_02, 128_03, 128_04, 128_05, 128_06, 128_07, 108_11, 108_12, 108_27, 104_04, 104_53, 104_54 |
| Jumping | 01_01, 91_61, 91_38, 49_04, 108_16, 108_17, 108_18, 108_20, 13_13, 02_04 |
| Arm movements | 55_27, 54_24, 40_12, 144_26, 144_30, 135_09, 132_54, 111_20, 111_37, 02_05 |
| Torso movements | 63_25, 144_28, 111_02, 108_22, 26_11, 135_07 |
| Dancing | 05_20, 55_12, 131_03, 111_05 |
| Others | 76_05, 104_11 |
Extract meshes
Requirements: python3, numpy-1.21.3
To extract the simulated garment meshes as .obj run the following script:
python extract_meshes.py tshirt/simulations/tshirt_shape00_01_01.pkl
Same for the dress:
python extract_meshes.py dress/simulations/dress_shape00_01_01.pkl
Citation
If you find this dataset useful please cite our work:
@article {santesteban2021garmentcollisions,
journal = {IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
title = {{Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-On}},
author = {Santesteban, Igor and Thuerey, Nils and Otaduy, Miguel A and Casas, Dan},
year = {2021}
}
@article {santesteban2019virtualtryon,
journal = {Computer Graphics Forum (Proc. Eurographics)},
title = {{Learning-Based Animation of Clothing for Virtual Try-On}},
author = {Santesteban, Igor and Otaduy, Miguel A. and Casas, Dan},
year = {2019},
ISSN = {1467-8659},
DOI = {10.1111/cgf.13643}
}