Home

Awesome

<br /> <p align="center"> <h1 align="center"> Towards High-Quality 3D Motion Transfer with Realistic Apparel Animation </h1> <h2 align="center"> MMDMC Dataset </h2> <p align="center"> <img src="assets/main.png"" alt="Overview" width="75%"> </p> <p align="center"> <strong>ECCV, 2024</strong> <br /> <a href="https://github.com/rongakowang"><strong>Rong Wang </strong></a> . <a href="https://github.com/wei-mao-2019"><strong>Wei Mao</strong></a> · <a href="https://github.com/AlanLuSun"><strong>Changsheng Lu</strong></a> · <a href="http://users.cecs.anu.edu.au/~hongdong/"><strong>Hongdong Li</strong></a> </p> <p align="center"> <a href='https://link.springer.com/chapter/10.1007/978-3-031-72933-1_3'> <img src='https://img.shields.io/badge/Paper-PDF-green?style=flat&logo=Googlescholar&logoColor=blue' alt='Paper PDF'> </a> <a href='https://arxiv.org/abs/2407.11266' style='padding-left: 0.5rem;'> <img src='https://img.shields.io/badge/ArXiv-PDF-green?style=flat&logo=arXiv&logoColor=green' alt='ArXiv PDF'> </a> </p> <br />

Installation

conda create -n mmdmc python=3.10
conda activate mmdmc
pip install -r requirements.txt

Download mmd_tools mmd_tools-v2.8.0.zip and extract the zip file into your bpy installation folder.

cp -r mmd_tools /path/to/bpy/3.5/scripts/modules/bpy/scripts/addons/

where path/to/bpy can be located by

python -c "import bpy; print(bpy.__file__)"

Data Preperation

    ├── data
    │   ├── DanceDB
    │   │   │── 20120731_StefanosTheodorou
    │   │   ...
    │   ├── smplh
    │   ├── characters
    │   │   │── char
    │   │   │   │── char.pmx
    │   │   │   │── readme.txt # for per-character license
                ...     

Data Generation

Run below command to dump all vmd pairs for character-motion.

python export.py --extract-vmd

After that, you can generate blend files with the below command.

python export.py --extract-blend

Note that this will generates by default blend files with physics simulation enabled. If you wish to disable simulation (e.g. for training the skinning weight predictor, you should also add arguments --no-physics). The output can be found in data/mmd_blend_dataset.

<p align="center"> <img src="assets/blend.png"" alt="Overview" width="75%"> </p>

[Optional] Reading and processing .blend files in the dataloader can be slow. We therefore provide caching frame infos into pickle files. However, this will require large storage spaces to dump all clips.

python export.py --cache

License

Each character pmx folder contains a README file describes the license and the artists information. We include the original Chinese license and English translation for the general requirement of using this dataset.

Chinese

◆ 允许完善物理,修正模型权重、表情等bug

◆ 允许改色,适度更改衣装,添加spa、toon等

◆ 请勿二次配布,以及拆取部件以用于改造其他模型

◆ 请勿用于18禁作品,极端宗教宣传,血腥恐怖猎奇作品,人身攻击等

◆ 请勿用于商业用途

◆ 他人使用本模型所造成的一切不良后果,不由模型改造者与miHoYo承担,请向使用者追究全部责任

English

◆ Users are allowed to modify models to improve physics, fix model weights, expressions, and other bugs.

◆ Users are allowed to modify models to change colors, moderately modify clothing, and add spa, toon, etc.

◆ Do not redistribute or disassemble parts for use in modifying other models.

◆ Do not use for 18+ content, extreme religious propaganda, gory horror works, personal attacks, etc.

◆ Do not use for commercial purposes.

◆ The artist and miHoYo are not responsible for any negative consequences resulting from the use of this model by others. Users are fully responsible for their actions.

Citation

@inproceedings{wang2025towards,
  title={Towards High-Quality 3D Motion Transfer with Realistic Apparel Animation},
  author={Wang, Rong and Mao, Wei and Lu, Changsheng and Li, Hongdong},
  booktitle={European Conference on Computer Vision},
  pages={35--51},
  year={2025},
  organization={Springer}
}

Acknowledge

We use CharacterAnimationTools for AMASS to BVH conversion and thank the authors for releasing the code.