Awesome

<p align="center"> <h2 align="center">MagicAvatar: Multimodal Avatar Generation and Animation</h2> <p align="center"> <a href="http://jeff95.me/"><strong>Jianfeng Zhang*</strong></a> · <a href="https://hanshuyan.github.io/"><strong>Hanshu Yan*</strong></a> · <a href="https://scholar.google.com/citations?user=-4iADzMAAAAJ&hl=en"><strong>Zhongcong Xu*</strong></a> · <a href="https://sites.google.com/site/jshfeng/home"><strong>Jiashi Feng</strong></a> · <a href="https://scholar.google.com.sg/citations?user=8gm-CYYAAAAJ&hl=en"><strong>Jun Hao Liew†</strong></a> <br> ByteDance Inc. <br> </br> <a href="https://arxiv.org/abs/2308.14748"> <img src='https://img.shields.io/badge/arXiv-MagicAvatar-blue' alt='Paper PDF'> </a> <a href='https://magic-avatar.github.io/'> <img src='https://img.shields.io/badge/Project_Page-MagicAvatar-green' alt='Project Page'></a> <a href='https://www.youtube.com/watch?v=UN7W5oKmWNA'> <img src='https://img.shields.io/badge/YouTube-MagicAvatar-red' alt='Project Page'></a> </p> <table align="center"> <td> <video autoplay loop muted src="https://github.com/magic-research/magic-avatar/assetes/8651119/263434155-c953754d-ce75-49ea-80e6-7ea845109577.mp4"></video> </td> </table> </p>

Introducing MagicAvatar, a multi-modal framework capable of converting various input modalities — text, video, and audio — into motion signals that subsequently generate/ animate an avatar.

For more general video editing applications, please also check our latest work <a href="https://magic-edit.github.io/">MagicEdit</a>!

Citing

If you find our work useful, please consider citing:

@inproceedings{zhang2023magicavatar,
    author    = {Zhang, Jianfeng and Yan, Hanshu and Xu, Zhongcong and Feng, Jiashi and Liew, Jun Hao},
    title     = {MagicAvatar: Multi-modal Avatar Generation and Animation},
    booktitle = {arXiv},
    year      = {2023}
}

@inproceedings{liew2023magicedit,
    author    = {Liew, Jun Hao and Yan, Hanshu and Zhang, Jianfeng and Xu, Zhongcong and Feng, Jiashi},
    title     = {MagicEdit: High-Fidelity and Temporally Coherent Video Editing},
    booktitle = {arXiv},
    year      = {2023}
}