Awesome

<div align="center">  <h3>AnimateZero: Video Diffusion Models are Zero-Shot Image Animators</h3>

Jiwen Yu<sup>1</sup>, Xiaodong Cun<sup>2</sup>, Chenyang Qi<sup>3</sup>, Yong Zhang<sup>2</sup>, Xintao Wang<sup>2</sup>, Ying Shan<sup>2</sup>, Jian Zhang<sup>1</sup>

<sup>1</sup> Peking University, <sup>2</sup> Tencent AI Lab, <sup>3</sup> HKUST

</div>

Gallery

We have showcased some results of image animation using AnimateZero on generated images below.

More results can be found on our Project Page.

<table> <tr> <td><img src="teaser/images/1.jpg" alt="Image 1"></td> <td><img src="teaser/videos/1.gif" alt="Animation 1"></td> <td><img src="teaser/images/2.jpg" alt="Image 2"></td> <td><img src="teaser/videos/2.gif" alt="Animation 1"></td> <td><img src="teaser/images/3.jpg" alt="Image 3"></td> <td><img src="teaser/videos/3.gif" alt="Animation 1"></td> </tr> <tr> <td colspan="2"><center>"1girl, underwater, swimsuit, ..."</center></td> <td colspan="2"><center>"1girl, black jacket, long sleeves, ..."</center></td> <td colspan="2"><center>"dark fantasy, purple eyes, ..."</center></td> </tr> <tr> <td><img src="teaser/images/5.jpg" alt="Image 1"></td> <td><img src="teaser/videos/5.gif" alt="Animation 1"></td> <td><img src="teaser/images/6.jpg" alt="Image 2"></td> <td><img src="teaser/videos/6.gif" alt="Animation 1"></td> <td><img src="teaser/images/141.jpg" alt="Image 3"></td> <td><img src="teaser/videos/141.gif" alt="Animation 1"></td> </tr> <tr> <td colspan="2"><center>"school uniform, JK, sketch, ..."</center></td> <td colspan="2"><center>"pixel art, cat ears, blonde hair, ..."</center></td> <td colspan="2"><center>"a cat head, look to one side"</center></td> </tr> <tr> <td><img src="teaser/images/7.jpg" alt="Image 1"></td> <td><img src="teaser/videos/7.gif" alt="Animation 1"></td> <td><img src="teaser/images/10.jpg" alt="Image 2"></td> <td><img src="teaser/videos/10.gif" alt="Animation 1"></td> <td><img src="teaser/images/153.jpg" alt="Image 3"></td> <td><img src="teaser/videos/153.gif" alt="Animation 1"></td> </tr> <tr> <td colspan="2"><center>"waves hit the beach"</center></td> <td colspan="2"><center>"freckles, orange hair, glasses, ..."</center></td> <td colspan="2"><center>"lighter, flame, candle"</center></td> </tr> </table>

BibTeX

@article{yu2023animatezero,
  title={AnimateZero: Video Diffusion Models are Zero-Shot Image Animators},
  author={Yu, Jiwen and Cun, Xiaodong and Qi, Chenyang and Zhang, Yong and Wang, Xintao and Shan, Ying and Zhang, Jian},
  journal={arXiv preprint arXiv:2312.03793},
  year={2023}
}