Home

Awesome

Awesome Video Diffusion Awesome <!-- omit in toc -->

A curated list of recent diffusion models for video generation, editing, restoration, understanding, nerf, etc.

<p align="center"> <img src="https://makeavideo.studio/assets/overview.webp" width="240px"/> <img src="https://makeavideo.studio/assets/A_teddy_bear_painting_a_portrait.webp" width="240px"/> </p> <p align="center"> <img src="https://tuneavideo.github.io/assets/teaser.gif" width="480px"/> </p> <p align="center"> <img src="https://github.com/ChenyangQiQi/FateZero/blob/main/docs/gif_results/17_car_posche_01_concat_result.gif?raw=true" width="240px"/> <img src="https://github.com/ChenyangQiQi/FateZero/blob/main/docs/gif_results/3_sunflower_vangogh_conat_result.gif?raw=true" width="240px"/> </p> <p align="center"> (Source: <a href="https://makeavideo.studio/">Make-A-Video</a>, <a href="https://tuneavideo.github.io/">Tune-A-Video</a>, and <a href="https://fate-zero-edit.github.io/">Fate/Zero</a>.) </p>

Table of Contents <!-- omit in toc -->

Open-source Toolboxes and Foundation Models

Evaluation Benchmarks and Metrics

Commercial Product

Video Generation

Efficiency for Video Generation

Controllable Video Generation

Motion Customization

Long Video / Film Generation

Video Generation with Physical Prior / 3D

Video Editing

Long-form Video Generation and Completion

Human or Subject Motion

AI Safety for Video Generation

Video Enhancement and Restoration

Audio Synthesis for Video

Talking Head Generation

Human/AI Feedback for Video Generation

Policy Learning with Video Generation

Try On with Video Generation

3D / NeRF

4D

Game Generation

Rendering with Virtual Engine

Open-World Model

Video Understanding

Unified Model for Generation and Understanding

Healthcare and Biology