Awesome
:sound: Soundini: Sound-Guided Diffusion for Natural Video Editing
This is the official code of the project, Soundini: Sound-Guided Diffusion for Natural Video Editing. Given video, you can modifiy the appearance of video solely based on audio. We leverage two types of the pre-trained models, DDPMs and CLIP (sound-aligned).
Paper, Project Page <br>