Home

Awesome

Vid2DensePose

<a target="_blank" href="https://colab.research.google.com/drive/1x77dESn7EGPCqjKdQ1sJJhNu0Cf-5Gpt?usp=sharing"> <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/> </a>

Overview

The Vid2DensePose is a powerful tool designed for applying the DensePose model to videos, generating detailed "Part Index" visualizations for each frame. This tool is exceptionally useful for enhancing animations, particularly when used in conjunction with MagicAnimate for temporally consistent human image animation.

Key Features

Prerequisites

To utilize this tool, ensure the installation of:

Installation Steps

  1. Clone the repository:

    git clone https://github.com/Flode-Labs/vid2densepose.git
    cd vid2densepose
    
  2. Install necessary Python packages:

    pip install -r requirements.txt
    
  3. Clone the Detectron repository:

    git clone https://github.com/facebookresearch/detectron2.git
    

Usage Guide

Run the script:

python main.py -i sample_videos/input_video.mp4 -o sample_videos/output_video.mp4

The script processes the input video and generates an output with the densePose format.

Gradio version

You can also use the Gradio to run the script with an interface. To do so, run the following command:

python app.py

Integration with MagicAnimate

For integration with MagicAnimate:

  1. Create the densepose video using the steps outlined above.
  2. Use this output as an input to MagicAnimate for generating temporally consistent animations.

Acknowledgments

Special thanks to:

Support

For any inquiries or support, please file an issue in our GitHub repository's issue tracker.