Home

Awesome

<p align="center"> <a href="" rel="noopener"> <img style=vertical-align:middle; height=150px src="resources/blender_community_badge_white.png" alt="Blender logo"></a> </p> <h1 align="center">VOCA Blender Addon</br><sub></sub></h1>

πŸ“ Table of Contents

πŸ“‹About <a name = "about"></a>

<p align="center" > <img width=80% src="resources\voca_blender_animation.gif" alt="Voca gif"></a> </p> VOCA is a simple and generic speech-driven facial animation framework that works across a range of identities. This add-on integrates VOCA withing Blender and allows the user to:

For more details please see the scientific publication of the VOCA framework here.

The original VOCA framework repository can be found here here.

πŸ‘©β€πŸ’»Installation and Usage <a name="ins-usage"></a>

  1. The add-on works with \Blender v2.92.0 (python 3.7) and requires some dependencies that can be installed directly from the preferences panel.
  2. Download the latest release.
  3. Import the downloaded .zip archive in Blender (Edit > Preferences > Add-ons > Install) and enable the add-on.
  4. Install the dependencies by clicking the dedicated button
  5. The add-on options are accessible in the 3D View side panel named "VOCA"
  6. (optional) If you want to uninstall the addon, you can also uninstall the dependencies from the preferences panel.
<p align="center" > <img style=vertical-align:middle; width=42% src="resources\install.png"></a> <img style=vertical-align:middle; width=40.9% src="resources\uninstall.png"></a> </p> <p align="center" > <img width=48% src="resources\panel_warning.png"></a> </p>

To generate a new sequence of meshes:

  1. Expand the 'Run VOCA Model' panel.
  2. Select the right path for the mesh template (.ply) to animate, the audio file with the speech signal and the desired output directory.
  3. Hit 'Run' and wait the end of the process.
<p align="center" > <img src="resources\panel_run.png"></a> </p>

To import the VOCA-generated meshes and generate the animated mesh:

  1. Expand the 'Import Mesh' panel.
  2. Select the path to the audio file and the output directory.
  3. Hit 'Import' and wait.
<p align="center" > <img src="resources\panel_import.png"></a> </p>

The 'Dev' panel allows you to:

<p align="center" > <img src="resources\panel_dev.png"></a> </p>

πŸ—‚ Project Topology <a name="project-topology"></a>

voca-blender/
β”œβ”€ voca-addon/
β”‚  β”œβ”€ audio/
β”‚  β”‚  β”œβ”€ sentence20.wav
β”‚  β”‚  └─ test_sentence.wav
β”‚  β”œβ”€ flame/
β”‚  β”‚  └─ generic_model.pkl
β”‚  β”œβ”€ model/
β”‚  β”‚  └─ gstep.model.*
β”‚  β”œβ”€ smpl_webuser/
β”‚  β”‚  β”œβ”€ lbs.py
β”‚  β”‚  β”œβ”€ posemapper.py
β”‚  β”‚  β”œβ”€ serialization.py
β”‚  β”‚  └─ verts.py
β”‚  β”œβ”€ template/
β”‚  β”‚  └─ FLAME_sample.ply
β”‚  β”œβ”€ utils/
β”‚  |  β”œβ”€ ctypesloader.py
β”‚  β”‚  β”œβ”€ audio_handler.py
β”‚  β”‚  β”œβ”€ edit_sequences.py
β”‚  β”‚  └─ inference.py
β”‚  β”œβ”€ operators.py
β”‚  β”œβ”€ panels.py
β”‚  └─ __init__.py
β”œβ”€ install-dependencies.command
β”œβ”€ install-dependencies.sh
β”œβ”€ LICENSE
└─ README.md

✍️ Authors <a name = "authors"></a>

πŸŽ‰ Acknowledgements <a name = "acknowledgement"></a>