Home

Awesome

FACSvatar-Blender add-on (FACSvatar)

Blender 2.8x companion add-on to the FACSvatar project. This add-on allows streaming of facial configuration and head pose data (from another computer) into Blender over ZeroMQ sockets, without freezing the interface (publisher-subscriber pattern).

Code working - README in progress

Standalone Blender-outside data transfer - BlendZMQ: https://github.com/NumesSanguis/Blender-ZMQ-add-on

Update

Overview

Blender is very powerful software, but if you run your own code that's a bit heavy, you quickly make the interface unresponsive. I.e freezing the interface. This could be solved with Threading/Async, however, this is difficult due Blender's internal loop (which is more like a game engine). Also, in case of threading, you can't manipulate objects in the main loop of Blender without using e.g. a queue system.

Why not take the program logic and manipulation of data outside Blender, and possibly run heavy code on another PC? Enter ZeroMQ.

ZeroMQ (pyzmq - Python wrapper of ZMQ) is a communication protocol library that allows the sending of data packages between programs (even when written in different languages) by using sockets. Therefore, the data can be send over the network (e.g. TCP), meaning you can even run the software on different machines.

This add-on works by setting a timer function (Blender 2.80+) that checks if a ZeroMQ socket has received a message from outside (using zmq.Poller()). If so, process that data to move selected objects. This timer keeps being invoked until the socket has been disconnected. See for a demonstration:

BlendZMQ demo

Prerequisite

How to use

  1. Download this repository as a .zip by:

  2. Start Blender with Administrator right (at least on Windows) to allow enabling of pip and installing pyzmq (does NOT work with a Snap package install of Blender on Linux, see troubleshooting)

  3. In Blender, add this add-on by selecting Edit -> Preferences -> Add-ons ->

    1. Install... -> select downloaded ZIP from step 1 -> Install Add-on
    2. Search: FACSvatar -> click checkbox to activate

  4. Open side panel in 3D view by

    • Pressing n on your keyboard
    • Dragging < to the left

  5. Click "FACSvatar" -> "Enable pip & install pyzmq" button (if fail, restart Blender and try again (with admin rights))

  6. Create a MB-Lab character (Use EEVEE engine), finalize it and select the character.

  7. In the settings panel, go to Modifier Properties (blue wrench icon) -> mbastlab_subdvision -> Set Subdivisions: Viewport to 0 (for performance reasons)

  8. Click "Connect socket" button. Now it's waiting for data message from FACSvatar.

  9. Follow the instructions over at FACSvatar and send data to port 5572 (the Quickstart setup automatically uses this port).

Troubleshooting

Notes

Acknowledgement