Awesome
Mesekai Unity
<p align="center"> <img src="https://github.com/Neleac/MesekaiUnity/blob/main/public/avatar.PNG" width="45%" /> <img src="https://github.com/Neleac/MesekaiUnity/blob/main/public/world.PNG" width="42.75%" /> </p>Mesekai is a real-time motion tracking virtual avatar application. Use your physical body through webcam video to control the avatar's arms, fingers, head, and facial expressions. It supports personalized ReadyPlayerMe avatars.
The primary use case is Vtubing. Additionally, the motion tracking feature can be applied to a 3rd person online multiplayer game for immersive social interactions. Enter the hub world to try this feature with other players.
Trailer
Mesekai - Webcam Motion Tracking Avatars
Download
Browser Verison
Extended Abstract
Motion Tracking Avatars in Desktop Multiplayer Online Games
Dependencies
This project performs pose estimation using my fork of the MediaPipeUnityPlugin. Refer to the git documentation on setting up submodules. Follow MediaPipeUnityPlugin's instructions to build the plugin. Once successful, move /Packages/com.github.homuler.mediapipe/ and /Assets/StreamingAssets/ into the main project.
Also need git LFS.