Awesome

Lobe Vidol

Experience the magic of virtual idol creation with Lobe Vidol. Enjoy our exquisite UI design, support for MMD dance content, and seamless conversations with characters—all integrated into one cohesive platform.

^{Anyone can create a virtual idol}

English · 简体中文 · 日本語 · Docs · Changelog · Report Bug · Request Feature

<br/> <br>

[!NOTE] Lobe Vidol is currently in the early stages of development and is now open for Beta testing. We welcome you to join us and contribute!

TOC

• 👋🏻 Getting Started & Community
• ✨ Feature Overview
  • 1. Smooth Conversational Experience
  • 2. Background Context Setting
  • 3. Rich Library of Actions and Poses
  • 4. Elegant UI Design
  • 5. Rich Character Editing Experience
  • 6. MMD Dance Support
  • 7. PMX Stage Loading Feature
  • 8. Touch Response Feature
  • 9. Character Marketplace
  • 10. Dance Marketplace
  • 11. TTS & STT Voice Conversations
• 📦 Ecosystem
• ⌨️ Local Development
• 🤝 Contributing
• 🩷 Community Sponsorship
• 🔗 More Tools
  • More Projects
  • Related Links

👋🏻 Getting Started & Community

Lobe Vidol is actively under development. If you have any requests or questions, feel free to submit [issues][issues-link].

	No installation or registration required! Visit our website for a quick experience.
	Join our Discord community! This is where you can interact with developers and other enthusiastic LobeHub users.

[!IMPORTANT]

Star the project to receive all release notifications from GitHub without delay!～⭐️

✨ Feature Overview

1. Smooth Conversational Experience

Streamed responses provide a smooth conversational experience. You can set the dialogue context by placing character actions and expressions in parentheses () and the ongoing events or scenes in square brackets [] to create an immersive experience.

2. Background Context Setting

You can enhance the dialogue by setting a background image that fits the context:

3. Rich Library of Actions and Poses

With a built-in library of Mixamo character actions and poses, you can have characters strike the desired poses or perform actions during conversations:

4. Elegant UI Design

The meticulously designed interface features an elegant appearance and smooth interaction effects, supporting both light and dark themes, and is optimized for mobile devices. It also supports PWA, providing an experience closer to that of a native application.

5. Rich Character Editing Experience

Using the character editor, you can create your own virtual idol, set touch responses, upload VRM models to the site, and interact with them.

6. MMD Dance Support

With the support of mmd-parser, you can dance with your favorite idols using vmd files; Just Dance!

https://github.com/user-attachments/assets/c017be86-dbac-4ce1-9f00-a10248b58621

7. PMX Stage Loading Feature

We have added a stage loading feature with a rich selection of stages, allowing characters to dance with different stage styles:

8. Touch Response Feature

By clicking on different body parts of the character, they will respond differently. You can also edit the character's touch responses to create unique interactive effects:

https://github.com/user-attachments/assets/a283bca0-222c-4ac8-8757-8c56ce3873c2

9. Character Marketplace

The LobeVidol character marketplace gathers a variety of meticulously designed characters, allowing you to experience different contexts and interactions, providing a unique companionship experience. Our marketplace is not just a display platform but a collaborative space where everyone can contribute their imagination and share their personally designed characters.

[!TIP]

With the character creation feature, you can easily submit your character creations to our platform. We emphasize that LobeVidol has established a sophisticated automated internationalization (i18n) workflow, which seamlessly converts your characters into multiple language versions. This means that regardless of the language your users speak, they can experience your characters without barriers.

10. Dance Marketplace

The LobeVidol dance marketplace features a rich collection of MMD dance resources, creating a wealth of visual experiences. You can combine different characters, stages, music, and dances to create a unique viewing experience.

11. TTS & STT Voice Conversations

LobeVidol supports Text-to-Speech (TTS) and Speech-to-Text (STT) technologies, enabling our application to convert text information into clear voice output. Users can interact with our conversational assistant as if they were talking to a real person. Users can choose from a variety of voices to match their assistant with the appropriate sound source. Additionally, for those who prefer auditory learning or want to obtain information while busy, TTS provides an excellent solution.

In LobeVidol, we have carefully selected a range of high-quality voice options (OpenAI Audio, Microsoft Edge Speech) to meet the needs of users from different regions and cultural backgrounds. Users can select suitable voices based on personal preferences or specific scenarios to achieve a personalized communication experience.

📦 Ecosystem

NPM	Repository	Description	Version
@lobehub/ui	lobehub/lobe-ui	An open-source UI component library designed for building AIGC web applications
@lobehub/icons	lobehub/lobe-icons	A collection of SVG logos and icons for mainstream AI / LLM models and companies
@lobehub/tts	lobehub/lobe-tts	A React Hooks library for AI TTS / STT voice synthesis / recognition
@lobehub/lint	lobehub/lobe-lint	LobeHub code style guidelines for ESlint, Stylelint, Commitlint, Prettier, Remark, and Semantic Release

• Vidol market - This is the Market Index of Vidol Chat. Vidol accesses index.json from this repo to show users the list of available agents and dances.
• Vidol agent sample - Vidol character data template
• Vidol dance sample - Vidol dance data template

⌨️ Local Development

You can use GitHub Codespaces for online development:

Or use the following commands for local development:

$ git clone https://github.com/lobehub/lobe-vidol.git
$ cd lobe-vidol
$ bun install
$ bun dev

🤝 Contributing

We warmly welcome contributions in various forms. If you're interested in contributing code, please check out our GitHub Issues and [Projects][github-project-link] to showcase your creativity and skills.

🩷 Community Sponsorship

Every bit of support is incredibly valuable, coming together to form the brilliant galaxy we support! You are like a shooting star that lights up our path forward in an instant. Thank you for your trust — your support acts like a guiding star, repeatedly illuminating the way for the project.

🔗 More Tools

More Projects

• 🤖 Lobe Chat : An open-source, extensible (Function Calling) plugin system, modern design ChatGPT/LLMs chat application and development framework. Supports one-click free deployment of your private ChatGPT/LLMs application.
• 🅰️ Lobe SD Theme: A modern theme for Stable Diffusion WebUI, featuring exquisite interface design, highly customizable UI, and efficiency-enhancing features.
• ⛵️ Lobe Midjourney WebUI: Midjourney WebUI, capable of quickly generating a rich variety of images based on text prompts, inspiring creativity and enhancing dialogue.
• 🌏 Lobe i18n: Lobe i18n is an automation tool for the i18n (internationalization) translation process powered by ChatGPT. It supports automatic splitting of large files, incremental updates, and customizable options for OpenAI models, API proxies, and temperature.

Related Links

• mmd-parser - https://github.com/takahirox/mmd-parser
• three-vrm - https://github.com/pixiv/three-vrm
• tts-vue - https://github.com/LokerL/tts-vue

📝 License

Copyright © 2024 lobehub. <br /> This project is Apache 2.0 licensed.