Awesome
适配了最新版 comfyui 的 py3.11 ，torch 2.3.1+cu121 Mixlab nodes discord
商务合作请联系 389570357@qq.com For business cooperation, please contact email 389570357@qq.com
最新：
-
新增 SimulateDevDesignDiscussions，需要安装swarm和Comfyui-ChatTTS，工作流下载
-
新增 SenseVoice
-
新增API调用图像生成节点 TextToImage Siliconflow，可以直接调用Siliconflow提供的flux生成图像
-
右键菜单支持 text-to-text，方便对 prompt 词补全，支持云LLM或者是本地LLM。
-
增加 MiniCPM-V 2.6 int4
This is the int4 quantized version of MiniCPM-V 2.6. Running with int4 version would use lower GPU memory (about 7GB).
-
移动端适配、修改 app 模式的 Mask 编辑器
-
App 模式增加 batch prompt，批量提示词，可以把动态提示词批量组成后运行
-
增加 API Key Input 节点，用于管理 LLM 的 Key,同时优化 LLM 相关节点，为后续 agent 模式做准备
-
增加 SiliconflowLLM，可以使用由 Siliconflow 提供的免费 LLM
相关插件推荐
<!-- [comfyui-CLIPSeg](https://github.com/shadowcz007/comfyui-CLIPSeg) -->
🚀🚗🚚🏃 Workflow-to-APP
- 新增 AppInfo 节点，可以通过简单的配置，把 workflow 转变为一个 Web APP。
- 支持多个 web app 切换
- 发布为 app 的 workflow，可以在右键里再次编辑了
- web app 可以设置分类，在 comfyui 右键菜单可以编辑更新 web app
- 支持动态提示
- 支持把输出显示到 comfyui 背景（TouchDesigner 风格）
- 如果转为 web app 打开是空白的，注意检查下插件目录的名字需要是：comfyui-mixlab-nodes(如果是 zip 包下载会多了个-main 的后缀，需要去掉)
- Support multiple web app switching.
- Add the AppInfo node, which allows you to transform the workflow into a web app by simple configuration.
- The workflow, which is now released as an app, can also be edited again by right-clicking.
- The web app can be configured with categories, and the web app can be edited and updated in the right-click menu of ComfyUI.
Example:
- workflow
text-to-image
APP-JSON:
- text-to-image
- image-to-image
- text-to-text
暂时支持 9 种节点作为界面上的输入节点：Load Image、VHSLoadVideo、CLIPTextEncode、PromptSlide、TextInput、Color、FloatSlider、IntNumber、CheckpointLoaderSimple、LoraLoader
输出节点：PreviewImage 、SaveImage、ShowTextForGPT、VHS_VideoCombine、PromptImage
seed 统一输入控件，支持：SamplerCustom、KSampler
配套ps 插件
如果遇到上传图片不成功，请检查下：局域网或者是云服务，请使用 https，端口 8189 这个服务（ 感谢 @Damien 反馈问题）
If you encounter difficulties in uploading images, please check the following: for local network or cloud services, please use HTTPS and the service on port 8189. (Thanks to @Damien for reporting the issue.)
🏃🚗🚚🚀 Real-time Design
ScreenShareNode & FloatingVideoNode. Now comfyui supports capturing screen pixel streams from any software and can be used for LCM-Lora integration. Let's get started with implementation and design! 💻🌐
ScreenShareNode & FloatingVideoNode
!! Please use the address with HTTPS (https://127.0.0.1).
SpeechRecognition & SpeechSynthesis
Voice + Real-time Face Swap Workflow
- Preview Audio
GPT
Support for calling multiple GPTs.Local LLM 、 ChatGPT、ChatGLM3 、ChatGLM4 , Some code provided by rui. If you are using OpenAI's service, fill in https://api.openai.com/v1 . If you are using a local LLM service, fill in http://127.0.0.1:xxxx/v1 . Azure OpenAI:https://xxxx.openai.azure.com
- SiliconflowLLM
- ChatGPTOpenAI
Prompt
<!--  -->PromptSlide
randomPrompt
ClipInterrogator
PromptImage & PromptSimplification,Assist in simplifying prompt words, comparing images and prompt word nodes.
ChinesePrompt && PromptGenerate，中文 prompt 节点，直接用中文书写你的 prompt
Layers
A new layer class node has been added, allowing you to separate the image into layers. After merging the images, you can input the controlnet for further processing.
The composite images node overlays a foreground image onto a background image at specified positions and scales, with optional blending modes and masking capabilities. position : 'overall',"center_center","left_bottom","center_bottom","right_bottom","left_top","center_top","right_top"
3D
Image
LoadImagesToBatch
Upload multiple images for batch input into the IP adapter.
LoadImagesFromLocal
Monitor changes to images in a local folder, and trigger real-time execution of workflows, supporting common image formats, especially PSD format, in conjunction with Photoshop.
LoadImagesFromURL
Conveniently load images from a fixed address on the internet to ensure that default images in the workflow can be executed.
TextImage
下载字体放到
custom_nodes/comfyui-mixlab-nodes/assets/fonts
MiniCPM-VQA Simple
This is the int4 quantized version of MiniCPM-V 2.6. Running with int4 version would use lower GPU memory (about 7GB).
Style
Apply VisualStyle Prompting , Modified from ComfyUI_VisualStylePrompting
StyleAligned , Modified from style_aligned_comfy
Utils
The Color node provides a color picker for easy color selection, the Font node offers built-in font selection for use with TextImage to generate text images, and the DynamicDelayByText node allows delayed execution based on the length of the input text.
Other Nodes
- 增加 Edit Mask，方便在生成的时候手动绘制 mask workflow
TransparentImage
FeatheredMask、SmoothMask
Add edges to an image.
LaMaInpainting（需要手动安装）
- simple-lama-inpainting 里的 pillow 造成冲突，暂时从依赖里移除，如果有安装 simple-lama-inpainting ，节点会自动添加，没有，则不会自动添加。
rembgNode
"briarmbg","u2net","u2netp","u2net_human_seg","u2net_cloth_seg","silueta","isnet-general-use","isnet-anime"
_ briarmbg _ model was developed by BRlA Al and can be used as an open-source model for non-commercial purposes
Enhancement
-
Direct "Help" option accessible through node context menu.
-
"Nodes Map" feature added to global context menu.
-
An improvement has been made to directly redirect to GitHub to search for missing nodes when loading the graph.
*** If not needed, you can comment out app.showMissingNodesError in the ui_mixlab.js file.
- Right-click shortcut
右键菜单支持 text-to-text，方便对 prompt 词补全，支持云LLM或者是本地LLM。 The right-click menu supports text-to-text conversion, facilitating prompt word completion, and supports cloud LLMs or local LLMs.
Local LLM API example:http://localhost:1234/v1
Models
-
Download TripoSR and place it in
models/triposr -
Download facebook/dino-vitb16 and place it in
models/triposr/facebook/dino-vitb16
Download rembg Models,move to:models/rembg
Download lama, move to : models/lama
Download Salesforce/blip-image-captioning-base, move to :models/clip_interrogator/Salesforce/blip-image-captioning-base
Download succinctly/text2image-prompt-generator,move to:models/prompt_generator/text2image-prompt-generator
Download Helsinki-NLP/opus-mt-zh-en,move to:models/prompt_generator/opus-mt-zh-en
Installation
manually install, simply clone the repo into the custom_nodes directory with this command:
cd ComfyUI/custom_nodes
git clone https://github.com/shadowcz007/comfyui-mixlab-nodes.git
Install the requirements:
run directly:
cd ComfyUI/custom_nodes/comfyui-mixlab-nodes
install.bat
or install the requirements using:
../../../python_embeded/python.exe -s -m pip install -r requirements.txt
If you are using a venv, make sure you have it activated before installation and use:
pip3 install -r requirements.txt
Chinese community
访问 www.mixcomfy.com，获得更多内测功能，关注微信公众号：Mixlab 无界社区
File / LoadImagesFromPath SaveImageToLocal LoadImagesFromURL