Awesome
PuLID ComfyUI
PuLID ComfyUI native implementation.
Important updates
- 2024.05.12: Added attention masking and the Advanced node, allows fine tuning of the generation.
Notes
The code can be considered beta, things may change in the coming days. In the examples
directory you'll find some basic workflows.
The original implementation makes use of a 4-step lighting UNet. I made a few comparisons with the official Gradio demo using the same model in ComfyUI and I can't see any noticeable difference, meaning that this code should be faithful to the orignal. The Lightning lora doesn't work as well.
Testing other models though I noticed some quality degradation. You may need to experiment with CFG and various samplers/schedulers (try sgm_uniform
).
The quality of the reference image is very important. Maybe this is because of the Eva CLIP that gets more details. Be sure to use a clean and sharp picture!
For IPAdapter compatibility you need to update the IPAdapter extension!
The 'method' parameter
method
applies the weights in different ways. Fidelity
is closer to the reference ID, Style
leaves more freedom to the checkpoint. Sometimes the difference is minimal. I've added neutral
that doesn't do any normalization, if you use this option with the standard Apply node be sure to lower the weight. With the Advanced node you can simply increase the fidelity
value.
The Advanced node has a fidelity
slider and a projection
option. ortho_v2
with fidelity: 8
is the same as fidelity
method in the standard node. Projection ortho
and fidelity: 16
is the same as method style
.
Lower fidelity
values grant higher resemblance to the reference image.
Installation
- PuLID pre-trained model goes in
ComfyUI/models/pulid/
(thanks to Chenlei Hu for converting them into IPAdapter format) - The EVA CLIP is EVA02-CLIP-L-14-336, but should be downloaded automatically (will be located in the huggingface directory).
facexlib
dependency needs to be installed, the models are downloaded at first use- Finally you need InsightFace with AntelopeV2, the unzipped models should be placed in
ComfyUI/models/insightface/models/antelopev2
.