Home

Awesome

šŸ£ Please follow me for new updates https://twitter.com/camenduru <br /> šŸ”„ Please join our discord server https://discord.gg/k5BwmmvJJU <br /> šŸ„³ Please join my patreon community https://patreon.com/camenduru <br />

šŸšØ Stable Diffusion WebUI Colabs With ControlNet

https://github.com/camenduru/stable-diffusion-webui-colab

šŸš¦ WIP šŸš¦

šŸšØ Only 1.5 base models may work right now

šŸ¦’ Colab

Colab PageModel Page
Open In Colab stable_diffusion_controlnet_colabhttps://huggingface.co/CompVis/stable-diffusion-v-1-4-original
Open In Colab waifu_diffusion_controlnet_colabhttps://huggingface.co/hakurei/waifu-diffusion-v1-3
šŸš§ Open In Colab stable_diffusion_inpainting_controlnet_colabhttps://huggingface.co/runwayml/stable-diffusion-inpainting
Open In Colab stable_diffusion_1_5_controlnet_colabhttps://huggingface.co/runwayml/stable-diffusion-v1-5
Open In Colab mo_di_diffusion_controlnet_colab (Use the tokens modern disney style in your prompts for the effect.)https://huggingface.co/nitrosocke/mo-di-diffusion
Open In Colab arcane_diffusion_3_controlnet_colab (Use the tokens arcane style in your prompts for the effect.)https://huggingface.co/nitrosocke/Arcane-Diffusion
Open In Colab cyberpunk_anime_diffusion_controlnet_colab (Use the tokens dgs illustration style in your prompts for the effect.)https://huggingface.co/DGSpitzer/Cyberpunk-Anime-Diffusion
Open In Colab midjourney_v4_diffusion_controlnet_colab (Use the tokens mdjrny-v4 style in your prompts for the effect.)https://huggingface.co/prompthero/midjourney-v4-diffusion
Open In Colab papercut_diffusion_controlnet_colab (Use the tokens PaperCut in your prompts for the effect.)https://huggingface.co/Fictiverse/Stable_Diffusion_PaperCut_Model
Open In Colab samdoesart_diffusion_controlnet_colab (Use the tokens SamDoesArt in your prompts for the effect.)https://huggingface.co/Sandro-Halpo/SamDoesArt-V3
Open In Colab anything_3_controlnet_colabhttps://huggingface.co/ckpt/anything-v3.0
Open In Colab woolitize_controlnet_colab (Use the tokens woolitize style in your prompts for the effect.)https://huggingface.co/plasmo/woolitize
Open In Colab inkpunk_controlnet_colab (Use the tokens nvinkpunk style in your prompts for the effect.)https://huggingface.co/Envvi/Inkpunk-Diffusion
Open In Colab rando_mix_3_controlnet_colabhttps://huggingface.co/sentet1c/RandoMix3 (Thanks to Sint for the suggestion ā¤)
Open In Colab f222_controlnet_colabhttps://huggingface.co/lilpotat/f2
Open In Colab berry_mix_1_5_controlnet_colabhttps://huggingface.co/lilpotat/rbm
šŸš§ Open In Colab stable_diffusion_v2_1_controlnet_colabhttps://huggingface.co/stabilityai/stable-diffusion-2-1
šŸš§ Open In Colab stable_diffusion_v2_1_base_controlnet_colabhttps://huggingface.co/stabilityai/stable-diffusion-2-1-base
šŸš§ Open In Colab stable_diffusion_v2_controlnet_colabhttps://huggingface.co/stabilityai/stable-diffusion-2
šŸš§ Open In Colab stable_diffusion_v2_base_controlnet_colabhttps://huggingface.co/stabilityai/stable-diffusion-2-base
šŸš§ Open In Colab stable_diffusion_v2_depth_controlnet_colabhttps://huggingface.co/stabilityai/stable-diffusion-2-depth
šŸš§ Open In Colab stable_diffusion_v2_inpainting_controlnet_colabhttps://huggingface.co/stabilityai/stable-diffusion-2-inpainting
Open In Colab hassan_blend_1_4_controlnet_colabhttps://huggingface.co/hassanblend/hassanblend1.4 (Thanks to maximaljahn for the suggestion ā¤)
Open In Colab yiffy_e18_controlnet_colabhttps://huggingface.co/Doubleyobro/yiffy-e18
Open In Colab pony_diffusion_2_controlnet_colabhttps://huggingface.co/AstraliteHeart/pony-diffusion-v2
Open In Colab elysium_anime_2_controlnet_colabhttps://huggingface.co/hesw23168/SD-Elysium-Model
Open In Colab eimis_anime_diffusion_1_controlnet_colabhttps://huggingface.co/eimiss/EimisAnimeDiffusion_1.0v (Thanks to Tjbr0ss2 for the suggestion ā¤)
Open In Colab dreamlike_diffusion_1_controlnet_colab (Use the tokens dreamlikeart style in your prompts for the effect.)https://huggingface.co/dreamlike-art/dreamlike-diffusion-1.0
Open In Colab van_gogh_diffusion_controlnet_colab (Use the tokens lvngvncnt style in your prompts for the effect.)https://huggingface.co/dallinmackay/Van-Gogh-diffusion
Open In Colab analog_diffusion_controlnet_colab (Use the tokens analog style in your prompts for the effect.)https://huggingface.co/wavymulder/Analog-Diffusion
Open In Colab monstermash_any_3_controlnet_colabhttps://huggingface.co/N75242/monstermash_anyv3
Open In Colab yohan_diffusion_controlnet_colabhttps://huggingface.co/andite/yohan-diffusion (Thanks to EBIX_benis for the suggestion ā¤)
Open In Colab openjourney_v2_diffusion_controlnet_colabhttps://huggingface.co/prompthero/openjourney-v2
Open In Colab vintedois_diffusion_0_1_controlnet_colab (Use the tokens estilovintedois in your prompts for the effect.)https://huggingface.co/22h/vintedois-diffusion-v0-1
Open In Colab knollingcase_controlnet_colab (Use the tokens knollingcase in your prompts for the effect.)https://huggingface.co/Aybeeceedee/knollingcase
Open In Colab comic_diffusion_v2_controlnet_colab (Use the tokens charliebo artstyle holliemengert artstyle marioalberti artstyle pepelarraz artstyle andreasrocha artstyle jamesdaly artstyle in your prompts for the effect.)https://huggingface.co/ogkalu/Comic-Diffusion
Open In Colab complex_lineart_controlnet_colab (Use the tokens ComplexLA style in your prompts for the effect.)https://huggingface.co/Conflictx/Complex-Lineart
Open In Colab synthwave_punk_v2_controlnet_colab (Use the tokens snthwve style nvinkpunk in your prompts for the effect.)https://huggingface.co/ItsJayQz/SynthwavePunk-v2
Open In Colab illustration_diffusion_controlnet_colab (Use the tokens holliemengert artstyle in your prompts for the effect.)https://huggingface.co/ogkalu/Illustration-Diffusion
Open In Colab seek_art_mega_v1_controlnet_colabhttps://huggingface.co/coreco/seek.art_MEGA
Open In Colab popup_book_diffusion_controlnet_colab (Use the tokens popupBook in your prompts for the effect.)https://huggingface.co/RayHell/popupBook-diffusion
Open In Colab riffusion_v1_controlnet_colab (Use with Script -> Riffusion Audio Generator)https://huggingface.co/riffusion/riffusion-model-v1 (Thanks to Neverstorm for the suggestion ā¤)
šŸš§ Open In Colab waifu_diffusion_v1_4_controlnet_colabhttps://huggingface.co/hakurei/waifu-diffusion-v1-4
Open In Colab protogen_v2_2_controlnet_colabhttps://huggingface.co/ckpt/Protogen_V2.2
Open In Colab elldreths_lucid_mix_v10_controlnet_colabhttps://huggingface.co/ckpt/elldrethSLucidMix_v10
Open In Colab all_in_one_pixel_model_controlnet_colab (Use the tokens pixelsprite 16bitscene in your prompts for the effect.)https://huggingface.co/PublicPrompts/All-In-One-Pixel-Model
Open In Colab cafe_instagram_v6_controlnet_colabhttps://huggingface.co/cafeai/cafe-instagram-sd-1-5-v6
Open In Colab cinematic_diffusion_controlnet_colab (Use the tokens syberart in your prompts for the effect.)https://huggingface.co/Basunat/Cinematic-Diffusion
Open In Colab food_crit_controlnet_colab (Use the tokens food_crit in your prompts for the effect.)https://huggingface.co/plasmo/food-crit
Open In Colab simpmaker_3k_controlnet_colabhttps://huggingface.co/AmethystVera/SimpMaker-3K1
šŸš§ Open In Colab duchaitenaiart_v1_1_controlnet_colabhttps://huggingface.co/DucHaiten/DucHaitenAIart (Thanks to DucHaiten for the suggestion ā¤)
Open In Colab uber_realistic_v1_controlnet_colabhttps://huggingface.co/lilpotat/urp (Thanks to cdefghijkl for the suggestion ā¤)
Open In Colab izumi_v1_controlnet_colabhttps://huggingface.co/lilpotat/iz
Open In Colab yiffy_mix_controlnet_colabhttps://civitai.com/models/3671/yiffymix
Open In Colab babes_blend_controlnet_colabhttps://civitai.com/models/2220/babes
Open In Colab samdoessexy_blend_controlnet_colabhttps://civitai.com/models/1180/samdoessexy-blend
Open In Colab comics_blend_controlnet_colab (Use the tokens ComplexLA style nvinkpunk marioalberti artstyle ghibli style in your prompts for the effect.)https://civitai.com/models/1491/comicsblend
Open In Colab dream_like_sam_kuvshino_controlnet_colabhttps://civitai.com/models/1473/dreamlikesamkuvshinov
Open In Colab 8528_diffusion_controlnet_colabhttps://huggingface.co/852wa/8528-diffusion (Thanks to é»„č‰²ć„ćƒćƒ© for the suggestion ā¤)
Open In Colab hasdx_controlnet_colabhttps://civitai.com/models/3758/hasdx (Thanks to EBIX_benis for the suggestion ā¤)
Open In Colab abyss_orange_mix_2_controlnet_colabhttps://huggingface.co/WarriorMama777/OrangeMixs
Open In Colab dreamlike_photoreal_2_controlnet_colabhttps://huggingface.co/dreamlike-art/dreamlike-photoreal-2.0
Open In Colab photorealistic_fuen_v1_controlnet_colabhttps://huggingface.co/claudfuen/photorealistic-fuen-v1
šŸš§ Open In Colab cool_japan_diffusion_2_1_controlnet_colabhttps://huggingface.co/aipicasso/cool-japan-diffusion-2-1-0
Open In Colab anything_gape_controlnet_colabhttps://huggingface.co/Inzamam567/AnyGape (Thanks to soliwoli for the suggestion ā¤)
Open In Colab anything_4_controlnet_colabhttps://huggingface.co/andite/anything-v4.0
Open In Colab counterfeit_v2_0_controlnet_colabhttps://huggingface.co/gsdf/Counterfeit-V2.0 (Thanks to é»„č‰²ć„ćƒćƒ© for the suggestion ā¤)
Open In Colab grapefruit_controlnet_colabhttps://huggingface.co/ckpt/grapefruit
Open In Colab open_anime_journey_controlnet_colabhttps://huggingface.co/MehjourneyClosedAI/OpenAnimeJourney (Thanks to é»„č‰²ć„ćƒćƒ© for the suggestion ā¤)
Open In Colab a_certainty_controlnet_colabhttps://huggingface.co/JosephusCheung/ACertainty
Open In Colab a_certain_model_controlnet_colabhttps://huggingface.co/JosephusCheung/ACertainModel
Open In Colab a_certain_thing_controlnet_colabhttps://huggingface.co/JosephusCheung/ACertainThing
šŸš§ Open In Colab 7th_layer_controlnet_colabhttps://huggingface.co/syaimu/7th_Layer (Thanks to Cherryblossomoflove for the suggestion ā¤)
šŸš§ Open In Colab rpg_v4_controlnet_colabhttps://huggingface.co/Anashel/rpg (Thanks to brunocalado for the suggestion ā¤)
šŸš§ Open In Colab waifu_diffusion_v1_5_controlnet_colabhttps://huggingface.co/waifu-diffusion/wd-1-5-beta
šŸš§ Open In Colab protogen_nova_controlnet_colabhttps://huggingface.co/darkstorm2150/Protogen_Nova_Official_Release (Thanks to alvaromaltrain for the suggestion ā¤)
šŸš§ Open In Colab protogen_x3_4_controlnet_colabhttps://huggingface.co/darkstorm2150/Protogen_x3.4_Official_Release (Thanks to alvaromaltrain for the suggestion ā¤)

Main Repo

https://github.com/lllyasviel/ControlNet thanks to https://twitter.com/lvminzhang ā¤

Paper

https://github.com/lllyasviel/ControlNet/raw/main/github_page/control.pdf

Modified Code

https://huggingface.co/spaces/hysts/ControlNet-with-other-models thanks to https://twitter.com/hysts12321 ā¤

Extracted ControlNet weights

https://huggingface.co/kohya-ss/ControlNet-diff-modules/tree/main thanks to https://twitter.com/kohya_tech ā¤ <br /> https://huggingface.co/webui/ControlNet-modules-safetensors/tree/main thanks to https://github.com/ClashSAN ā¤

License

https://github.com/lllyasviel/ControlNet/blob/main/LICENSE <br /> https://huggingface.co/spaces/hysts/ControlNet-with-other-models/blob/main/LICENSE