Home

Awesome

FastSDXL

This is an efficient implementation of Stable-Diffusion-XL. I make the following improvements:

Usage

The code is headless. I developed this project based on diffusers==0.21.3. If you find it cannot run with another version of diffusers, please open an issue and tell me.

pip install diffusers safetensors torch gradio

To launch a webui without OLSS scheduler, please run the following command.

python launch_without_olss.py

To train an OLSS scheduler, please see run_olss.py for more details.

I trained an OLSS scheduler with the style of "Slightly Cinematic". You can use it by running the following command.

python launch_with_olss.py

Efficiency of the reconstructed UNet

I tested my code using NVidia 3060 laptop (6G, 85W). The resolution is 1024*1024, and the model is converted to float16 format.

Performance of OLSS scheduler

Here are some examples of OLSS.

Prompt template: cinematic still {prompt}. emotional, harmonious, vignette, highly detailed, high budget, bokeh, cinemascope, moody, epic, gorgeous, film grain, grainy Negative prompt: anime, cartoon, graphic, text, painting, crayon, graphite, abstract, glitch, deformed, mutated, ugly, disfigured

In the image generated by OLSS, the details of flowers on the right are more realistic.

DDIMDPMOLSS
ddimdpmsolverolss

More birds.

DDIMDPMOLSS
ddimdpmsolverolss

In this example, the image generated by OLSS is completely different with others.

DDIMDPMOLSS
ddimdpmsolverolss

Sometimes OLSS can modify the composition and fix the composition error.

DDIMDPMOLSS
ddimdpmsolverolss