Additional Comparison between Single- and Two-Stage SDXL pipeline

:::info
Authors:
(1) Dustin Podell, Stability AI, Applied Research;
(2) Zion English, Stability AI, Applied Research;
(3) Kyle Lacey, Stability AI, Applied Research;
(4) Andreas Blattmann, Stability AI, Applied Research;
(5) Tim Dockhorn, Stability AI,…


This content originally appeared on HackerNoon and was authored by Synthesizing

:::info Authors:

(1) Dustin Podell, Stability AI, Applied Research;

(2) Zion English, Stability AI, Applied Research;

(3) Kyle Lacey, Stability AI, Applied Research;

(4) Andreas Blattmann, Stability AI, Applied Research;

(5) Tim Dockhorn, Stability AI, Applied Research;

(6) Jonas Müller, Stability AI, Applied Research;

(7) Joe Penna, Stability AI, Applied Research;

(8) Robin Rombach, Stability AI, Applied Research.

:::

Abstract and 1 Introduction

2 Improving Stable Diffusion

2.1 Architecture & Scale

2.2 Micro-Conditioning

2.3 Multi-Aspect Training

2.4 Improved Autoencoder and 2.5 Putting Everything Together

3 Future Work

\ Appendix

A Acknowledgements

B Limitations

C Diffusion Models

D Comparison to the State of the Art

E Comparison to Midjourney v5.1

F On FID Assessment of Generative Text-Image Foundation Models

G Additional Comparison between Single- and Two-Stage SDXL pipeline

References

G Additional Comparison between Single- and Two-Stage SDXL pipeline

Figure 13: SDXL samples (with zoom-ins) without (left) and with (right) the refinement model discussed. Prompt: (top) “close up headshot, futuristic young woman, wild hair sly smile in front of gigantic UFO, dslr, sharp focus, dynamic composition” (bottom) “Three people having dinner at a table at new years eve, cinematic shot, 8k”. Zoom-in for details.

\

H Comparison between SD 1.5 vs. SD 2.1 vs. SDXL

\ Figure 14: Additional results for the comparison of the output of SDXL with previous versions of Stable Diffusion. For each prompt, we show 3 random samples of the respective model for 50 steps of the DDIM sampler [46] and cfg-scale 8.0 [13]

\ \ \ Figure 15: Additional results for the comparison of the output of SDXL with previous versions of Stable Diffusion. For each prompt, we show 3 random samples of the respective model for 50 steps of the DDIM sampler [46] and cfg-scale 8.0 [13].

\

I Multi-Aspect Training Hyperparameters

We use the following image resolutions for mixed-aspect ratio finetuning as described in Sec. 2.3.

\ \

J Pseudo-code for Conditioning Concatenation along the Channel Axis

\ Figure 16: Python code for concatenating the additional conditionings introduced in Secs. 2.1 to 2.3 along the channel dimension.

\ \ \

:::info This paper is available on arxiv under CC BY 4.0 DEED license.

:::

\


This content originally appeared on HackerNoon and was authored by Synthesizing


Print Share Comment Cite Upload Translate Updates
APA

Synthesizing | Sciencx (2024-10-04T09:00:22+00:00) Additional Comparison between Single- and Two-Stage SDXL pipeline. Retrieved from https://www.scien.cx/2024/10/04/additional-comparison-between-single-and-two-stage-sdxl-pipeline/

MLA
" » Additional Comparison between Single- and Two-Stage SDXL pipeline." Synthesizing | Sciencx - Friday October 4, 2024, https://www.scien.cx/2024/10/04/additional-comparison-between-single-and-two-stage-sdxl-pipeline/
HARVARD
Synthesizing | Sciencx Friday October 4, 2024 » Additional Comparison between Single- and Two-Stage SDXL pipeline., viewed ,<https://www.scien.cx/2024/10/04/additional-comparison-between-single-and-two-stage-sdxl-pipeline/>
VANCOUVER
Synthesizing | Sciencx - » Additional Comparison between Single- and Two-Stage SDXL pipeline. [Internet]. [Accessed ]. Available from: https://www.scien.cx/2024/10/04/additional-comparison-between-single-and-two-stage-sdxl-pipeline/
CHICAGO
" » Additional Comparison between Single- and Two-Stage SDXL pipeline." Synthesizing | Sciencx - Accessed . https://www.scien.cx/2024/10/04/additional-comparison-between-single-and-two-stage-sdxl-pipeline/
IEEE
" » Additional Comparison between Single- and Two-Stage SDXL pipeline." Synthesizing | Sciencx [Online]. Available: https://www.scien.cx/2024/10/04/additional-comparison-between-single-and-two-stage-sdxl-pipeline/. [Accessed: ]
rf:citation
» Additional Comparison between Single- and Two-Stage SDXL pipeline | Synthesizing | Sciencx | https://www.scien.cx/2024/10/04/additional-comparison-between-single-and-two-stage-sdxl-pipeline/ |

Please log in to upload a file.




There are no updates yet.
Click the Upload button above to add an update.

You must be logged in to translate posts. Please log in or register.