Stable Diffusion x2 latent upscaler model card This model card focuses on the latent diffusion based upscaler developed by Katherine Crowson in collaboration with Stability AI. This model was trained on a high resolution subset of the LAION 2B dataset. It is a diffusion model that operates in the same latent space as the Stable Diffusion model, which is decoded into a full resolution image. To use it with Stable Diffusion, You can take the generated latent from Stable Diffusion and pass it into the upscaler before decoding with your standard VAE. Or you can take any image, encode it into the latent space, use the upscaler, and decode it. Note : This upscaling model is designed explicitely for Stable Diffusion as it can upscale Stable Diffusion's latent denoised image embeddings. This allows for very fast text to image + upscaling pipelines as all intermeditate states can be kept on GPU. More for information, see example below. This model works on all Stable Diffusion checkpoints : : Image by Tanishq Abraham from Stability AI originating from this tweet Original output image 2x upscaled output image : : : : Use it with 🧨 diffusers Model Details Developed by: Katherine Crowson Model…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy