Stable Diffusion Inpainting model card ⚠️ This repository is a mirror of the now deprecated ruwnayml/stable diffusion inpainting , this repository or oganization are not affiliated in any way with RunwayML. Modifications to the original model card are in red or green Stable Diffusion Inpainting is a latent text to image diffusion model capable of generating photo realistic images given any text input, with the extra capability of inpainting the pictures by using a mask. The Stable Diffusion Inpainting was initialized with the weights of the Stable Diffusion v 1 2. First 595k steps regular training, then 440k steps of inpainting training at resolution 512x512 on “laion aesthetics v2 5+” and 10% dropping of the text conditioning to improve classifier free classifier free guidance sampling. For inpainting, the UNet has 5 additional input channels (4 for the encoded masked image and 1 for the mask itself) whose weights were zero initialized after restoring the non inpainting checkpoint. During training, we generate synthetic masks and in 25% mask everything. Open In Spaces : : : : Examples: You can use this both with the 🧨Diffusers library and RunwayML GitHub repository ( now deprecat…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy