FLUX.1 dev IP Adapter This repository contains a IP Adapter for FLUX.1 dev model released by researchers from InstantX Team, where image work just like text, so it may not be responsive or interfere with other text, but we do hope you enjoy this model, have fun and share your creative works with us on Twitter. Model Card This is a regular IP Adapter, where the new layers are added into 38 single and 19 double blocks. We use google/siglip so400m patch14 384 to encode image for its superior performance, and adopt a simple MLPProjModel of 2 linear layers to project. The image token number is set to 128. The currently released model is trained on the 10M open source dataset with a batch size of 128 and 80K training steps. Showcases Showcases (LoRA) We adopt Shakker Labs/FLUX.1 dev LoRA collections as a character LoRA and use its default prompt. Inference The code has not been integrated into diffusers yet, please use our local files at this moment. ComfyUI Please refer to ComfyUI IPAdapter Flux. Online Inference You can also enjoy this model at Shakker AI. Limitations This model supports image reference, but is not for fine grained style transfer or character consistency, which means t…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy