SmolVLM SmolVLM is a compact open multimodal model that accepts arbitrary sequences of image and text inputs to produce text outputs. Designed for efficiency, SmolVLM can answer questions about images, describe visual content, create stories grounded on multiple images, or function as a pure language model without visual inputs. Its lightweight architecture makes it suitable for on device applications while maintaining strong performance on multimodal tasks. Model Summary Developed by: Hugging Face 🤗 Model type: Multi modal model (image+text) Language(s) (NLP): English License: Apache 2.0 Architecture: Based on Idefics3 (see technical summary) Resources Demo: SmolVLM Demo Blog: Blog post Uses SmolVLM can be used for inference on multimodal (image + text) tasks where the input comprises text queries along with one or more images. Text and images can be interleaved arbitrarily, enabling tasks like image captioning, visual question answering, and storytelling based on visual content. The model does not support image generation. To fine tune SmolVLM on a specific task, you can follow the fine tuning tutorial. Technical Summary SmolVLM leverages the lightweight SmolLM2 language model t…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy