SmolVLM 500M SmolVLM 500M is a tiny multimodal model, member of the SmolVLM family. It accepts arbitrary sequences of image and text inputs to produce text outputs. It's designed for efficiency. SmolVLM can answer questions about images, describe visual content, or transcribe text. Its lightweight architecture makes it suitable for on device applications while maintaining strong performance on multimodal tasks. It can run inference on one image with 1.23GB of GPU RAM. Model Summary Developed by: Hugging Face 🤗 Model type: Multi modal model (image+text) Language(s) (NLP): English License: Apache 2.0 Architecture: Based on Idefics3 (see technical summary) Resources Demo: SmolVLM 256 Demo Blog: Blog post Uses SmolVLM can be used for inference on multimodal (image + text) tasks where the input comprises text queries along with one or more images. Text and images can be interleaved arbitrarily, enabling tasks like image captioning, visual question answering, and storytelling based on visual content. The model does not support image generation. To fine tune SmolVLM on a specific task, you can follow the fine tuning tutorial. Evaluation Technical Summary SmolVLM leverages the lightweight…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy