Nemotron Labs Diffusion VLM 8B Model Overview Nemotron Labs Diffusion VLM 8B is the vision language extension of the Nemotron Labs Diffusion family. It pairs the same tri mode language backbone (AR / diffusion / self speculation, switchable by attention pattern) with a vision encoder, accepting interleaved image + text input and producing text output. The diffusion based parallel decoding from the LM family carries over to VLM: the language head can draft a block in parallel and verify autoregressively against shared KV cache, retaining the family's decode efficiency story while extending it to multimodal prompts. Key Design 8B vision language model in the Nemotron Labs Diffusion family — same tri mode language backbone (AR, diffusion, self speculation) plus a Pixtral style vision encoder. Vision encoder: 24 layer, 1024 hidden, 14×14 patch, supports up to 1540×1540 images with spatial merge size=2 . Language decoder weights match nvidia/Nemotron Labs Diffusion 8B (34 layers, 4096 hidden, 14336 intermediate); the model card structure and inference modes inherit from the LM line. Diffusion based parallel decoding works for multimodal prompts: image tokens are placed in the bidirectio…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy