granite 4.0 1b speech: transcribe.cpp GGUF GGUF conversions of ibm granite/granite 4.0 1b speech for use with transcribe.cpp. Ported from upstream commit bd87ab8, pinned 2026 05 17. Validated against the Transformers reference at transcribe.cpp commit 275332d on 2026 05 17. Offline multilingual speech to text. IBM Granite Speech 4.0 1b is an audio LLM: a Conformer encoder with block local Shaw attention, a BLIP 2 Q Former projector, and the Granite 4.0 1b base LLM as an autoregressive decoder. Takes a 16 kHz mono WAV and produces a transcript; the LLM half is what writes the text. Transcribes English, French, German, Spanish, Portuguese, and Japanese. Translates between English and each of those five other languages in either direction (en ↔ fr, en ↔ de, en ↔ es, en ↔ pt, en ↔ ja) — always via English, no direct fr↔de etc. Downloads Quantization Download Size WER (LibriSpeech test clean) : : BF16 granite 4.0 1b speech BF16.gguf 4.63 GB 1.42% F16 granite 4.0 1b speech F16.gguf 4.63 GB 1.42% Q8 0 granite 4.0 1b speech Q8 0.gguf 2.56 GB 1.44% Q6 K granite 4.0 1b speech Q6 K.gguf 2.02 GB 1.41% Q5 K M granite 4.0 1b speech Q5 K M.gguf 1.83 GB 1.42% Q4 K M granite 4.0 1b speech Q4 K M.gg…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy