parakeet ctc 0.6b: transcribe.cpp GGUF GGUF conversions of nvidia/parakeet ctc 0.6b for use with transcribe.cpp. Ported from upstream commit ad09ba1, pinned 2026 05 10. Validated against the NeMo reference at transcribe.cpp commit 42528dd on 2026 05 10. Offline English speech to text with greedy CTC decoding. A 0.6B parameter FastConformer Large encoder with a linear CTC head — the simplest and fastest decoder in the parakeet family. Output is lowercase, no punctuation. Not a streaming model and does not translate. Downloads Quantization Download Size WER (LibriSpeech test clean) : : F32 parakeet ctc 0.6b F32.gguf 2.44 GB 1.87% F16 parakeet ctc 0.6b F16.gguf 1.22 GB 1.87% Q8 0 parakeet ctc 0.6b Q8 0.gguf 722 MB 1.87% Q6 K parakeet ctc 0.6b Q6 K.gguf 594 MB 1.84% Q5 K M parakeet ctc 0.6b Q5 K M.gguf 533 MB 1.87% Q4 K M parakeet ctc 0.6b Q4 K M.gguf 469 MB 1.90% WER measured on the full LibriSpeech test clean split (2620 utterances) with greedy CTC decoding and no external LM. F32 reference baseline: 1.87%. NVIDIA's self reported number on the same split is 1.87%. Usage Build transcribe.cpp from source: Run on a 16 kHz mono WAV: If your audio isn't already 16 kHz mono WAV, convert it…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy