Qwen3 TTS GGUF GGUF weights for qwentts.cpp, a C++17/GGML port of Qwen3 TTS 12 Hz (Qwen team, Alibaba). Multilingual zero shot TTS with named speakers and Mandarin dialects, 24 kHz mono. Runs on CPU, CUDA, Metal, Vulkan. Files Two GGUFs load together : qwen talker {size} {mode} {variant}.gguf Qwen3 LM + code predictor MTP head + optional speaker encoder, text 12 Hz codes qwen tokenizer 12hz {variant}.gguf SEANet + ConvNeXt + DAC v2 + RVQ, 12 Hz codes 24 kHz audio Three modes are available across two talker sizes : mode 0.6B 1.7B use case base yes yes zero shot TTS with named speakers and dialects customvoice yes yes zero shot voice cloning from a reference clip voicedesign no yes voice synthesis from attribute description The tokenizer is shared across every talker. variant talker 0.6B talker 1.7B tokenizer use case F32 3.7 GB 7.7 GB 647 MB reference, debug, conversion BF16 1.8 GB 3.9 GB 359 MB source faithful, max precision Q8 0 993 MB 2.1 GB 291 MB recommended default Q4 K M 629 MB 1.2 GB 255 MB lowest VRAM Quick start Backends Set GGML BACKEND to force a device, otherwise the runtime picks the best one available. value target CUDA0 NVIDIA GPU, fastest path on Ada / Blackwell Vul…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy