Qwen3.6-14B-A3B-FableVibes-GGUF

GGUF quantizations of Qwen3.6-14B-A3B-FableVibes, a 14B MoE model fine-tuned on reasoning traces from Claude Fable 5.

Background

This model started as Qwen3.6-35B-A3B-heretic and was pruned via REAP down to ~14B active parameters, removing over half its expert capacity. A single QLoRA pass was then orchestrated entirely by an autonomous AI agent (Steve), utilizing ~4,600 raw reasoning traces from Claude Fable 5 (Mythos-class) to recover capabilities lost during pruning.

Rather than focusing strictly on agentic orchestration, this model serves as a general-purpose reasoning distill. The Fable CoT traces provide structured multi-step reasoning patterns from a frontier-class model, distilled into a footprint that can run on consumer hardware. The Fable traces are further supplemented by Claude Opus reasoning, Qwen tool-calling data, and Evol-Instruct-Code.

Available Formats

Vision support (mmproj files) is included for multimodal use.

Usage

Works with any llama.cpp-compatible backend (llama.cpp, LM Studio, Ollama, text-generation-webui). This model uses Qwen's thinking format -- it will produce reasoning tokens before its response. Give it sufficient generation budget (the reasoning pass typically uses hundreds to thousands of tokens before answering).

llama-cli -m Qwen3.6-14B-A3B-FableVibes-Q4_K_M.gguf \
  --mmproj Qwen3.6-14B-A3B-FableVibes-mmproj-F16.gguf \
  -p "Your prompt here"

Notes

• This is a general-purpose reasoning model. The Fable traces improve structured thinking across domains.
• The pruned base was not pre-fine-tuned before this run -- the Fable LoRA was applied directly to the REAP output.
• Expect longer first-token latency due to the thinking pass, but higher quality reasoning on complex tasks.