Qwen3.6 VL REAP 26B A3B W4A16 First REAP+W4A16 release of Qwen/Qwen3.6 35B A3B, retaining the full vision language encoder, optimized for agentic coding and tool use on 24 GB consumer GPUs. 35B → 27B (REAP 25% prune) → W4A16 (INT4) ~3B active per token For the BF16 pruned checkpoint (pre quantization), see atbender/Qwen3.6 VL REAP 26B A3B. Why This Exists Qwen3.6 35B A3B is the best open MoE for agentic coding, but at 67 GB BF16 it doesn't fit a single consumer GPU. Plain quantization (AWQ/GPTQ) gets it down to ~18 GB but doesn't reduce the 256 experts worth of routing overhead. REAP prunes the least activated 25% of experts before quantizing, giving a smaller, faster model with minimal quality loss on the target workload (coding + tool use). There are 100+ quantized versions of Qwen3.6 35B A3B on HF. This is the only one that combines expert pruning + quantization + vision preservation . Model Specifications Property Original REAP Pruned This Model (W4A16) Total Parameters ~35B ~27B ~27B Active Parameters ~3B ~3B ~3B Experts per Layer 256 192 192 Routed per Token 8 8 8 Shared Expert 1/layer 1/layer 1/layer Layers 40 40 40 Vision Encoder Yes Yes Yes (BF16, unquantized) Precision BF…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy