Qwen3.6 27B MTPLX Optimized Run this with MTPLX MTPLX is an MLX native runtime for native Multi Token Prediction speculative decoding on Apple Silicon. Up to 2.24× faster decode at real coding temperatures ( temp=0.6 / top p=0.95 / top k=20 ) using the model's own built in MTP heads — no external drafter, no greedy hack. Project: github.com/youssofal/MTPLX Other MTPLX checkpoints: Qwen3.6 27B MTPLX Optimized Speed — 4 bit flagship speed (63 TPS on M5 Max) Qwen3.5 4B MTPLX Optimized Speed — small 4 bit speed test Qwen3.5 4B Optimized MTPLX — small 8 bit This artifact pairs the Qwen3.6 27B trunk — MLX quantized with MTPLX's gdn8 speed4 policy (8 bit Gated Delta Network linears, 4 bit MLP, BF16 norms) — with a calibrated INT4 Multi Token Prediction sidecar grafted onto the trunk. The MTP head is what enables native speculative decoding: the model drafts its own tokens, with no external draft model required. MTPLX accepts those draft tokens with mathematically exact probability ratio acceptance and residual correction, so the speculative path stays distribution preserving at realistic coding settings ( temperature=0.6 , top p=0.95 , top k=20 ) — not just greedy. You can also: Inspect t…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy