shawnw3i/Qwen3.6 27B AWQ MTP Highlights AWQ Marlin kernel supported (auto converted by vLLM at runtime) MTP speculative decoding supported out of the box 110+ tok/s on a single A800 80GB (vLLM 0.21.0, MTP enabled, fp8 KV cache) vLLM
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy