Read our How to Run Qwen3.5 MTP Guide! To run Qwen3.5 locally Read our Guide! Unsloth Dynamic 2.0 achieves superior accuracy & outperforms other leading quants. NEW: MTP speculative decoding for ~1.5 2x faster generation build llama.cpp from the MTP PR branch has been merged 16th May 2026! Note: llama.cpp renamed spec type mtp to spec type draft mtp on 2026 05 13 Set DGGML CUDA=OFF for CPU/Metal. np 1 and mmproj are not yet supported with MTP. Developer Role Support so Qwen3.5 can work in Codex, OpenCode and more! Tool calling improvements: Makes parsing nested objects to make tool calling succeed more. Disable thinking via chat template kwargs '{"enable thinking":false}' . Read our guide. Mar 5 Update: All GGUFs now use our new imatrix data. See some improvements in chat, coding, long context, and tool calling use cases. Rest of variants like UD K XL are now uploaded. Please follow the correct instructions / settings in our guide here. Qwen3.5 27B [!Note] This repository contains model weights and configuration files for the post trained model in the Hugging Face Transformers format. These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, KTransformers, etc. O…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy