Qwen3.6 35B A3B MTP GGUF (ShapeLearn Quantized) This is a GGUF quantized version of Qwen3.6 35B A3B with Multi Token Prediction (MTP) support, produced with ByteShape's ShapeLearn , which learns the optimal datatype per tensor to maintain high quality even at very low bitlengths. MTP allows the model to predict multiple tokens per forward pass, accelerating decoding on GPUs by accepting speculative tokens that match what the base model would have produced. These models are optimized for GPU only inference. To learn more about ShapeLearn and to see detailed benchmarks across GPUs, please visit our blog. If you have questions or want to share feedback, reach us on Reddit. Quick Start Pick a model from the table below and click Get llama.cpp command to get a ready to run command with all the correct sampling parameters for this model. You can also copy the Model Tag from the table and use it directly: Tool Command llama.cpp llama server hf mmproj auto spec type draft mtp spec draft n max 4 This is a vision capable model. llama.cpp auto downloads the model and vision projector on first run. The MTP head is bundled inside the GGUF, so no separate draft model is required — just pass spec…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy