Qwen3.6 35B A3B GGUF (ShapeLearn Quantized) This is a GGUF quantized version of Qwen3.6 35B A3B produced with ByteShape's ShapeLearn , which learns the optimal datatype per tensor to maintain high quality even at very low bitlengths. To learn more about ShapeLearn and to see detailed benchmarks across GPUs, CPUs, and even the Raspberry Pi, please visit our blog. If you have questions or want to share feedback, reach us on Reddit. Quick Start Pick a model from the tables below and click Get llama.cpp command to get a ready to run command with all the correct sampling parameters for this model. You can also copy the Model Tag from the table and use it directly: Tool Command llama.cpp llama server hf mmproj auto This is a vision capable model. llama.cpp auto downloads the model and vision projector on first run. Once you run the llama server, you can access the web interface at http://localhost: . Note on Ollama: As of this release, Ollama does not support Qwen3.6 35B A3B based on Llama.cpp GGUFs. We suggest using llama.cpp or LM Studio as an alternative. How to Pick a Model We provide CPU and GPU optimized variants for llama.cpp: CPUs: Models labeled as KQ (Q K), optimized for CPU in…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy