Qwen3.5 9B abliterated GGUF GGUF quantized versions of lukey03/Qwen3.5 9B abliterated for use with Ollama, llama.cpp, and other GGUF compatible inference engines. Quick Start Text only With Vision Requires Ollama 0.17.1+ . Available Files File Quant Size Description Qwen3.5 9B abliterated vision Q4 K M.gguf Q4 K M ~6.1 GB Vision + Text — abliterated text weights merged into official Qwen3.5 9B with full vision encoder Qwen3.5 9B abliterated Q4 K M.gguf Q4 K M ~5.2 GB Text only — no vision support Qwen3.5 9B abliterated F16.gguf F16 ~17 GB Text only, full precision Vision Model Details Qwen3.5 is natively multimodal — vision is built into every Qwen3.5 model via early fusion training. There is no separate "VL" variant. The vision GGUF was created by: 1. Starting with the official Qwen/Qwen3.5 9B GGUF (883 tensors: 427 text + 441 vision + 15 MTP) 2. Replacing 400 text model tensors with abliterated weights (the remaining 27 text tensors use different quantization types and are not affected by abliteration — they target attn qkv and attn v , while abliteration only modifies o proj / output proj and down proj ) 3. Keeping all 441 vision encoder tensors and 15 MTP (multi token predictio…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy