Melvin56/Qwen3 4B abliterated GGUF Original Model : huihui ai/Qwen3 4B abliterated Llama.cpp build: 0208355 (5342) I used imatrix to create all these quants using this Dataset. CPU (AVX2) CPU (ARM NEON) Metal cuBLAS rocBLAS SYCL CLBlast Vulkan Kompute : : : : : : : : : : : : : : : : : : : K quants ✅ ✅ ✅ ✅ ✅ ✅ ✅ 🐢5 ✅ 🐢5 ❌ I quants ✅ 🐢4 ✅ 🐢4 ✅ 🐢4 ✅ ✅ Partial¹ ❌ ❌ ❌
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy