These are quantizations of the model Huihui Qwen3 VL 30B A3B Instruct abliterated The imatrix from unsloth has been used for these. Original model: https://huggingface.co/huihui ai/Huihui Qwen3 VL 30B A3B Instruct abliterated Download the latest llama.cpp to use them. Try to use the best quality you can run. For the mmproj, try to use the F32 version as it will produce the best results. F32 BF16 F16.
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy