Huihui Qwen3.5 9B abliterated AWQ Model Highlights This model Huihui Qwen3.5 9B abliterated AWQ was converted to AWQ format, from huihui ai/Huihui Qwen3.5 9B abliterated using llm compressor version 0.10.0.1 (https://github.com/vllm project/llm compressor.git). With using dataset wikitext from Salesforce/wikitext & COCO Caption2017 from lmms lab/COCO Caption2017 Datasets: Salesforce/wikitext lmms lab/COCO Caption2017 Base Model: huihui ai/Huihui Qwen3.5 9B abliterated Use with VLLM 1. Download models at first by using hf 2. Copy hash for snapshots directory, then use it for chat templates and tool call parser ex: /home/xxx/.cache/huggingface/hub/models nicklas373 Huihui Qwen3.5 9B abliterated AWQ/snapshots/HASH CODE/xxx 3. Run models with this command huihui ai/Huihui Qwen3.5 9B abliterated This is an uncensored version of Qwen/Qwen3.5 9B created with abliteration (see remove refusals with transformers to know more about it). This is a crude, proof of concept implementation to remove refusals from an LLM model without using TransformerLens. ollama Please use the latest version of ollama v0.17.7 You can use huihui ai/qwen3.5 abliterated:9b directly, Usage Warnings Risk of Sensitive…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy