About weighted/imatrix quants of https://huggingface.co/Ewere/Qwen3 30B A3B abliterated erotic For a convenient overview and download list, visit our model page for this model. static quants are available at https://huggingface.co/mradermacher/Qwen3 30B A3B abliterated erotic GGUF Usage If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi part files. Provided Quants (sorted by size, not necessarily quality. IQ quants are often preferable over similar sized non IQ quants) Link Type Size/GB Notes : : : : GGUF i1 Q2 K 11.4 IQ3 XXS probably better GGUF i1 IQ3 XXS 11.9 lower quality GGUF i1 IQ3 XS 12.7 GGUF i1 Q3 K S 13.4 IQ3 XS probably better GGUF i1 IQ3 S 13.4 beats Q3 K GGUF i1 IQ3 M 13.6 GGUF i1 Q3 K M 14.8 IQ3 S probably better GGUF i1 Q3 K L 16.0 IQ3 M probably better GGUF i1 IQ4 XS 16.5 GGUF i1 Q4 0 17.5 fast, low quality GGUF i1 Q4 K S 17.6 optimal size/speed/quality GGUF i1 Q4 K M 18.7 fast, recommended GGUF i1 Q4 1 19.3 GGUF i1 Q5 K S 21.2 GGUF i1 Q5 K M 21.8 GGUF i1 Q6 K 25.2 practically like static Q6 K Here is a handy graph by ikawrakow comparing some lower quality quant types (lower is better):…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy