About weighted/imatrix quants of https://huggingface.co/zaakirio/gemma 4 12b it uncensored For a convenient overview and download list, visit our model page for this model. static quants are available at https://huggingface.co/mradermacher/gemma 4 12b it uncensored GGUF This is a vision model mmproj files (if any) will be in the static repository. Usage If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi part files. Provided Quants (sorted by size, not necessarily quality. IQ quants are often preferable over similar sized non IQ quants) Link Type Size/GB Notes : : : : GGUF imatrix 0.1 imatrix file (for creating your own quants) GGUF i1 IQ1 S 3.1 for the desperate GGUF i1 IQ1 M 3.3 mostly desperate GGUF i1 IQ2 XXS 3.7 GGUF i1 IQ2 XS 4.0 GGUF i1 IQ2 S 4.2 GGUF i1 IQ2 M 4.5 GGUF i1 Q2 K S 4.6 very low quality GGUF i1 Q2 K 4.9 IQ3 XXS probably better GGUF i1 IQ3 XXS 4.9 lower quality GGUF i1 IQ3 XS 5.4 GGUF i1 IQ3 S 5.6 beats Q3 K GGUF i1 Q3 K S 5.6 IQ3 XS probably better GGUF i1 IQ3 M 5.8 GGUF i1 Q3 K M 6.2 IQ3 S probably better GGUF i1 Q3 K L 6.7 IQ3 M probably better GGUF i1 IQ4 XS 6.7 GGUF i1 IQ4 NL 7.1…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy