⚡ Gemma 4 12B Heretic QAT — Q4 0 GGUF Heretic ARA · QAT Lossless Q4 0 · 6.4 GB · Encoder Free Multimodal 📖 中文文档 Q4 0 12B Dense Heretic Uncensored 6.4 GB QAT Weights Encoder Free Uncensored version of Google Gemma 4 12B IT (QAT) , processed with Heretic ARA abliteration. Quantized to Q4 0 matching Unsloth's UD Q4 K XL format — QAT weights trained for 4 bit quantization, near lossless quality. ⚠️ Important Notice: UD Q4 K XL and Google QAT UD Q4 K XL is the UD team's naming convention for its Gemma QAT Q4 0 GGUF variant. The repository or file name must not be interpreted as proof that the model uses mixed K quants. In this release, the actual GGUF tensor information shows that the main model weights are stored as Q4 0 , while normalization and scaling tensors remain in F32 . This model is derived from Google's QAT weights, which were trained for 4 bit quantization. Claims that this file was converted to UD mixed precision, or that its QAT structure was damaged by mixed K quant remapping, are therefore not supported by the actual tensor types contained in the GGUF. Before opening a discussion or reporting a quantization issue, please inspect the GGUF metadata and tensor types first.…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy