Adèlic Gemma 4 12B (GGUF) This repository contains the GGUF quantized weights for google/gemma 4 12B, specifically optimized and patched to run on the experimental Adèlic Condense infinite context engine. 🛠️ Changelog (V2 Patch) Native ChatML Integration: Addressed a bug where the model would occasionally hallucinate fake user dialogue (e.g., user ). This was traced to a mismatch between the base Gemma templates and the model's SFT format. The industry standard ChatML Jinja2 template is now permanently baked into the GGUF metadata, allowing standard engines (and Ollama) to automatically parse the conversational stops natively. Native Multimodal Suppression: The and generation hallucination bug has been permanently eradicated via the Adèlic engine and Hugging Face generation configurations. 🚀 The Adèlic Project This model is designed to be run on a custom fork of llama.cpp that features the Adèlic KV Condenser . The Adèlic engine utilizes a specialized CUDA kernel that continuously evaluates the cosine similarity of tokens inside the KV cache. By aggressively pruning older, redundant historical tokens (similarity 0.999) from the value cache on every single layer, the engine theore…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy