This model was quantized by SanctumAI. To leave feedback, join our community in Discord. Gemma 2 9B IT GGUF Model creator: google Original model : gemma 2 9b it Model Summary: Gemma is a family of lightweight, state of the art open models from Google, built from the same research and technology used to create the Gemini models. They are text to text, decoder only large language models, available in English, with open weights for both pre trained variants and instruction tuned variants. Gemma models are well suited for a variety of text generation tasks, including question answering, summarization, and reasoning. Their relatively small size makes it possible to deploy them in environments with limited resources such as a laptop, desktop or your own cloud infrastructure, democratizing access to state of the art AI models and helping foster innovation for everyone. Prompt Template: If you're using Sanctum app, simply use Gemma model preset. Prompt template: Hardware Requirements Estimate Name Quant method Size Memory (RAM, vRAM) required gemma 2 9b it.Q2 K.gguf Q2 K 3.81 GB 15.14 GB gemma 2 9b it.Q3 K S.gguf Q3 K S 4.34 GB 15.64 GB gemma 2 9b it.Q3 K M.gguf Q3 K M 4.76 GB 16.04 GB gem…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy