Gemma 4 31B IT Assistant — MTP GGUF This repository contains GGUF quantizations of google/gemma 4 31B it assistant to use as MTP. Do not use with llama.cpp as they do not offer support. This model is only compatible with ik llama.cpp. ~~Use only with PR 1744, which enables the gemma 4 MTP to work, otherwise you will encounter errors such as the model failing to load.~~ New: PR is merged. Usage The assistant is a draft model that requires the main Gemma 4 31B target GGUF alongside it. Note: draft max 3 is a good starting point.
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy