Granite 4.1 30B AWQ INT4 INT4 weight only quantization of ibm granite/granite 4.1 30b . First public 4 bit AWQ of IBM Granite 4.1 30B. Apache 2.0. Loads on a single 24 GB consumer GPU. Property Value Base model ibm granite/granite 4.1 30b Quantization INT4 weight only Approx. on disk size ~15.5 GB Languages English Load (vLLM) Footprint ~15.5 GB on disk. Recommended VRAM: enough headroom for KV cache. License & attribution This artifact is a derivative work of ibm granite/granite 4.1 30b , released by its original authors under the Apache License, Version 2.0 . This artifact is distributed under the same license. The full license text is included in LICENSE , and required attribution is in NOTICE . License text: https://www.apache.org/licenses/LICENSE 2.0 Source model: https://huggingface.co/ibm granite/granite 4.1 30b
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy