OmniCoder 9B GGUF GGUF quantizations of OmniCoder 9B Available Quantizations Quantization Size Use Case : : : Q2 K ~3.8 GB Extreme compression, lowest quality Q3 K S ~4.3 GB Small footprint Q3 K M ~4.6 GB Small footprint, balanced Q3 K L ~4.9 GB Small footprint, higher quality Q4 0 ~5.3 GB Good balance Q4 K S ~5.4 GB Good balance Q4 K M ~5.7 GB Recommended for most users Q5 0 ~6.3 GB High quality Q5 K S ~6.3 GB High quality Q5 K M ~6.5 GB High quality, balanced Q6 K ~7.4 GB Near lossless Q8 0 ~9.5 GB Highest quality quantization BF16 ~17.9 GB Full precision Usage Built by Tesslate See full model card: OmniCoder 9B
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy