Sulphur 2 Base (Dev) GGUF This repository contains GGUF format model files for SulphurAI's Sulphur 2 base. Model Details Original Model: SulphurAI/Sulphur 2 base Format: GGUF Architecture: ltxv Model Size: 21B parameters Available Quantizations The following quantization tiers are provided to accommodate different hardware capabilities and VRAM constraints. Filename Quantization Type Size Recommended Use : : : : sulphur dev bf16.gguf BF16 (16 bit) 42.0 GB Unquantized baseline. Maximum quality and accuracy. Requires massive VRAM. sulphur dev Q8 0.gguf Q8 0 (8 bit) 22.8 GB Extremely high quality, near unquantized performance. sulphur dev Q6 K.gguf Q6 K (6 bit) 17.8 GB Very high quality, minimal precision loss. sulphur dev Q5 K M.gguf Q5 K M (5 bit) 16.1 GB Excellent balance of quality and performance. sulphur dev Q5 K S.gguf Q5 K S (5 bit) 15.0 GB Slightly smaller 5 bit variant for strict memory limits. sulphur dev Q4 K M.gguf Q4 K M (4 bit) 14.3 GB Recommended standard. Fast inference with very low quality degradation. sulphur dev Q4 K S.gguf Q4 K S (4 bit) 13.2 GB Smaller 4 bit variant, slightly lower quality than K M. sulphur dev Q4 0.gguf Q4 0 (4 bit) 13.0 GB Legacy 4 bit quant.…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy