Quantization made by Richard Erkhov. Github Discord Request more models Qwen2.5 14B Instruct abliterated v2 GGUF Model creator: https://huggingface.co/huihui ai/ Original model: https://huggingface.co/huihui ai/Qwen2.5 14B Instruct abliterated v2/ Name Quant method Size Qwen2.5 14B Instruct abliterated v2.Q2 K.gguf Q2 K 5.37GB Qwen2.5 14B Instruct abliterated v2.IQ3 XS.gguf IQ3 XS 5.94GB Qwen2.5 14B Instruct abliterated v2.IQ3 S.gguf IQ3 S 6.23GB Qwen2.5 14B Instruct abliterated v2.Q3 K S.gguf Q3 K S 6.2GB Qwen2.5 14B Instruct abliterated v2.IQ3 M.gguf IQ3 M 6.44GB Qwen2.5 14B Instruct abliterated v2.Q3 K.gguf Q3 K 6.84GB Qwen2.5 14B Instruct abliterated v2.Q3 K M.gguf Q3 K M 6.84GB Qwen2.5 14B Instruct abliterated v2.Q3 K L.gguf Q3 K L 7.38GB Qwen2.5 14B Instruct abliterated v2.IQ4 XS.gguf IQ4 XS 7.62GB Qwen2.5 14B Instruct abliterated v2.Q4 0.gguf Q4 0 7.93GB Qwen2.5 14B Instruct abliterated v2.IQ4 NL.gguf IQ4 NL 8.01GB Qwen2.5 14B Instruct abliterated v2.Q4 K S.gguf Q4 K S 7.98GB Qwen2.5 14B Instruct abliterated v2.Q4 K.gguf Q4 K 8.37GB Qwen2.5 14B Instruct abliterated v2.Q4 K M.gguf Q4 K M 8.37GB Qwen2.5 14B Instruct abliterated v2.Q4 1.gguf Q4 1 8.75GB Qwen2.5 14B Instruct abl…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy