🚀 Qwen2.5 Coder 7B Instruct Uncensored GGUF Optimized quantized models for efficient inference 📋 Overview A collection of optimized GGUF quantized models derived from BlossomsAI/Qwen2.5 Coder 7B Instruct Uncensored, providing various performance quality tradeoffs. 💎 Model Variants Variant Use Case Download Q2 K Basic text completion tasks 📥 Q3 K M Memory efficient quality operations 📥 Q4 K S Balanced performance and quality 📥 Q4 K M Balanced performance and quality 📥 Q5 K S Enhanced quality text generation 📥 Q5 K M Enhanced quality text generation 📥 Q6 K Superior quality outputs 📥 Q8 0 Maximum quality, production grade results 📥 🤝 Contributors Developed with ❤️ by BlossomAI Star ⭐️ this repo if you find it valuable!
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy