🚀 Qwen2.5-Coder-7B-Instruct-Uncensored-GGUF
Optimized quantized models for efficient inference
📋 Overview
A collection of optimized GGUF quantized models derived from BlossomsAI/Qwen2.5-Coder-7B-Instruct-Uncensored, providing various performance-quality tradeoffs.
💎 Model Variants
| Variant | Use Case | Download |
|---|---|---|
| Q2_K | Basic text completion tasks | 📥 |
| Q3_K_M | Memory-efficient quality operations | 📥 |
| Q4_K_S | Balanced performance and quality | 📥 |
| Q4_K_M | Balanced performance and quality | 📥 |
| Q5_K_S | Enhanced quality text generation | 📥 |
| Q5_K_M | Enhanced quality text generation | 📥 |
| Q6_K | Superior quality outputs | 📥 |
| Q8_0 | Maximum quality, production-grade results | 📥 |
🤝 Contributors
Developed with ❤️ by BlossomAI
Star ⭐️ this repo if you find it valuable!