Qwen2.5 Coder 1.5B Instruct AWQ Introduction Qwen2.5 Coder is the latest series of Code Specific Qwen large language models (formerly known as CodeQwen). As of now, Qwen2.5 Coder has covered six mainstream model sizes, 0.5, 1.5, 3, 7, 14, 32 billion parameters, to meet the needs of different developers. Qwen2.5 Coder brings the following improvements upon CodeQwen1.5: Significantly improvements in code generation , code reasoning and code fixing . Base on the strong Qwen2.5, we scale up the training tokens into 5.5 trillion including source code, text code grounding, Synthetic data, etc. Qwen2.5 Coder 32B has become the current state of the art open source codeLLM, with its coding abilities matching those of GPT 4o. A more comprehensive foundation for real world applications such as Code Agents . Not only enhancing coding capabilities but also maintaining its strengths in mathematics and general competencies. This repo contains the AWQ quantized 4 bit instruction tuned 1.5B Qwen2.5 Coder model , which has the following features: Type: Causal Language Models Training Stage: Pretraining & Post training Architecture: transformers with RoPE, SwiGLU, RMSNorm, Attention QKV bias and tied…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy