Qwen2.5 Coder 7B Introduction Qwen2.5 Coder is the latest series of Code Specific Qwen large language models (formerly known as CodeQwen). As of now, Qwen2.5 Coder has covered six mainstream model sizes, 0.5, 1.5, 3, 7, 14, 32 billion parameters, to meet the needs of different developers. Qwen2.5 Coder brings the following improvements upon CodeQwen1.5: Significantly improvements in code generation , code reasoning and code fixing . Base on the strong Qwen2.5, we scale up the training tokens into 5.5 trillion including source code, text code grounding, Synthetic data, etc. Qwen2.5 Coder 32B has become the current state of the art open source codeLLM, with its coding abilities matching those of GPT 4o. A more comprehensive foundation for real world applications such as Code Agents . Not only enhancing coding capabilities but also maintaining its strengths in mathematics and general competencies. Long context Support up to 128K tokens. This repo contains the 7B Qwen2.5 Coder model , which has the following features: Type: Causal Language Models Training Stage: Pretraining Architecture: transformers with RoPE, SwiGLU, RMSNorm, and Attention QKV bias Number of Parameters: 7.61B Number…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy