ERNIE 4.5 21B A3B Thinking Model Highlights Over the past three months, we have continued to scale the thinking capability of ERNIE 4.5 21B A3B, improving both the quality and depth of reasoning, thereby advancing the competitiveness of ERNIE lightweight models in complex reasoning tasks. We are pleased to introduce ERNIE 4.5 21B A3B Thinking , featuring the following key enhancements: Significantly improved performance on reasoning tasks, including logical reasoning, mathematics, science, coding, text generation, and academic benchmarks that typically require human expertise. Efficient tool usage capabilities. Enhanced 128K long context understanding capabilities. [!NOTE] Note: This version has an increased thinking length. We strongly recommend its use in highly complex reasoning tasks. Model Overview ERNIE 4.5 21B A3B Thinking is a text MoE post trained model, with 21B total parameters and 3B activated parameters for each token. The following are the model configuration details: Key Value Modality Text Training Stage Posttraining Params(Total / Activated) 21B / 3B Layers 28 Heads(Q/KV) 20 / 4 Text Experts(Total / Activated) 64 / 6 Vision Experts(Total / Activated) 64 / 6 Shared…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy