🎉 License Updated! We are pleased to announce our more flexible licensing terms 🤗 ✈️ Try on FriendliAI (licensed under commercial purposes) 📢 EXAONE 4.0 is officially supported by HuggingFace transformers! Please check out the guide below EXAONE 4.0 32B AWQ Introduction We introduce EXAONE 4.0 , which integrates a Non reasoning mode and Reasoning mode to achieve both the excellent usability of EXAONE 3.5 and the advanced reasoning abilities of EXAONE Deep. To pave the way for the agentic AI era, EXAONE 4.0 incorporates essential features such as agentic tool use, and its multilingual capabilities are extended to support Spanish in addition to English and Korean. The EXAONE 4.0 model series consists of two sizes: a mid size 32B model optimized for high performance, and a small size 1.2B model designed for on device applications. In the EXAONE 4.0 architecture, we apply new architectural changes compared to previous EXAONE models as below: 1. Hybrid Attention : For the 32B model, we adopt hybrid attention scheme, which combines Local attention (sliding window attention) with Global attention (full attention) in a 3:1 ratio. We do not use RoPE (Rotary Positional Embedding) for glob…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy