📰 Tech Blog 📄 Full Report 1. Model Introduction Kimi K3 is an open weight, native multimodal agentic model and our most capable model to date. It is a 2.8T parameter model built on Kimi Delta Attention (KDA) and Attention Residuals (AttnRes), with native vision capabilities and a 1 million token context window. It is the world's first open 3T class model, designed for frontier intelligence across long horizon coding, knowledge work, and reasoning. Key Features New Architecture : Kimi K3 is built on Kimi Delta Attention (KDA) and Attention Residuals (AttnRes), and scales up MoE sparsity with a Stable LatentMoE framework that activates 16 out of 896 experts — yielding an approximate 2.5× improvement in overall scaling efficiency over Kimi K2. Long Horizon Coding : Operating with minimal human oversight, Kimi K3 sustains long engineering sessions, navigates massive repositories, and orchestrates terminal tools — from GPU kernel optimization and compiler development to vision in the loop game dev, CAD, and even chip design. Agentic Knowledge Work : Kimi K3 advances end to end knowledge work, producing deep research with interactive visualiza…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy