Model Overview Inferact/MiniMax M3 EAGLE3 is an EAGLE3 draft model for accelerating inference of MiniMax M3. It is served end to end with vLLM and was trained using TorchSpec — a torch native online speculative decoding training framework that runs FSDP training and vLLM based target inference concurrently, learning from MiniMax M3 regenerated responses and live vLLM generated hidden states to match the base model's exact token distribution. The draft is a 1 layer dense Llama ( LlamaForCausalLMEagle3 , ~3.3 B params) operating on MiniMax M3's hidden size=6144 / vocab size=200064 ; at serve time it shares the target's embedding and LM head (EAGLE3). See config.json for the full architecture. Performance All numbers are measured end to end against MiniMaxAI/MiniMax M3 MXFP8 served with vLLM at tensor parallel size=4 , num speculative tokens=3 , and enforce eager . Greedy draft sampling ( topk=1 ). Category Dataset n Mean Accept Length Draft Accept Rate Per pos Accept Rate : : : Dialogue MT Bench 80 2.698 56.60% 0.749, 0.547, 0.402 Math GSM8K 200 3.518 83.93% 0.923, 0.839, 0.756 Code HumanEval 164 3.499 83.29% 0.922, 0.832, 0.744 Math MATH500 500 3.517 83.90% 0.929, 0.841, 0.747 Math…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy