Model Details Model Card for Olmo Hybrid Instruct SFT We expand on our Olmo model series by introducing Olmo Hybrid, a new 7B hybrid RNN model in the Olmo family. Olmo Hybrid dramatically outperforms Olmo 3 in final performance, consistently showing roughly 2x data efficiency on core evals over the course of our pretraining run. We also show gains in performance on long context benchmarks, as well as improved inference efficiency (throughput and memory) on long context lengths by a factor of 75%. The core models released in this batch include the following: Stage Olmo 3 7B Think Olmo 3 32B Think Olmo 3 7B Instruct Olmo Hybrid Think 7B Olmo Hybrid Instruct 7B Base Model Olmo 3 7B Olmo 3 32B Olmo 3 7B Olmo Hybrid 7B Olmo Hybrid 7B SFT Olmo 3 7B Think SFT Olmo 3 32B Think SFT Olmo 3 7B Instruct SFT Olmo Hybrid Think SFT 7B Olmo Hybrid Instruct SFT 7B DPO Olmo 3 7B Think DPO Olmo 3 32B Think DPO Olmo 3 7B Instruct DPO Olmo Hybrid Instruct DPO 7B Final Models (RLVR) Olmo 3 7B Think Olmo 3 32B Think Olmo 3 7B Instruct Olmo is a series of O pen l anguage mo dels designed to enable the science of language models. These models are pre trained on the Dolma 3 dataset and post trained on the D…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy