Dolma 3 Longmino Mix (50B) The Dolma 3 Longmino Mix (50B) is the mixture of data used for the third stage of training for Olmo 3 7B model. Dataset Sources Source Type Tokens Docs LC s2pdf REX 32k 64k Synth PDFs 6.08B (12.2%) 217K LC s2pdf CWE 32k 64k Synth PDFs 1.94B (3.88%) 71.3K LC s2pdf 32k 64k PDFs 4.81B (9.63%) 177K LC s2pdf 8k 32k (8 16k) PDFs 2.27B (4.55%) 235K LC s2pdf 8k 32k (16 32k) PDFs 1.85B (3.70%) 110K Midtraining Data Mix 33.0B (66.1%) 79.2M Total 50.0B 80.0M Licensing Information Dolma 3 Longmino is licensed under the Open Data Commons Attribution License v1.0 (ODC By). It is intended for research and educational use. For more information, please see our Responsible Use Guidelines. Citation
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy