Model Card for Marin 8B This is the model card for the Marin 8B Base model. The Marin Project is a collaborative effort to develop open source foundation models. Datasets Datasets used in Marin 8B Base Marin 8B Base was trained on a variety of datasets: Nemotron CC DCLM Baseline Starcoder Data Proofpile 2 FineMath 3+ Dolma, including their versions of: MegaWika peS2o (And most of the rest of it) Dolmino Mix 1124, including their versions of: FLAN CodeSearchNet (with OWM Filter) GSM8K MetaMath MathCoder2 Synthetic And some new datasets: Marin Markdownified StackExchange Marin Markdownified Wikipedia Marin Markdownified Ar5iv (No Problem) Marin Markdownified Ar5iv (Warnings) Marin Datashop Science QA The first three are licensed per their original licenses. The fourth is licensed under CC BY SA 4.0. Datasets used in Marin 8B Instruct Marin 8B Instruct is currently an SFT only model. It was trained on the following datasets: TIGER Lab/AceCode 89K bespokelabs/Bespoke Stratos 17k cognitivecomputations/dolphin r1 (includes both nonreasoning and reasoning subsets) tuenguyen/dolphin r1 reasoning facebook/natural reasoning open r1/OpenThoughts 114k math HuggingFaceTB/smoltalk allenai/tulu 3…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy