Model Details RefuelLLM 2 small, aka Llama 3 Refueled, is a Llama3 8B base model instruction tuned on a corpus of 2750+ datasets, spanning tasks such as classification, reading comprehension, structured attribute extraction and entity resolution. We're excited to open source the model for the community to build on top of. More details about RefuelLLM 2 family of models You can also try out the models in our LLM playground Model developers Refuel AI Input Text only. Output Text only. Architecture Llama 3 Refueled is built on top of Llama 3 8B instruct which is an auto regressive language model that uses an optimized transformer architecture. Release Date May 8, 2024. License CC BY NC 4.0 How to use This repository contains weights for Llama 3 Refueled that are compatible for use with HuggingFace. See the snippet below for usage with Transformers: Training Data The model was both trained on over 4 Billion tokens, spanning 2750+ NLP tasks. Our training collection consists majorly of: 1. Human annotated datasets like Flan, Task Source, and the Aya collection 2. Synthetic datasets like OpenOrca, OpenHermes and WizardLM 3. Proprietary datasets developed or licensed by Refuel AI Benchmark…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy