Tiny LLM A Tiny LLM model with just 10 Million parameters, this is probably one of the small LLM arounds, and it is functional. Pretraining Tiny LLM was trained on 32B tokens of the Fineweb dataset, with a context length of 1024 tokens. Getting Started To start using these models, you can simply load them via the Hugging Face transformers library:
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy