LaMini GPT 124M This model is one of our LaMini LM model series in paper "LaMini LM: A Diverse Herd of Distilled Models from Large Scale Instructions". This model is a fine tuned version of gpt2 on LaMini instruction dataset that contains 2.58M samples for instruction fine tuning. For more information about our dataset, please refer to our project repository. You can view other models of LaMini LM series as follows. Models with ✩ are those with the best overall performance given their size/architecture, hence we recommend using them. More details can be seen in our paper. Base model LaMini LM series ( parameters) T5 LaMini T5 61M LaMini T5 223M LaMini T5 738M Flan T5 LaMini Flan T5 77M ✩ LaMini Flan T5 248M ✩ LaMini Flan T5 783M ✩ Cerebras GPT LaMini Cerebras 111M LaMini Cerebras 256M LaMini Cerebras 590M LaMini Cerebras 1.3B GPT 2 LaMini GPT 124M ✩ LaMini GPT 774M ✩ LaMini GPT 1.5B ✩ GPT Neo LaMini Neo 125M LaMini Neo 1.3B GPT J coming soon LLaMA coming soon Use Intended use We recommend using the model to respond to human instructions written in natural language. Since this decoder only model is fine tuned with wrapper text, we suggest using the same wrapper text to achieve the b…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy