Table of Contents 1. Model Summary 2. Use 3. Limitations 4. Training 5. Evaluation 7. Citation Model Summary We present BLOOMZ & mT0, a family of models capable of following human instructions in dozens of languages zero shot. We finetune BLOOM & mT5 pretrained multilingual language models on our crosslingual task mixture (xP3) and find the resulting models capable of crosslingual generalization to unseen tasks & languages. Repository: bigscience workshop/xmtf Paper: Crosslingual Generalization through Multitask Finetuning Point of Contact: Niklas Muennighoff Languages: Refer to bloom for pretraining & xP3 for finetuning language proportions. It understands both pretraining & finetuning languages. BLOOMZ & mT0 Model Family: Multitask finetuned on xP3 . Recommended for prompting in English. Parameters 300M 580M 1.2B 3.7B 13B 560M 1.1B 1.7B 3B 7.1B 176B Finetuned Model mt0 small mt0 base mt0 large mt0 xl mt0 xxl bloomz 560m bloomz 1b1 bloomz 1b7 bloomz 3b bloomz 7b1 bloomz Multitask finetuned on xP3mt . Recommended for prompting in non English. Finetuned Model mt0 xxl mt bloomz 7b1 mt bloomz mt Multitask finetuned on P3 . Released for research purposes only. Strictly inferior to abov…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy