Model Card for Aya 101 Model Summary The Aya model is a massively multilingual generative language model that follows instructions in 101 languages. Aya outperforms mT0 and BLOOMZ a wide variety of automatic and human evaluations despite covering double the number of languages. The Aya model is trained using xP3x, Aya Dataset, Aya Collection, a subset of DataProvenance collection and ShareGPT Command. We release the checkpoints under a Apache 2.0 license to further our mission of multilingual technologies empowering a multilingual world. Developed by: Cohere Labs Model type: a Transformer style autoregressive massively multilingual language model. Paper : Aya Model: An Instruction Finetuned Open Access Multilingual Language Model Point of Contact : Cohere Labs Languages : Refer to the list of languages in the language section of this model card. License : Apache 2.0 Model : Aya 101 Model Size : 13 billion parameters Datasets : xP3x, Aya Dataset, Aya Collection, DataProvenance collection, ShareGPT Command. Use Model Details Finetuning Architecture: Same as mt5 xxl Number of Samples seen during Finetuning: 25M Batch size: 256 Hardware: TPUv4 128 Software: T5X, Jax Data Sources The Ay…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy