Version v2 (default): April 28th, 2022 Version v1: July 26th, 2021 Version v1 512: July 26th, 2021 Version beta: July 15th, 2021 BERTIN BERTIN is a series of BERT based models for Spanish. The current model hub points to the best of all RoBERTa base models trained from scratch on the Spanish portion of mC4 using Flax. All code and scripts are included. This is part of the Flax/Jax Community Week, organized by HuggingFace and TPU usage sponsored by Google Cloud. The aim of this project was to pre train a RoBERTa base model from scratch during the Flax/JAX Community Event, in which Google Cloud provided free TPUv3 8 to do the training using Huggingface's Flax implementations of their library. Team members Javier de la Rosa (versae) Eduardo González (edugp) Paulo Villegas (paulo) Pablo González de Prado (Pablogps) Manu Romero (mrm8488) María Grandury (mariagrandury) Citation and Related Information To cite this model: See also https://arxiv.org/abs/2207.06814. If you use this model, we would love to hear about it! Reach out on twitter, GitHub, Discord, or shoot us an email. Team Javier de la Rosa (versae) Eduardo González (edugp) Paulo Villegas (paulo) Pablo González de Prado (Pablogp…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy