Paper: For more details, please refer to our paper: BERTabaporu: Assessing a Genre Specific Language Model for Portuguese NLP Introduction BERTabaporu is a Brazilian Portuguese BERT model in the Twitter domain. The model has been built from a collection of 238 million tweets written by over 100 thousand unique Twitter users, and conveying over 2.9 billion tokens in total. Available models Model Arch. Layers Params pablocosta/bertabaporu base uncased BERT Base 12 110M pablocosta/bertabaporu large uncased BERT Large 24 335M Usage Cite us @inproceedings{costa etal 2023 bertabaporu, title = "{BERT}abaporu: Assessing a Genre Specific Language Model for {P}ortuguese {NLP}", author = "Costa, Pablo Botton and Pavan, Matheus Camasmie and Santos, Wesley Ramos and Silva, Samuel Caetano and Paraboni, Ivandr{\'e}", editor = "Mitkov, Ruslan and Angelova, Galia", booktitle = "Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing", month = sep, year = "2023", address = "Varna, Bulgaria", publisher = "INCOMA Ltd., Shoumen, Bulgaria", url = "https://aclanthology.org/2023.ranlp 1.24", pages = "217 223", abstract = "Transformer based language models such as…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy