BERTić* [bert ich] /bɜrtitʃ/ A transformer language model for Bosnian, Croatian, Montenegrin and Serbian * The name should resemble the facts (1) that the model was trained in Zagreb, Croatia, where diminutives ending in ić (as in fotić, smajlić, hengić etc.) are very popular, and (2) that most surnames in the countries where these languages are spoken end in ić (with diminutive etymology as well). This Electra model was trained on more than 8 billion tokens of Bosnian, Croatian, Montenegrin and Serbian text. *new* We have published a version of this model fine tuned on the named entity recognition task (bcms bertic ner) and on the hate speech detection task (bcms bertic frenk hate). If you use the model, please cite the following paper: Benchmarking Comparing this model to multilingual BERT and CroSloEngual BERT on the tasks of (1) part of speech tagging, (2) named entity recognition, (3) geolocation prediction, and (4) commonsense causal reasoning, shows the BERTić model to be superior to the other two. Part of speech tagging Evaluation metric is (seqeval) microF1. Reported are means of five runs. Best results are presented in bold. Statistical significance is cal…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy