This model was trained for multilingual toxicity labeling. Label 1 means TOXIC, Label 0 means NOT TOXIC. The model was fine tuned based off the xlm roberta base model for 4 languages: EN, RU, FR, DE The validation accuracy is 92%. The model was finetuned on the total sum of 100933k sentences. The train data for English and Russian came from https://github.com/s nlp/multilingual detox, French data comprised the translated to French data from https://github.com/s nlp/multilingual detox as well as all the French data from the Jigsaw dataset, the German data was similarly composed using translations and semi manual data collection techniquies, in particular for offensive words and phrases were crawled the dict.cc dictionary (https://www.dict.cc/) and the Reverso Context (https://context.reverso.net/translation/).
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy