Inclusively Classification Model This model is an Italian classification model fine tuned from the Italian BERT model for the classification of inclusive language in Italian. It has been trained to detect three classes: inclusive : the sentence is inclusive (e.g. "Il personale docente e non docente") not inclusive : the sentence is not inclusive (e.g. "I professori") not pertinent : the sentence is not pertinent to the task (e.g. "La scuola è chiusa") Training data The model has been trained on a dataset containing: 8580 training sentences 1073 validation sentences 1072 test sentences The data collection has been manually annotated by experts in the field of inclusive language (dataset is not publicly available yet). Training procedure The model has been fine tuned from the Italian BERT model using the following hyperparameters: max length : 128 batch size : 128 learning rate : 5e 5 warmup steps : 500 epochs : 10 (best model is selected based on validation accuracy) optimizer : AdamW Evaluation results The model has been evaluated on the test set and obtained the following results: Model Accuracy Inclusive F1 Not inclusive F1 Not pertinent F1 TF IDF + MLP 0.68 0.63 0.69 0.66 TF IDF…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy