Model Card for Model ID This model is ModernBERT multi task fine tuned on tasksource NLI tasks, including MNLI, ANLI, SICK, WANLI, doc nli, LingNLI, FOLIO, FOL NLI, LogicNLI, Label NLI and all datasets in the below table). This is the equivalent of an "instruct" version. The model was trained for 200k steps on an Nvidia A30 GPU. It is very good at reasoning tasks (better than llama 3.1 8B Instruct on ANLI and FOLIO), long context reasoning, sentiment analysis and zero shot classification with new labels. The following table shows model test accuracy. These are the scores for the same single transformer with different classification heads on top. Further gains can be obtained by fine tuning on a single task, e.g. SST, but it this checkpoint is great for zero shot classification and natural language inference (contradiction/entailment/neutral classification). test name test accuracy : : glue/mnli 0.89 glue/qnli 0.96 glue/rte 0.91 glue/wnli 0.64 glue/mrpc 0.81 glue/qqp 0.87 glue/cola 0.87 glue/sst2 0.96 super glue/boolq 0.66 super glue/cb 0.86 super glue/multirc 0.9 super glue/wic 0.71 super glue/axg 1 anli/a1 0.72 anli/a2 0.54 anli/a3 0.55 sick/label 0.91 sick/entailment AB 0.93 snli…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy