BalkanBench SuperGLUE Serbian Part of BalkanBench the open, reproducible benchmark for language models across Serbian, Croatian, Montenegrin, and Bosnian (BCMS). Live leaderboard at . Background and motivation: Release of BalkanBench the vision behind it (Medium, 2026 04 27). This is the Serbian SuperGLUE track of BalkanBench v0.1. Serbian is the official frozen track: the leaderboard's ranked average is computed over 6 ranked tasks , with 2 diagnostic tasks reported separately. Croatian and Montenegrin previews live in sibling repos (superglue hr / superglue mne). What's inside 7 task configs are published here in their full train + validation + public test form (train + validation labelled here; the test split lives only in the gated sibling repo , see below): Config What it tests Train Validation Test : : : boolq Yes/no question answering over passages 9,427 3,270 3,245 cb 3 way textual entailment (entail / contradict / neutral) 250 56 250 copa Causal reasoning between two alternatives 400 100 500 multirc Multi sentence reading comprehension (multiple correct) 27,243 4,848 9,693 record Commonsense cloze over news articles 5,607 1,869 1,869 rte Binary textual entailment 2,490 277…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy