MMLU ( hendrycks test on huggingface) without auxiliary train. It is much lighter (7MB vs 162MB) and faster than the original implementation, in which auxiliary train is loaded (+ duplicated!) by default for all the configs in the original version, making it quite heavy. We use this version in tasksource. Reference to original dataset: Measuring Massive Multitask Language Understanding https://github.com/hendrycks/test
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy