MMLU professionally translated into 14 languages using professional human translators, sourced from OpenAI's simple eval. Original files: english: https://openaipublic.blob.core.windows.net/simple evals/mmlu.csv multilingual: https://openaipublic.blob.core.windows.net/simple evals/mmlu {language}.csv where language one of "AR XY", "BN BD", "DE DE", "ES LA", "FR FR", "HI IN", "ID ID", "IT IT", "JA JP", "KO KR", "PT BR", "ZH CN", "SW KE", "YO NG", "EN US"
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy