language: en license: mit task categories: question answering pretty name: MMLU PromptEval full dataset info: config name: format 0 features: name: question dtype: string name: subject dtype: string name: example dtype: int32 name: choices sequence: string name: answer dtype: class label: names: '0': A '1': B '2': C '3': D '4': E name: input formatted dtype: string name: model output dtype: string name: correctness dtype: int8 splits: name: meta llama llama 3 8b num bytes: 40967634 num examples: 14042 name: meta llama llama 3 8b instruct num bytes: 40967594 num examples: 14042 name: meta llama llama 3 70b instruct num bytes: 40965182 num examples: 14042 name: codellama codellama 34b instruct num bytes: 40827221 num examples: 14042 name: google flan t5 xl num bytes: 40729214 num examples: 14042 name: google flan t5 xxl num bytes: 40728930 num examples: 14042 name: google flan ul2 num bytes: 40728928 num examples: 14042 name: ibm mistralai merlinite 7b num bytes: 40820070 num examples: 14042 name: mistralai mixtral 8x7b instruct v01 num bytes: 40827213 num examples: 14042 name: mistralai mistral 7b instruct v0 2 num bytes: 40828810 num examples: 14042 name: google gemma 7b num bytes:…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy