Homepage and repository
- Homepage: https://matharena.ai/
- Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from HMMT November 2025 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx(int64): Problem index within the corresponding MathArena benchmark.answer(string): Gold final answer.problem(string): Problem statement, usually stored as LaTeX source.
Source Data
The original questions were sourced from the HMMT November 2025 competition. Questions were extracted, converted to LaTeX and verified.
Licensing Information
This dataset is licensed under the Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0). Please abide by the license when using the provided data.
Citation Information
@article{dekoninck2026matharena,
title={Beyond Benchmarks: MathArena as an Evaluation Platform for Mathematics with LLMs},
author={Jasper Dekoninck and Nikola Jovanović and Tim Gehrunger and Kári Rögnvaldsson and Ivo Petrov and Chenhao Sun and Martin Vechev},
year={2026},
eprint={2605.00674},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2605.00674},
}