HLE Verified (HF native JSONL) This dataset is a lightweight, evaluation ready reformatting of the HLE Verified benchmark created by the Skylenage Team. Original work: Weiqi Zhai et al., "HLE Verified: A Systematic Verification and Structured Revision of Humanity's Last Exam" (arXiv:2602.13964) Original dataset: skylenage/HLE Verified Original repository: SKYLENAGE AI/HLE Verified Source & Snapshot Converted from skylenage/HLE Verified snapshot becad9f339dfce27df0ebb38e55dabef12ca5735 . Modifications The following changes were made from the original dataset: Format conversion: Raw data converted to HF native JSONL splits Image payloads removed: Heavy raw image data dropped; text eval fields retained for hle verified task Split restructuring: Data organized into the following splits: Split Count Description full 2,500 All items test 1,811 Gold + Revision (for evaluation) gold 668 Fully validated items revision 1,143 Revised and re verified items uncertain 689 Items with inconclusive validity No questions, answers, rationales, or verification metadata were altered. License This dataset is distributed under CC BY 4.0, consistent with the original release. Citation If you use this data…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy