LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code š Home Page ā¢ š» GitHub Repository ā¢ š Leaderboard ā¢ š Paper Change Log Since LiveCodeBench is a continuously updated benchmark, we provide different versions of the dataset. Particularly, we provide the following versions of the dataset: release v1 : The initial release of the dataset with problems released between May 2023 and Mar 2024 containing 400 problems. release v2 : The updated release of the dataset with problems released between May 2023 and May 2024 containing 511 problems. release v3 : The updated release of the dataset with problems released between May 2023 and Jul 2024 containing 612 problems. release v4 : The updated release of the dataset with problems released between May 2023 and Sep 2024 containing 713 problems. release v5 : The updated release of the dataset with problems released between May 2023 and Jan 2025 containing 880 problems. You can use the version tag argument to load the desired version of the dataset. Additionally, you can use version tags like v1 , v2 , v1 v3 , v4 v5 to get the problems released in a specific version. Dataset Description LiveCodeBench iā¦
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy