SWE rebench V2 Dataset Summary SWE rebench V2 is a curated dataset of software engineering tasks derived from real GitHub issues and pull requests. The dataset contains 32,079 samples covering Python, Go, TypeScript, JavaScript, Rust, Java, PHP, Kotlin, Julia, Elixir, Scala, Swift, Dart, C, C++, C , R, Clojure, OCaml, and Lua. For log parser functions, base Dockerfiles, and the prompts used, please see https://github.com/SWE rebench/SWE rebench V2 The detailed technical report is available at “SWE rebench V2: Language Agnostic SWE Task Collection at Scale”. Quick Start Dataset Structure Field Type Description instance id string Unique identifier for the instance repo string GitHub repository in owner/repo format base commit string Git commit SHA of the base before the fix patch string The gold patch that resolves the issue test patch string Diff adding or modifying tests that verify the fix problem statement string Issue description the patch addresses pr description string Full pull request description created at int64 Unix timestamp (milliseconds) of the issue/PR creation image name string Docker image name used for the evaluation environment language string Primary programming l…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy