GAIA2 CLI Benchmark dataset for gaia2 cli, the CLI based agent evaluation harness. Schema Each row has two columns: Column Type Description scenario id string Unique scenario identifier (e.g. scenario universe 21 1qgjj6 ) scenario string Complete scenario as a JSON string Usage Available configs: adaptability , ambiguity , execution , search , time . With the runner The gaia2 runner downloads and caches this dataset automatically: Or in a TOML config: Export to JSON To export scenarios as individual JSON files:
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy