OpenRCA2 v1 (500 cases, 2026 05 02 snapshot) Curated 500 case RCA evaluation set built 2026 05 02 from a unified pool of older FSE/openrca2 train ticket cases plus the most recent aegisctl detector success runs across train ticket , hotel reservation , and otel demo . Each case carries the full telemetry parquets, the injection metadata, and a regenerated service level causal graph.json . Layout MANIFEST.json at the root lists all 500 cases with system / chaos family / hybrid flag / service graph stats. Composition ts hs otel demo total : : : : old (FSE/openrca2) 188 0 0 188 new (aegisctl detector success) 126 132 54 312 total 314 132 54 500 Service level longest path distribution (DAG depth + 1): mean 3.46, p25=2, p50=3, p75=4, max=9. Two injection.json formats New (aegisctl detector success): engine config is a list of dicts with app , chaos type , target service , direction , class , method . Use this directly. Old (FSE/openrca2): engine config is an opaque JSON encoded string and fault type is numeric. The authoritative ground truth is injection.json::ground truth . Loaders should fall back to that field when engine config is not a list of dicts. The rcabench platform[llm eval]…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy