Global PIQA Non Parallel Global PIQA is a participatory commonsense reasoning benchmark for over 100 languages, constructed by hand by over 350 researchers from over 65 countries around the world. The non parallel split covers 136 language varieties, covering five continents, 18 language families, and 24 writing systems. In this non parallel split, over 50% of examples reference local foods, customs, traditions, or other culturally specific elements. Details are in our preprint: Global PIQA: Evaluating Commonsense Reasoning Across 100+ Languages and Cultures (2026). Following the English PIQA dataset (Bisk et al., 2020), each example consists of a prompt and two candidate solutions, one correct and one incorrect. In Global PIQA, determining the correct solution for each example is designed to require commonsense reasoning (e.g. knowledge of object properties, affordances, physical or temporal relations, cultural knowledge, or basic world knowledge). Beyond its uses for LLM evaluation, we hope that Global PIQA provides a glimpse into the wide diversity of cultures in which human language is embedded. For more "culturally agnostic" examples translated into 100+ languages, see our par…
Runs entirely in your browser via DuckDB-Wasm — this dataset's real data file is loaded once, then queried locally. Nothing is sent to a server.
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy