natgillin/translations raw Frozen, canonical raw bitext consolidated from upstream alvations/mtdata raw snapshots (since deleted). This is the read only source of truth for downstream quality filtering pipelines. 31,663 parquet files (1566.8 GB) 49 language pairs under data/ / Schema: 5 columns — see below Read only for downstream pipelines. Do not delete or modify. Schema Each parquet has 5 columns: column type description source string source language sentence target string target language sentence source lang string ISO 639 3 source language code target lang string ISO 639 3 target language code origin string upstream OPUS / mtdata corpus tag (e.g. opus nllb , opus paracrawl ) Layout 49 pairs total. File naming convention: NNNNN of NNNNN.parquet (original consolidation runs) mtdata recovery NNNNN of NNNNN.parquet (re sourced from mtdata) Provenance Originally consolidated from alvations/mtdata raw , alvations/mtdata raw 2 , alvations/mtdata raw hashed (now deleted). Files marked mtdata recovery were re pulled directly from the mtdata library on 2026 06 09. Downstream filtered versions natgillin/translations — rows that scored 0.8 on Claude Haiku 4.5 translation quality evaluatio…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy