Dataset Card for Parallel Sentences - CCMatrix
This dataset contains parallel sentences (i.e. English sentence + the same sentences in another language) for numerous other languages. The texts originate from the CCMatrix dataset.
Related Datasets
The following datasets are also a part of the Parallel Sentences collection:
- parallel-sentences-europarl
- parallel-sentences-global-voices
- parallel-sentences-muse
- parallel-sentences-jw300
- parallel-sentences-news-commentary
- parallel-sentences-opensubtitles
- parallel-sentences-talks
- parallel-sentences-tatoeba
- parallel-sentences-wikimatrix
- parallel-sentences-wikititles
- parallel-sentences-ccmatrix
These datasets can be used to train multilingual sentence embedding models. For more information, see sbert.net - Multilingual Models.
Dataset Subsets
en-... subsets
- Columns: "english", "non_english"
- Column types:
str,str - Examples:
{ "english": "He and his mother will be standing vigil there.”", "non_english": "Él y su madre estarán de vigilia allí”.", } - Collection strategy: Processing the data from yhavinga/ccmatrix and reformatting it in Parquet and with "english" and "non_english" columns.
- Deduplified: No