Dataset Card for "wmt14" Table of Contents Dataset Description Dataset Summary Supported Tasks and Leaderboards Languages Dataset Structure Data Instances Data Fields Data Splits Dataset Creation Curation Rationale Source Data Annotations Personal and Sensitive Information Considerations for Using the Data Social Impact of Dataset Discussion of Biases Other Known Limitations Additional Information Dataset Curators Licensing Information Citation Information Contributions Dataset Description Homepage: http://www.statmt.org/wmt14/translation task.html Repository: More Information Needed Paper: More Information Needed Point of Contact: More Information Needed Size of downloaded dataset files: 1.70 GB Size of the generated dataset: 282.95 MB Total amount of disk used: 1.98 GB Dataset Summary Warning: There are issues with the Common Crawl corpus data ( training parallel commoncrawl.tgz ): Non English files contain many English sentences. Their "parallel" sentences in English are not aligned: they are uncorrelated with their counterpart. We have contacted the WMT organizers, and in response, they have indicated that they do not have plans to update the Common Crawl corpus data. Their rat…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy