🥂 FineWeb2 A sparkling update with 1000s of languages Table of Contents 🥂 FineWeb2 What is it? Languages and available subsets + How many tokens? Changelog How to download and use 🥂 FineWeb2 + Using 🏭 datatrove + Using huggingface hub + Using datasets Dataset processing steps + Language Identification 🌍 + Deduplication 🗃️ + Data Filtering 🧹 + PII Anonymization and fixes 🎭 Dataset performance evaluation and ablations + Hyper parameters for ablation models + Score normalization + Global scores across languages + Comparison with other datasets Dataset card for 🥂 FineWeb2 Dataset Description + Dataset Summary Dataset Structure + Data Instances + Data Fields + Data Splits Dataset Creation + Curation Rationale + Source Data + Data processing steps + Annotations + Personal and Sensitive Information and opt out Considerations for Using the Data + Social Impact of Dataset + Discussion of Biases + Other Known Limitations Additional Information + Licensing Information + Future work and community initiatives Citation Information What is it? This is the second iteration of the popular 🍷 FineWeb dataset, bringing high quality pretraining data to over 1000 🗣️ languages. The 🥂 FineWeb2…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy