📚 FineWeb Edu 1.3 trillion tokens of the finest educational data the 🌐 web has to offer Paper: https://arxiv.org/abs/2406.17557 What is it? 📚 FineWeb Edu dataset consists of 1.3T tokens and 5.4T tokens (FineWeb Edu score 2) of educational web pages filtered from 🍷 FineWeb dataset. This is the 1.3 trillion version. To enhance FineWeb's quality, we developed an educational quality classifier using annotations generated by LLama3 70B Instruct. We… See the full description on the dataset page: https://huggingface.co/datasets/CharlesPing/fineweb edu.
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy