Lazyup-crypto/fineweb-edu📚 FineWeb Edu 1.3 trillion tokens of the finest educational data the 🌐 web has to offer Paper: https://arxiv.org/abs/2406.17557 What is it? 📚 FineWeb Edu dataset consists of 1.3T tokens and 5.4T tokens (FineWeb Edu score 2) of educational web pages filtered from 🍷 FineWeb dataset. This is the 1.3 trillion version. To enhance FineWeb's quality, we developed an educational quality classifier using annotations generated by LLama3 70B Instruct. We… See the full description on the dataset page: https://huggingface.co/datasets/Lazyup crypto/fineweb edu.

fineweb-edu

PUBLIC

Mirrored

📚 FineWeb-Edu 1.3 trillion tokens of the finest educational data the 🌐 web has to offer Paper: https://arxiv.org/abs/2406.17557 What is it? 📚 FineWeb-Edu dataset consists of 1.3T tokens and 5.4T tokens (FineWeb-Edu-score-2) of educational web pages filtered from 🍷 FineWeb dataset. This is the 1.3 trillion version. To enhance FineWeb's quality, we developed an educational quality classifier using annotations generated by LLama3-70B-Instruct. We… See the full description on the dataset page: https://huggingface.co/datasets/Lazyup-crypto/fineweb-edu.

Formats:md, parquetLibraries:Datasets, Dask, Polars, CroissantLicense:odc-by

ArXiv:2406.17557, 2404.14219, 2401.10020, 2109.07445

imported

huggingface

minio

task_categories:text-generation

language:en

license:odc-by

size_categories:1B<n<10B

format:parquet

modality:tabular

modality:text