FineFineWeb: A Comprehensive Study on Fine Grained Domain Web Corpus arXiv: Coming Soon Project Page: Coming Soon Blog: Coming Soon Data Statistics Domain ( tokens/ samples) Iteration 1 Tokens Iteration 2 Tokens Iteration 3 Tokens Total Tokens Iteration 1 Count Iteration 2 Count Iteration 3 Count Total Count aerospace 5.77B 261.63M 309.33M 6.34B 9100000 688505 611034 10399539 agronomy 13.08B 947.41M 229.04M 14.26B 15752828 2711790 649404 19114022 artistic 178.25B 5.79B 3.75B 187.80B 314279703 16113512 9957104 340350319 astronomy 5.20B 134.39M 54.66M 5.38B 7596521 357647 145832 8100000 atmospheric science 2.80B 102.04M 259.25M 3.16B 5709537 267789 525969 6503295 automotive 36.72B 436.34M 911.65M 38.07B 60239679 1166729 1535882 62942290 beauty 19.10B 671.88M 1.01B 20.78B 34787376 1808382 2201810 38797568 biology 85.84B 371.29M 776.99M 86.99B 81413569 995384 1350348 83759301 celebrity 9.63B 706.41M 4.22B 14.56B 19831188 1803788 7949240 29584216 chemistry 27.80B 588.92M 131.46M 28.52B 31188189 1499085 328038 33015312 christianity 47.72B 403.68M 732.55M 48.86B 55013147 1349874 2021458 58384479 civil engineering 8.85B 1.27B 402.91M 10.52B 13591632 2683940 940742 17216314 communication en…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy