stanford-oval/ccnewsThis dataset is the result of processing all WARC files in the CCNews Corpus, from the beginning (2016) to June of 2024. The data has been cleaned and deduplicated, and language of articles have been detected and added. The process is similar to what HuggingFace's DataTrove does. Overall, it contains about 600 million news articles in more than 100 languages from all around the globe. For license information, please refer to CommonCrawl's Terms of Use. Sample Python code to explore this… See the full description on the dataset page: https://huggingface.co/datasets/stanford oval/ccnews.

ccnews

PUBLIC

Mirrored

This dataset is the result of processing all WARC files in the CCNews Corpus, from the beginning (2016) to June of 2024. The data has been cleaned and deduplicated, and language of articles have been detected and added. The process is similar to what HuggingFace's DataTrove does. Overall, it contains about 600 million news articles in more than 100 languages from all around the globe. For license information, please refer to CommonCrawl's Terms of Use. Sample Python code to explore this… See the full description on the dataset page: https://huggingface.co/datasets/stanford-oval/ccnews.

Formats:parquetLibraries:Datasets, Dask, Polars, Croissant

imported

huggingface

minio

task_categories:text-classification

task_categories:question-answering

task_categories:text-generation

language:multilingual

language:af

language:am

language:ar

language:as

language:az

language:be

language:bg

language:bn

language:br

language:bs

language:ca

language:cs

language:cy

0downloads0likes20 GB

Dataset Card

Edit

No dataset card provided yet.

Formats

parquet

Source

Mirrored from an external registry.

Last synced 6/13/2026

Dataset Viewer

API

Preview not yet available for this dataset