This is an updated and better extracted version of the wikimedia/Wikipedia dataset originally released in 2023. We carefully parsed Wikipedia HTML dumps from August of 2025 covering 325 languages. This dataset: fully renders templates as it was extracted from HTML and not markdown dumps removes redirects, disambiguation, and other non main article pages includes detailed metadata such as page ID, title, last modified date, wikidate ID, version and markdown version of the text preserves elements and formatting such as headings, lists, code/pre blocks, tables and math content notably, wikimedia/Wikipedia removes all tables and math content excludes most of the "References", "See also", "Notes", "External links", and similar citations/notes sections across all languages besides keeping all math content, pages containing math are flagged with a has math metadata attribute extracts infoboxes (the summary high level information boxes on the right of some wikipedia pages) in a structured format into the metadata, for RAG and other uses only keeps pages whose script (writing alphabet) matches the expected list for that language for non English wikis, any page fully or mostly in English is…
Runs entirely in your browser via DuckDB-Wasm — this dataset's real data file is loaded once, then queried locally. Nothing is sent to a server.
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy