📜 Source Data & Attribution This dataset is a processed derivative of nick007x/github code 2025 . Origination The original data was aggregated by nick007x from public GitHub repositories. We have retained the original content, file paths, and metadata while restructuring the format for easier consumption by language specific models. Processing Steps To create this dataset, we performed the following processing on the source data: 1. Language Identification: We mapped file extensions (e.g., .py , .rs , .ts ) to their respective programming languages using a comprehensive extension map. 2. Splitting: The dataset was sharded and split into separate sub directories/categories by programming language to allow for targeted loading (e.g., loading only Python or Rust data). 3. Filtering: Binary files and ambiguous extensions were categorized as "Unknown" or removed to ensure text based model compatibility. Licensing Information The data contained in this dataset belongs to the original authors of the code repositories on GitHub. Source Aggregation: The aggregation was provided by nick007x/github code 2025 . Individual Code Files: Each file typically retains the license of its original rep…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy