Dataset Card for bailii_260505
Dataset Summary
This dataset contains ~551,000 documents crawled from BAILII, covering judgments, decisions, legislation, and transcripts from courts and tribunals across the United Kingdom, Ireland, the European Court of Human Rights, the European Court of Justice, and other related jurisdictions.
The dataset preserves both the raw HTML content and extracted metadata (court, date, parties, citations, etc.) for each document.
Dataset Details
Dataset Description
- Language(s): English
- Crawl date: 2026-05-05
Dataset Sources
- Source Website: https://www.bailii.org
Uses
Direct Use
Suitable for:
- Legal NLP research and training (case law summarisation, citation extraction, legal reasoning)
- Academic research into judicial decisions, legislation, and tribunal outcomes
- Historical analysis of legal trends across UK, Irish, and EU jurisdictions
- Information retrieval and semantic search over legal documents
Dataset Structure
Schema
| Column | Type | Description |
|---|---|---|
path | string | URL path on BAILII |
title | string | Document title |
citation | string | Neutral citation |
date | string | Document date (e.g. "18 December 1958") |
case_number | string | Case / cause number |
court | string | Court or tribunal name |
venue | string | Physical venue of the hearing |
panel | string | Judges or panel members |
status | string | Document status (e.g. "HTML VERSION OF JUDGMENT") |
database_name | string | Short database code (e.g. num_reg, ECHR, ScotCS) |
html_content | string | Cleaned HTML content of the document |
parties | list<struct<name, role>> | Parties to the case (name and role, e.g. Appellant/Defendant) |
representatives | string | Legal representatives |
Parties struct
| Column | Type | Description |
|---|---|---|
name | string | Party name |
role | string | Party role (e.g. Appellant, Respondent, Plaintiff, Defendant) |
Statistics
| Metric | Value |
|---|---|
| Documents | 551,330 |
| Columns | 13 |
| Databases | 92 |
| Unique courts (non-empty) | 28,035 |
| HTML content size (mean) | ~28 KB |
| HTML content size (median) | ~12 KB |
| HTML content size (max) | ~6.1 MB |
Top databases by document count
| Database | Count | Description |
|---|---|---|
num_reg | 137,990 | UK numbered regulations / statutory instruments |
UKAITUR | 74,911 | UK Asylum and Immigration Tribunal |
ECHR | 31,065 | European Court of Human Rights |
EUECJ | 29,780 | European Union (Court of Justice) |
ScotCS | 22,311 | Scottish Court of Session |
Civ | 21,132 | UK Civil Division cases |
UKEAT | 17,205 | UK Employment Appeal Tribunal |
IEHC | 15,946 | Irish High Court |
Admin | 14,638 | UK Administrative Court |
UKTS | 13,137 | UK Tribunal decisions |
Top courts by document count
| Court | Count |
|---|---|
| EMPLOYMENT APPEAL TRIBUNAL | 11,691 |
| IN THE HIGH COURT OF JUSTICE QUEEN'S BENCH DIVISION ADMINISTRATIVE COURT | 4,853 |
| IN THE COURT OF APPEAL CRIMINAL DIVISION | 4,203 |
| IN THE HIGH COURT OF JUSTICE QUEEN'S BENCH DIVISION | 3,679 |
| IN THE HIGH COURT OF JUSTICE CHANCERY DIVISION | 3,470 |
Coverage completeness
| Field | Non-empty rate |
|---|---|
path, title, database_name, html_content | 100% |
citation | ~72% |
date | ~72% |
case_number | ~16% |
court | ~18% |
venue | ~15% |
panel | ~15% |
status | ~16% |
parties | ~15.5% (85,512 rows with at least one party) |
representatives | ~13.2% (72,533 rows with representative text) |
Dataset Creation
Curation Rationale
BAILII is one of the most comprehensive free-access repositories of British, Irish, and EU case law and legislation. A structured crawl makes this corpus available in a machine-readable tabular format for legal informatics, NLP, and social-science research.
Source Data
Data Collection and Processing
- Tool: Scrapy
- Scope: All documents discoverable via BAILII's database index pages.
- No filtering was applied to content; all discoverable documents are included.
Who are the source data producers?
Courts, tribunals, and legislative drafting offices across the UK, Ireland, and EU. BAILII itself is a non-profit initiative that republishes publicly available legal materials.
Bias, Risks, and Limitations
Content Risks
- The dataset includes full text of legal judgments and decisions, which may contain descriptions of violent crime, sexual offences, child abuse, and other sensitive matters.
- Some documents discuss individuals by name (parties, witnesses, defendants, victims).
- Legislation and regulations may reflect historical social attitudes now considered discriminatory or offensive.
Structural Limitations
- Metadata coverage is highly uneven: legislation items (e.g. statutory instruments) typically have minimal structured metadata, while full court judgments are richer.
- Dates are stored as raw strings in a variety of formats; some very old documents have incomplete or unusual date strings.
- The dataset represents a snapshot in time; BAILII content is continuously updated and some URLs may have changed.
- All content is in English, but some EU and ECHR materials are translations.
Personal and Sensitive Information
- No systematic PII detection or redaction was performed.
- Names of individuals, companies, and public bodies appear in case titles, parties, and judgment text.
- The dataset should be treated as containing potentially sensitive personal information.
Licence and Redistribution
No licence was identified for the source BAILII content. This dataset is therefore marked as license: unknown.
The dataset consists of scraped public legal documents. The dataset publisher does not claim ownership of the underlying text and does not grant additional rights beyond any rights users may already have under applicable law.
Users are responsible for determining whether their intended use is lawful, including with respect to copyright, privacy, data protection, and platform terms.