🚀 Open Portuguese LLM Leaderboard — archived
This leaderboard is archived: submissions are closed, the evaluation cluster is off and no new result will be added. The Space is now a static React app that ships the final results with it — it no longer downloads anything from the Hugging Face dataset repos at runtime.
Layout
| Path | What it is |
|---|---|
data/leaderboard.csv.gz | every evaluation, one row per model revision (+ external models and the random baseline) |
data/metadata.json | tasks, baselines, filter vocabularies, snapshot date |
build_static_data.py | compiles the two files above from the eval snapshots, and re-renders the docs |
frontend/ | React + Vite app (TanStack Table + Virtual, all filtering client side) |
frontend/src/content/*.md | documentation generated from src/display/about.py — do not edit by hand |
app.py, src/ | the original gradio app and its result-parsing pipeline, kept for reference and reuse |
Regenerating the snapshot
The compiler reads the dataset snapshots the gradio app used (eval-queue/, eval-results/,
dynamic-info/), so download them first if they are not on disk:
set -a && . ./.env && set +a # HF token + repo ids
HF_HOME=. uv run python build_static_data.py
It rewrites data/leaderboard.csv.gz (~120 KiB) and data/metadata.json.
data/leaderboard.csv.gz is binary, so the Hub stores it in Xet/LFS (*.gz is already in
.gitattributes) — make sure git lfs install has been run before committing a new snapshot,
otherwise the push is rejected. A fresh clone needs git lfs pull before npm run build; the
build aborts if the file is still a pointer.
Front-end
npm install
npm run dev # http://localhost:5173
npm run build # -> dist/ (what the Space serves)
The Space builds itself (sdk: static + app_build_command: npm run build + app_file: dist/index.html),
but dist/ is also committed: the Hub resolves app_file as soon as the commit lands, before the build
ref exists, and a missing dist/index.html makes the Space report a configuration error. Run
npm run build and commit dist/ together with any change to the app or to data/.