QueryRoute Dataset Artifacts This directory is the release target for the frozen QueryRoute action outcome matrix. Model Coverage Create one subdirectory per reformulator backbone under reformulators/ : qwen2.5 7b instruct/ qwen2.5 72b instruct/ llama 3.1 8b instruct/ llama 3.3 70b instruct/ gpt 4.1/ The paper's main table uses Qwen2.5 7B Instruct , but this dataset structure is intended to host all five backbones. Regime Coverage Original queries are grouped by retrieval regime: trec dl : DL19, DL20, and DL Hard. beir : SciFact, ArguAna, TREC COVID, FiQA, DBPedia, and TREC News. bright : Biology, Earth Science, Economics, Psychology, Robotics, StackOverflow, and Sustainable Living. Artifact Types reformulators/ : generated candidate variants for each model, dataset, and reformulator. TREC format ranked lists for bm25 , bge , and splade each runs. scores/ : per query candidate utility matrices. oracle labels/ : per query oracle best candidate ids and ties. qpp features/ : pre retrieval, post retrieval, and neural QPP feature matrices. judge labels/ : optional outcome level judge labels, currently organized around deepseek v3 . manifests/ : machine readable coverage and release meta…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy