REVISOR-25k
A multi-task video understanding dataset for training video LLMs with reinforcement learning (GRPO). The dataset contains ~25k samples spanning Video QA and Temporal Grounding tasks.
Dataset Structure
The dataset is organized into 4 subsets:
| Subset | Task | Samples | Description |
|---|---|---|---|
video_r1 | Video QA | 20,855 | Multiple-choice video question answering |
time_r1 | Temporal Grounding | 2,500 | Locate time intervals in videos |
cg_bench | Temporal Grounding | 1,167 | CG-Bench temporal grounding |
rextime | Temporal Grounding | 837 | ReXTime temporal grounding |
Total: 25,359 samples
Data Fields
| Field | Type | Description |
|---|---|---|
video | string | Relative path to the video file |
video_filename | string | Video filename |
sample_fps | int | Sampling FPS used for training |
original_fps | string | Original video FPS |
duration | string | Video duration in seconds |
video_id | string | Unique video identifier |
conversations | string (JSON) | Full conversation (system + user messages) |
system_prompt | string | System prompt with tool definitions |
query | string | Raw user query |
ground_truth | string | Ground truth answer (letter or time interval) |
data_source | string | Source dataset identifier |
env_name | string | Tool environment name |
ability | string | Task type: "video_qa" or "temporal grounding" |
subset | string | Subset name |
Usage
from datasets import load_dataset
# Load all subsets
ds = load_dataset("YOUR_USERNAME/REVISOR-25k")
# Load a specific subset
video_qa = load_dataset("YOUR_USERNAME/REVISOR-25k", split="video_r1")
temporal = load_dataset("YOUR_USERNAME/REVISOR-25k", split="time_r1")
Directory Structure
REVISOR-25k/
├── README.md
├── data/
│ ├── video_r1/train.parquet
│ ├── time_r1/train.parquet
│ ├── cg_bench/train.parquet
│ └── rextime/train.parquet
└── videos/
├── video_r1/
├── time_r1/
├── cg_bench/
└── rextime/
Citation
If you use this dataset, please cite:
@inproceedings{li2026revisor,
title={Revisor: Beyond textual reflection, towards multimodal introspective reasoning in long-form video understanding},
author={Li, Jiaze and Yin, Hao and Tan, Wenhui and Chen, Jingyang and Xu, Boshen and Qu, Yuxun and Chen, Yijing and Ju, Jianzhong and Luo, Zhenbo and Luan, Jian},
booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
pages={5059--5069},
year={2026}
}