Dataset Card for RoboFAC RoboFAC is a multimodal VQA dataset for robotic failure analysis and correction, comprising over 10,000 robot manipulation videos and 78,623 question answer pairs. The dataset supports both VQA and failure reasoning tasks across simulated and real world environments. It was introduced in the paper RoboFAC: A Comprehensive Framework for Robotic Failure Analysis and Correction. Files Dataset Details Dataset Description RoboFAC is designed to benchmark multimodal reasoning and error correction in robot manipulation. It includes: 9,440 erroneous robot manipulation trajectories 78,623 QA pairs 16 diverse manipulation tasks 53 unique scenes 1,282 successful robot trajectories (as reference) The dataset contains simulated and real world demonstrations and is organized to support both training and evaluation of vision language and robotic reasoning models. Curated by: MINT Group @ SJTU Language(s) (NLP): English License: MIT License Tasks and Descriptions Task Name Description SpinStack Pick up the cube on the spinning disc and stack it on another cube on the disc. SpinPullStack Pull out the cube on the spinning disc and stack it on another cube on the disc. Microw…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy