JoyAI Image OpenSpatial Spatial understanding dataset built on OpenSpatial, used in JoyAI Image. The full dataset contains about ~3M multi turn visual spatial QA samples across 7 open source datasets and web data. The open source datasets contain ARKitScenes, ScanNet, ScanNet++, HyperSim, Matterport3D, WildRGB D, and Ego Exo4D. Tasks cover a wide range of spatial understanding capabilities including 3D object grounding, depth ordering, spatial relation reasoning, distance estimation, and more. We have released ~2.3M QA samples constructed from the open source datasets. The remaining web data will be open sourced in a future release. Quick Start Data Format Each parquet file contains the following columns: Column Type Description conversations list[{from, value}] Multi turn conversation pairs ( human / gpt ). The human turn provides camera parameters and a spatial reasoning question; the gpt turn provides structured spatial annotations (e.g., 3D bounding boxes, depth ordering, spatial relations). id string Unique sample identifier data source string Source dataset (e.g., arkitscenes , scannet , scannetpp , hypersim , matterport3d , wildrgbd , Ego Exo4D ) images list[{bytes, path}] E…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy