Martian World Model: Controllable Video Synthesis with Physically Accurate 3D Reconstructions M3arsSynth Dataset Summary M3arsSynth is a large scale, multimodal dataset designed for controllable Martian video synthesis. Derived from real NASA Planetary Data System (PDS) imagery, the dataset features over 10,000 physically accurate 3D scenes rendered into video clips. Each clip is paired with its corresponding camera trajectory and rich textual descriptions, enabling the training of sophisticated, controllable generative models. Dataset Structure and Content The dataset is organized into training and validation splits, which are defined by a list of samples in the annotation.json file. The associated media files are stored in corresponding directories. annotation.json : A JSON file containing a list of data samples for both train and val splits. This file is the main entry point for the dataset. train video/ & val video/ : Directories containing the rendered .mp4 video clips. train camera/ & val camera/ : Directories containing .txt files with the corresponding 6 DOF camera poses for each video. Each entry in annotation.json is a dictionary that represents one data sample. The field…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy