RealCam Vid Dataset News 25/04/08: We provide torch dataset demo code for example usage of our RealCam Vid. 25/03/26: Release our dataset RealCam Vid v1 for metric scale camera controlled video generation, containing ~100K video clips with dedicated short/long captions and metric scale camera annotations. 25/02/18: Initial commit of the project, we plan to release the full dataset and data processing code in several weeks. DiT based models (e.g., CogVideoX) trained on our dataset will be available at RealCam I2V. Motivation Current datasets for camera controllable video generation face critical limitations that hinder the development of robust and versatile models. Our curated dataset and data processing pipeline uniquely combines diverse scene dynamics with metric scale camera trajectories , enabling generative models to learn both scene dynamics and camera motion in a unified framework. Training Data Variation Static Scene & Dynamic Camera Dynamic Scene & Static Camera Dynamic Scene & Dynamic Camera Existing datasets for camera motions and scene dynamics suffer from domain specific biases and incomplete annotations , limiting their utility for training robust real world models. S…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy