Cosmos Reason1: Physical AI Common Sense and Embodied Reasoning Models Cosmos Code Paper Paper Website Model Overview Description: NVIDIA Cosmos Reason – an open, customizable, 7B parameter reasoning vision language model (VLM) for physical AI and robotics enables robots and vision AI agents to reason like humans, using prior knowledge, physics understanding and common sense to understand and act in the real world. This model understands space, time, and fundamental physics, and can serve as a planning model to reason what steps an embodied agent might take next. Cosmos Reason excels at navigating the long tail of diverse scenarios of the physical world with spatial temporal understanding. Cosmos Reason is post trained with physical common sense and embodied reasoning data with supervised fine tuning and reinforcement learning. It uses chain of thought reasoning capabilities to understand world dynamics without human annotations. Given a video/image and a text prompt, the model first converts the video/image into tokens using a vision encoder and a special translator called a projector. These video tokens are combined with the text prompt and fed into the core model, which uses a m…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy