X VLA (LeRobot) X VLA is a Vision Language Action foundation model that uses soft prompts to handle cross embodiment and cross domain robot control within a unified Transformer architecture. Original paper: X VLA: Soft Prompted Transformer as Scalable Cross Embodiment Vision Language Action Model Reference implementation: https://github.com/2toinf/X VLA LeRobot implementation: Follows the original reference code for compatibility. Model description Inputs: images (multi view), proprio/state, optional language instruction Outputs: continuous actions Training objective: flow matching Action representation: continuous Intended use: Base model to fine tune on your specific use case Quick start (inference on a real batch) Installation For full installation details (including optional video dependencies such as ffmpeg for torchcodec), see the official documentation: https://huggingface.co/docs/lerobot/installation Load model + dataset, run select action Training step (loss + backward) If you’re training / fine tuning, you typically call forward(...) to get a loss and then: Notes: Some policies expose policy( batch) or return a dict; keep this snippet aligned with the policy API. Use your…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy