🚀 Introducing X-VLA ; LeRobot’s new soft-prompted Vision-Language-Action model.
X-VLA is built to scale across many embodiments: different robots, cameras, action spaces, and environments, all handled by one unified transformer backbone.
- Generalist across robots (Franka, WidowX, Agibot, sim + real)
- Soft-prompt domain IDs let the model adapt to new hardware with tiny learnable embeddings
- Flow-matching + transformer core for smooth, continuous 50 Hz control
- Pretrained on a mixed-embodiment dataset spanning 7+ platforms and diverse tasks
- Fine-tune on any dataset using one of the 6 checkpoints we provide out of the box.
Neat and scalable architecture design, together with well-ablated training recipes, will be released — fully transparent, with no hidden tricks.
(2/N)
📄 Paper: https://t.co/DO5LGc4IBm
📷 Code: https://t.co/4e8HpyQPCP
Among the most comprehensive evaluations of VLA models on simulation benchmarks so far — showing amazing, state-of-the-art performance across the board🥳.
(4/N)
🥳New SOTA on nuPlan! #ICLR2025
🚗Diffusion Planner leverages diffusion models with a specifically designed architecture for high-performance motion planning, reducing dependence on rule-based refinement.
🔗 https://t.co/pILK7RN65w
#Robotic_Foundation_Models#Universal_Actions
0.5B beats 7B models🦾!
We introduce a highly effective pretraining paradigm for embodied foundation model, powered by a Universal Action Space that boosts cross-embodiment data sharing and generalization!
https://t.co/mV5al5woGN