Real2Sim2Real presents a promising opportunity for zero-shot robot deployment ๐ค, but how does this paradigm translate to tricky, contact-rich applications such as the game of billiards ๐ฑ?
We argue that an agent can learn the underlying dynamics parameters through interaction!
Can an agent learn a pool tableโs physics by playing on it? ๐ฑ
While agents can close the visual gap, the difference between real world and sim dynamics remains significant. For CoRL late breaking๐ค , we let an agent take real shots to try and close this real2sim dynamics gap: https://t.co/g12jkuuB4n
Very fun short project with @XilunZhangXZ@MatthewFoutter@Luis_A_Pabon@drmapavone
โจ Test-Time Scaling for Robotics โจ
Excited to release ๐ค RoboMonkey, which characterizes test-time scaling laws for Vision-Language-Action (VLA) models and introduces a framework that significantly improves the generalization and robustness of VLAs!
๐งต(1 / N)
๐ Website: https://t.co/pYvytO8OmZ
๐ป Code: https://t.co/bDhjWoNBim
๐๏ธ Datasets and Models: https://t.co/u97uiAFk9V
๐ Serving Engine: https://t.co/JIuhS9xgUw
๐ Paper: https://t.co/q59LkD2iSV