I'm a featured interview in our latest behind-the-scenes release! We break down the ML and perception that drives the whole-body manipulation behaviors from last year. It starts with a neat demo of Atlas's range-of-motion and our vision foundation models. https://t.co/pABFxxQZlo
Most world models for robot manipulation learn physics from pixels. But pixels don’t see it all.
Can we ground these models in the "feeling" of contact to disambiguate visually identical states?
Visuo-Tactile World Models (VT-WM): robot imagination in a shared space👇
Check out UMI-FT, the newest member of the UMI family! 🐣
We integrated a coin-sized🪙, low-cost, 6-axis force-torque sensor behind each UMI Fin Ray finger.
The sensor is physically compact, mechanically robust, and extremely easy-to-calibrate against ATI -- directly measures physically meaningful force/torque outputs (N/Nm).
UMI-FT enables in-the-wild robot learning with force-aware manipulation data, without needing in-the-wild robots or relying on traditional, bulky, thousands-dollar F/T sensors!
A cross-paradigm bonus: because the coinFT sensor outputs physically meaningful force/torque values (N/Nm), you can directly run standard admittance control to get F/T-aware compliant robot fingers -- no learning required, immediately useful!
Checkout @Hojung_Choi_' post for deets!
I will join UChicago CS @UChicagoCS as an Assistant Professor in late 2026, and I’m recruiting PhD students in this cycle (2025 - 2026).
My research focuses on AI & Robotics - including dexterous manipulation, humanoids, tactile sensing, learning from human videos, robot systems, and anything needed to make robots truly work and improve everyday life. I also place strong emphasis on open-source.
Check my homepage to learn more: https://t.co/gBZAFrwZmg.
Please reachout if you are interested! The deadline is Dec 11th. Link: https://t.co/yKTmcZu7FP.
Same for ego data, UMI data, etc. An open secret is “we used ego4d” actually means filtering out the 1% of videos that are vaguely useful for learning.
Occlusions, suboptimality, sensor noise, and so many pitfalls!
Modeling + collect co-design is only gold standard currently.
I'm super excited to announce mjlab today!
mjlab = Isaac Lab's APIs + best-in-class MuJoCo physics + massively parallel GPU acceleration
Built directly on MuJoCo Warp with the abstractions you love.
I'll be giving a talk @CoRL2025 about developing large behavior models on Atlas. Come by the dexterous manipulation workshop at 11:30 to see the talk, https://t.co/PaM1fAcYvM
Can we scale up mobile manipulation with egocentric human data?
Meet EMMA: Egocentric Mobile MAnipulation
EMMA learns from human mobile manipulation + static robot data — no mobile teleop needed!
EMMA generalizes to new scenes and scales strongly with added human data.
1/9
Lucas and co. wrote a great blogpost on the careful science and engineering behind language-conditioned policies for whole-body manipulation!
There's a lot more work on the horizon; our team is hiring researchers to scale egocentric human data and VLMs for robotics. Reach out!
Today I’m proud to share what I’ve been working on recently with my team at @BostonDynamics along with our collaborators at @ToyotaResearch .
https://t.co/yExkGIdwxb
📹Recording now available!
If you missed our workshop at RSS, you can now watch the full session here: https://t.co/1VnLjRyleN
Thanks again to all the speakers and participants!
TRI's latest Large Behavior Model (LBM) paper landed on arxiv last night! Check out our project website: https://t.co/AV2cmfeX40
One of our main goals for this paper was to put out a very careful and thorough study on the topic to help people understand the state of the technology, and to share a lot of details for how we're achieving it.
https://t.co/EVFLJAY6Zu
Current robot policies often face a tradeoff: they're either precise (but brittle) or generalizable (but imprecise).
We present ViTaL, a framework that lets robots generalize precise, contact-rich manipulation skills across unseen environments with millimeter-level precision. 🧵