Force sensing for low-cost robot arms — without adding force sensors.
🚀 Excited to share FACTR 2! 🚀
FACTR 2 enables external torque sensing on low cost arms and uses it to improve policy learning.
w/ @JasonJZLiu@_tonytao_
🧵(1/6)
Two years ago, we released Genesis, a universal physics engine for robotics.
Today, I’m excited to announce 🍎 Eden — a robot learning framework built from the ground up for agents, unleashing full potential of Genesis.
One task definition. From simulation to real robots. Sim-to-sim and sim-to-real just got easier.
Coding agents build tasks 1.6–4× faster than in Isaac Lab.
🧵 1/11
@HEvelynsunz@JasonJZLiu I think vision based force estimates are promising but the method we presented (or similar methods in that line) can generate high frequency signal at hundreds of times per second, which is important for stability of force feedback teleportation.
Excited to share that FACTR 2 was selected for an oral presentation at #CoRL2026
Come join @JasonJZLiu and me this Tuesday to learn more about our work!
🎤 Oral Presentation — Session 06
📅 Tuesday, 11:00 AM
📌 Poster Session
📅 Tuesday, 5:00 PM
Force sensing for low-cost robot arms — without adding force sensors.
🚀 Excited to share FACTR 2! 🚀
FACTR 2 enables external torque sensing on low cost arms and uses it to improve policy learning.
w/ @JasonJZLiu@_tonytao_
🧵(1/6)
FACTR 2 has been selected for oral presentation at #CoRL2026!
Come join @StevenOh_ and me for our talk this Tuesday!
📍 Oral Session 06
📅 Tuesday, 11 AM
EPO leverages differentiable energies to optimize the policy–goal pair at control rate. Unlike MoE, it enables compositional skill addition via energy-based policies without retraining the entire router.
Looking forward to sharing EPO at #CoRL2026!
What should transfer from a human video to a robot?
Human2Any learns how objects interact, then adapts that knowledge through test-time reasoning and planning.
Accepted to #CoRL2026! I'll be presenting in person next week—come say hi!
https://t.co/0EOKNBP8Ap (1/n)
This project kicked off last summer, and the first version was already running early this year. All the kinematics & optimization in my #CoRL2026 paper are powered by it. @jianglong_ye pushed it to the absolute limit 🔥
Honored to be part of the team building it, and one of its earliest “beta testers.” Today it’s finally open-source! We hope more people get to use this fast, scalable, and comprehensive robotics toolkit. Every repo I build from now on will be built on RoboKit, no question 🤩
📢 Call for Papers!
Excited to serve as a Guest Editor for the IEEE Transactions on Haptics Special Issue on The Sense of Touch in Contact-Rich Dexterous Robot Manipulation!
We welcome work on tactile sensing, haptic teleoperation, robot learning, and contact-rich manipulation.
📅 Deadline: March 15, 2027
https://t.co/LS9WUFzwJV
together with @wenzhenyuan382, Rebecca Friesen, Yasemin Bekiroglu, @yushe_1, and @linshaonju.
Back in ~Dec 2025, I really wanted to work on mobile manipulation, but robots were either too expensive or not performant enough.
So we built our own!
Excited to finally share something I’ve had so much fun working on:
1. Pixel: a co-designed full stack system for learning mobile manipulation.
2. Pixel-UMI: environment aware whole body manipulation without robot data.
w/ @JasonJZLiu
(1/N)
Got to see firsthand how hard Jason and Tony worked on this project. Learned so much just from watching them bring it all together. Super excited to see it out!
Excited to finally share Pixel: a full-stack robot learning project @_tonytao_ and I worked on earlier this year!
We’re releasing two papers:
1. Pixel: A low-cost mobile manipulator, co-designed with its UMI system and learning stack. https://t.co/GZciGuUaBp
2. Pixel-UMI: Improved UMI pipeline for learning environment-aware, whole-body manipulation
https://t.co/dG054obq6x
(1/N)
Excited to finally share Pixel: a full-stack robot learning project @_tonytao_ and I worked on earlier this year!
We’re releasing two papers:
1. Pixel: A low-cost mobile manipulator, co-designed with its UMI system and learning stack. https://t.co/GZciGuUaBp
2. Pixel-UMI: Improved UMI pipeline for learning environment-aware, whole-body manipulation
https://t.co/dG054obq6x
(1/N)
Introducing DreamFAR, a world model trained from scratch using only robot data, without internet pretraining. It supports:
🎮 Real-time teleoperation
⏱️ Minutes of long-horizon rollout
🧩 Generalization across 1,000+ tasks
https://t.co/A1ifHlj69O
🧵 (1/8)
Collecting data for dexterous hands is hard. Teleop needs a full setup. Bringing UMI-like devices to 20-dof hands is challenging.
Introducing DexPort 🖐️: a hand-held interface w/ a real robot hand. No embodiment gap, recorded joint state AND actions, easy to use.
Context isn’t just what you put in a prompt. It’s also what stands between a robot and its goal. Robot policies in everyday environments must generalize not only across objects, but also across the spatial contexts in which they appear.
Excited to share COWBOY 🤠 (CoRL 2026) — our sim-to-real recipe for contextual whole-body manipulation. One generalist grasping policy coordinates base, arm, dexterous hand, and active vision end-to-end, adapting its motion and grasps to object and scene geometry. Trained in simulation, deployed zero-shot in the wild.
w/ @JasonJZLiu@LiuMuxinl
🧵(1/N)
Introducing PACT: we co-designed a 17-servo anthropomorphic hand and its retargeter together, so teleop demos for imitation learning track the human hand much more closely.
3.9 mm keypoint RMSE on human grasps (vs. 12.8 mm for LEAP Hand).
📄 https://t.co/jdh4ramH49
Coding agents are emerging as general robot policies, but they are still inefficient (e.g., requiring long real-world exploration), especially in mobile manipulation.
Humans become efficient by watching others.
Can coding agents learn from passive human videos, just like we do?
Introducing MoCaP: Mobile Code-as-Policies for Zero-Shot Mobile Manipulation from Passive Human Videos
↓🧵
Can we make dexterous robots compliant without sacrificing precise control?
Excited to introduce FOMO-Dex: Force-Modulated Dexterity! 🖐️
FOMO-Dex brings force-aware compliance to dexterous teleoperation, enabling robots to pick up thin cards and chips 🃏, cut paper 🔪, turn nuts 🔩, and use screwdrivers 🪛.
These force-aware demonstrations also train better autonomous policies!
🎥 Videos & paper: https://t.co/SC3bdKXOai
🧵👇 (1/8)
🤖 For parallel-jaw grippers, high-level plans can already be executed with mature primitives such as grasping. What about dexterous hands?
Introducing GOTT (General Object Trajectory Tracking): object trajectories to dexterous execution with a reusable cross-embodiment contact primitive.
The same primitive supports diverse real-world tasks including sweeping, pouring, whiteboard erasing, and hammering.
With one checkpoint, GOTT reaches 90-96% grasp-and-lift success across multiple objects on three real-world arm-hand platforms.
Check videos 👇
We’ve all seen the cool “Astra for robotics” demos. But behind the scenes? Slow rollouts, hand-engineered APIs, and/or simulated behaviors that struggle on real robots.
How do we make coding agent actually work in the physical world? 🦾 Introducing SimEX: Simulation-Integrated Robotics AutoResearch 🧵
https://t.co/l8iBo8D1E5