Finally we made it work through open-loop replaying sim actions! Before that, Sim2Real process was always a headache. That said, simulation training is still pretty valuable as a way of efficiently exploring possible solutions to a dynamic, contact-rich task like “pen spinning”.
When I started my first project on in-hand manipulation, I thought it would be super cool but also quite challenging to make my robot hands spin pens. After almost 2.5 years of effort in this line of research, we have finally succeeded in making our robot hand "spin pens."
Happy to share our work accepted by RSS2026! Hierarchical policy structures and sub-goal specifications can not only help single-task generalization but also benefit cross-task learning from human videos. Nice work @sriramsk99 !
Boo! 👻 GHOST has been accepted to #RSS2026!
Can we learn manipulation skills from human video (without action retargeting)?
Yes! GHOST learns generalizable manipulation skills by training a hierarchical policy with an embodiment-agnostic sub-goal predictor + embodiment-specific controller.
🧵(1/7)
Because of you, I couldn’t charge and ended up dealing with a ticket. If your charger’s down, move to another spot - don’t make it everyone else’s issue.
To the Tesla driver who parked at @CarnegieMellon East Campus Garage today:
You don’t get to hijack a charging port from across the garage just because yours wasn’t working.
Unitree Spring Festival Gala Robots —a Full Release of Additional Details 🥳
Dozens of G1 robots achieved the world’s first fully autonomous humanoid robot cluster Kung Fu performance (with quick movement), pushing motion limits and setting multiple world firsts! H2 made striking appearances at both the Beijing main venue and the Yiwu sub-venue, clad in the Monkey King’s heavy armor and riding a “somersault cloud” played by B2W quadruped robot dogs, delivering New Year blessings from the clouds.
How far can we push dexterous robot manipulation with human video-only supervision and minimal assumptions?
🚫 No teleop. 🚫 No wearables. 🚫 No external sensors. 🚫 No robot demos.
Introducing VIDEOMANIP: 🎥 Just monocular RGB, 🌍 in-the-wild human video → dexterous robot manipulation 🤚[1/6]
A closed door looks the same whether it pushes or pulls. Two identical-looking boxes might have different center of mass. How should robots act when a single visual observation isn't enough?
Introducing HAVE 🤖, our method that reasons about past interactions online! #CORL2025
Introducing ArticuBot🤖at #RSS2025, in which we learn a single policy for manipulating diverse articulated objects across 3 robot embodiments in different labs, kitchens & lounges, achieved via large-scale simulation and hierarchical imitation learning.
https://t.co/A0SZbAzhAh
🧵
Training robots for the open world needs diverse data
But collecting robot demos in the wild is hard!
Presenting DexWild
🙌🏕️ Human data collection system that works in diverse environments, without robots
💪🦾 Human + Robot Cotraining pipeline that unlocks generalization
🧵👇
Low-cost teleop systems have democratized robot data collection, but they lack any force feedback, making it challenging to teleoperate contact-rich tasks.
Many robot arms provide force information — a critical yet underutilized modality in robot learning.
We introduce:
1. 🦾A low-cost, force-feedback-enabled teleop system.
2. 🥊Force-Attending Curriculum Training (FACTR) uses force to improve generalization in complex, contact-rich tasks.
https://t.co/0CmtIsC30Z
🧵(1/N)
🤖 Want to train a humanoid to stand up safely and smoothly?
Try HumanUP: Sim-to-Real Humanoid Getting-Up Policy Learning! 🚀
✨ HumanUP is a two-stage RL framework that enables humanoid robots to stand up from any pose(facing up and down) with stability and safety.
Check out our new project:
Learning Getting-up Policies for Real-world Humanoid Robots!
A huge thanks to our team for making this possible! 💪🎉@RunpeiDong@C___eric417@_saurabhg
Project page: https://t.co/0Vvsg3ve0K
Paper: https://t.co/csbGpzx8yU
Everything you love about generative models — now powered by real physics!
Announcing the Genesis project — after a 24-month large-scale research collaboration involving over 20 research labs — a generative physics engine able to generate 4D dynamical worlds powered by a physics simulation platform designed for general-purpose robotics and physical AI applications.
Genesis's physics engine is developed in pure Python, while being 10-80x faster than existing GPU-accelerated stacks like Isaac Gym and MJX. It delivers a simulation speed ~430,000 faster than in real-time, and takes only 26 seconds to train a robotic locomotion policy transferrable to the real world on a single RTX4090 (see tutorial: https://t.co/bEkIlCKqdf).
The Genesis physics engine and simulation platform is fully open source at https://t.co/DhBv7NdyqH. We'll gradually roll out access to our generative framework in the near future.
Genesis implements a unified simulation framework all from scratch, integrating a wide spectrum of state-of-the-art physics solvers, allowing simulation of the whole physical world in a virtual realm with the highest realism.
We aim to build a universal data engine that leverages an upper-level generative framework to autonomously create physical worlds, together with various modes of data, including environments, camera motions, robotic task proposals, reward functions, robot policies, character motions, fully interactive 3D scenes, open-world articulated assets, and more, aiming towards fully automated data generation for robotics, physical AI and other applications.
Open Source Code: https://t.co/DhBv7NdyqH
Project webpage: https://t.co/SBNyhFB0yn
Documentation: https://t.co/3yuBoaealV
1/n
As my kids are singing APT non-stop these days, I did a bit of reverse engineering of the APT music video and tried to understand why the MV is so addictive.
Here is what I learned.
Want to use tactile sensing but not familiar with hardware?
No worries!
Just follow the steps, and you’ll have a high-resolution tactile sensor ready in 30 mins! It’s as simple as making a sandwich! 🥪
🎥 YouTube Tutorial: https://t.co/AOtturFcv5
🛠️ Open Source & Hardware Guide: https://t.co/Hl6fJwVUPP
🌐 Project Website: https://t.co/73NRCamUkq
Let’s make robotics more tactile! 🤖 #Robotics #TactileSensing #AI #opensource
Introducing TAX3D, in which we extend relative-placement methods to generalizable deformable manipulation! #CoRL2024 (1/🧵)
Our approach generalizes to:
- Diverse unseen objects
- Diverse unseen configurations
- Multimodal placements
We’ve seen humanoid robots walk around for a while, but when will they actually help with useful tasks in daily life?
The challenge here is the diversity and complexity of real-world scenes.
Our new work tackles this problem via 3D visuomotor policy learning. Using data from only 1 scene, our Improved 3D Diffusion Policy (iDP3) enables a full-sized humanoid robot to autonomously pick&place objects, pour water, and wipe tables, in the wild open world.
(and all these skills are useful, right?)
Web: https://t.co/584I6UJh7k
Fully open-sourced code: https://t.co/wNxOxkFxLR
How can an autonomous agent leverage novel tools to cut, roll, and scoop a piece of dough, given just a few tool shapes for training? Our method generates a “desired tool shape” that performs the motion and then matches the real tool to the generated shape.https://t.co/i098zlSfxw
Finally we made it work through open-loop replaying sim actions! Before that, Sim2Real process was always a headache. That said, simulation training is still pretty valuable as a way of efficiently exploring possible solutions to a dynamic, contact-rich task like “pen spinning”.
When I started my first project on in-hand manipulation, I thought it would be super cool but also quite challenging to make my robot hands spin pens. After almost 2.5 years of effort in this line of research, we have finally succeeded in making our robot hand "spin pens."