.@RewardAI_ came out of stealth yesterday with OM-1, a robot foundation model trained entirely from human demonstrations.
The part I find interesting is how they collect the data.
Instead of teleoperating a robot, a person wears a device called the Omnibody Hand and simply does the task themselves.
Pick something up, fold laundry, mix a drink, package a phone, or plug and unplug cables.
The system records the human hand motion, tactile information, proximity, vision and position. That data can then be used to train OM-1 to control different robot bodies.
Reward calls the idea:
“One Model, One Data Interface, Any Body.”
According to the company, a new task can be learned from less than 30 minutes of human demonstration data, without collecting additional robot data.
The videos are worth watching.
They show four robot arms packaging a phone, robots folding laundry and mixing cocktails, an arm unplugging an Ethernet cable, and early experiments with humanoids.
Some of the longer tasks finish in under 30 seconds, in real time.
There is also some history behind this.
Reward AI builds on DexCap, work that came out of Stanford in 2024 around capturing human dexterous manipulation and transferring it to robots. @chenwang_j , C. Karen Liu and Li Fei-Fei were among the researchers involved.
I think the bigger bet here is about the data layer.
Robot hardware is changing quickly. If collecting training data means teleoperating every new robot body for thousands of hours, scaling gets expensive fast.
Reward is betting that you can collect much of that knowledge from humans instead, then transfer it across different embodiments.
That could become quite valuable if it works.
For now, we only have the launch material. There is no paper or open model yet, and Reward has not published the kind of large-scale success-rate data needed to judge robustness.
Still, this is one of the more interesting approaches I’ve seen to the robotics data problem recently.
Source: https://t.co/tYyhp90zGn
——
Weekly robotics and AI insights.
Subscribe free: https://t.co/9Nm01QUcw3
Honestly, watching robot bartenders, robot installers, and humanoid assistants actually get work done autonomously is way more interesting than sitting around worrying about the dangers of AI.
They’re already moving fast and smoothly. Desktop manipulation tasks seem almost effortless, and they look pretty close to being ready for fast customer order fulfillment.
Turning a nut calls for a different kind of control than shaking a cocktail. The range from quick arm movements to careful finger work is pretty compelling here.
Super impressive! The co-design of mechanics, sensing, and data are fantastic, and the policy is incredibly dynamic and smooth! Living the dream toward human-level dexterity! Big congrats to @chenwang_j, @zipengfu and the team!
First GEN-1, now OM-1. {roof is mounting that pre-training on human wearables without teleop or on-robot fine-tuning is a massive step forward for robotics.
The cross-embodiment dexterity (zero-shot!) from tabletop arms to full-body humanoids is wild to see!
Learning from human data could let robot learning scale beyond robot data collection. Cross-embodiment models make this even more interesting - shared skills across different robot bodies. A very promising direction!
This is huge! 🤯
Reliance on real robot data and cross embodiment are big issues of robotics action models! Super excited to see OM1 solving both of them!
The motion is also fast and looks smart!
Great work @zipengfu@chenwang_j!