- $10/hr and dropping
- 90 international operators and growing
- No two tasks exactly alike
- Maximum customizability (any change to the environment/operator instructions/etc. is a single phone call to our wonderful team in Mexico)
- Ungodly amounts of custom camera firmware written for max operational efficiency
- A self built 20 petabyte data cluster to store all of this
At Pantheon, we like to bet on things that scale.
This has been and will continue to be an unbelievable push by the team. Infinite moving parts and countless people involved.
How do you build the most diverse UMI dataset in robotics?
In the last 8 weeks, we scaled an international UMI data collection operation from 5 to 90 operators, built out a dataset of over 1M+ unique tasks, and continue to capture over 45k+ new tasks each day.
Robotic World Models require much higher diversity of tasks than imitation learning. Here's the why and how behind our operations. 🧵
Argus: an open-source robotics data annotation and quality pipeline.
With new frontier VLMs like GPT-6 Astra, we can generate rich, high-quality annotations for robotics data for both training and dataset analysis. Argus delivers detailed, timestamp-level annotations while catching issues like mislabeled instructions, sped-up recordings, swapped camera streams, and unflagged operator mistakes.
To support better data quality for the robotics community, we’re open-sourcing Argus for anyone to use 🧵
We (@PantheonInc) have been working on a robotics data quality pipeline that uncovered a series of major problems in public robotics datasets, especially for world modeling.
To improve the quality of data available to open-source robotics, we're publishing annotations for four of the most popular datasets. Some examples of issues, and our report 🧵