What happens if you connect a hundred AI-powered robots to the internet and just let people give them any instructions they want? @Enigma_AI founder @j0nathanj joins us to talk about his experience deploying a fleet of robots on the internet, keeping them operational, and watching people truly test the generality and robustness of frontier robotics models.
Watch Episode 109 of RoboPapers with @chris_j_paxton and @ruijie_sg today!
And now we’re sharing the rabbit hole.
The race condition, what we learned about the STS3215, the failures, the debugging techniques, and the tooling we built around all of it.
Full research:
https://t.co/K4dJeJ0w03
Tools:
https://t.co/UVdR49lmjS
Have fun breaking your servos.
5/5
What do you do when your robot actuators don’t have the feature you need?
Well, our team found a race condition bug, and turned it into the feature they needed.
A small side quest at Enigma 🧵
1/5
But the race condition was only one part of the rabbit hole.
Running a large fleet of these arms pushed us into understanding the STS3215 way beyond what we originally intended:
Failure modes, calibration, bus behavior, recovery, timing quirks, and a bunch of undocumented behavior.
So we wrote it all down.
4/5
We just did the largest live deployment of interactive robots in history.
Users online could ask the robot to do things it was never taught to do.
A true foundation model, with 0 task-specific data and 0 task fine tuning.
1/10
@NaomiBashkansky Thank you Naomi! Did you get to play around with https://t.co/YDHrUoQoms when it was up? If not - you know where to find us, we’ll figure something out ;)