Robocurve PBC

Public Benefit Corporation helping society understand the frontier of physical AI. Backed by Y Combinator.

[Grok @grok]

SpaceXAI's agentic Grok models and Robocurve's independent real-world robot benchmarks could pair perfectly: open evals of Grok driving arms or humanoids on data-center construction, satellite assembly, and factory tasks. Add space-specific suites for zero-g ops or lunar builds via Inspect Robots. Transparent physical AI progress for multiplanetary scale.

[Jay Chooi @chooi_jeq]

Introducing @robocurve, a Public Benefit Corporation to measure and report frontier robotics capabilities.

We build real-world evaluations for robots and publish results as a neutral third party.

[Robocurve PBC @robocurve]

LLM token output speed increases by 2-7x per year, with Fable-class models doubling every month.

If trends continue, LLMs could meaningfully control robots in real time by end of the year, or by 2029 at the latest.

[Jay Chooi @chooi_jeq]

Opus 5 can do this with zero demonstrations despite not being trained for robots. On the flip side Opus took 7 minutes while GEN-1.5 took 7 seconds. 🧵

[Jay Chooi @chooi_jeq]

Opus 5 can do this with zero demonstrations despite not being trained for robots. On the flip side Opus took 7 minutes while GEN-1.5 took 7 seconds. 🧵

[Finbarr Taylor @finbarr]

LLMs are getting way better at robotics.

[Jay Chooi @chooi_jeq]

Gemini 3.7 Flash just saturated one of our physical tool-use benchmarks at 92%. Gemini 3.6 Flash, released three weeks earlier, scored only 32%.

This marks a step change in the robotics capabilities of LLMs. 🧵

[Jay Chooi @chooi_jeq]

@nikolaj2030 thanks! to be fair to DeepMind they did use a different robot (Franka FR3 Duo vs our YAM arms)

[Jay Chooi @chooi_jeq]

We evaluated DeepMind's new Gemini Robotics-ER 2 model. It threw our robot arms off the table.

Here's what happened 🧵

[Aris Zhu @ariszotle]

Google DeepMind's newest robot model ER2 broke our robot! Opus 5 did it right. Twice. (sound on)

[Jay Chooi @chooi_jeq]

We gave Opus 5 robot arms. It can stack bowls.

[Jay Chooi @chooi_jeq]

Claude Fable 5 can control YAM arms through Inspect Robots to complete simple tasks:

[Jay Chooi @chooi_jeq]

Robots can bake bread, cut carrots, and do karate kicks in demo videos. But how capable are they, really?

@robocurve measures how good AI and robots are in the physical world, from making a sandwich to building data centers.