Anatomy of a Starpilot Ace
Ace is an agent trained on the Atari-style env Starpilot.
We can trace Ace's sensorimotor chain from pixel inputs to action. Ace's actions appear complex, often sophisticated, but when we pop open the hood they reduce to pure mechanism.
1/12
@REjercitos Es cierto, hoy en día las librerías de deep learning son muy fáciles de usar y existen modelos de visión mucho más eficientes que antes. A lo que me refería con el anterior tuit es que alguien con un mínimo de conocimiento ya podía hacer algo como lo del vídeo fácilmente.
We started by investigating why Claude chose to blackmail. We believe the original source of the behavior was internet text that portrays AI as evil and interested in self-preservation.
Our post-training at the time wasn’t making it worse—but it also wasn’t making it better.
1/ We just released π0.7 — a steerable generalist robot model with emergent capabilities.
I want to share a bit of the backstory, because π0.7 taught me something surprising about where robot learning is heading. A thread on bittersweet lessons ���