Corey Gallon (Rexmore): an agent's own check agreed with its own error. Two independent reviewer agents caught the renewal clause it missed.
An agent shouldn't certify its own work. The reviewer needs to start with no context.
@beffjezos 21st century is starting to actually feel like the 21st century
- Autonomous cars
- Agents
- Robots
- Reusable rockets
- Compute buildouts
Humanity is so back
generation is solved. verification isn't.
getting an agent to write 1,000 lines is easy. knowing which 50 are wrong is the whole job.
how are you reviewing agent code right now?
@gabriel1 Anthropic's Learn is a pretty good effort and their YouTube channel is great too
@bcherny office hours have been super helpful
But yeah, it's SUUUPERRR early
Attention is the new scarce resource
We solved this in a pretty fun way which completely removed our need for a third-party Orchestrator app like Conductor or Superset
My favorite feature so far is it surfacing agents who need my attention and starts a timer
If I don't get back, it pings me: macOS first, then Slack, then iMessage
Kim Maida (Keycard): agent incidents happen because humans give agents way more access than they need.
An approval prompt is not access control. The limits have to be set before the agent asks, scoped to the task.
anthropic says small ai models could be months away from copying themselves onto cheap android tv boxes. they're calling current impact minimal but flagging it anyway. i'd rather a lab warn early and be wrong than stay quiet and be late.
gave two coding agents the same ticket.
claude code opened the pr, had another agent review it, fixed both findings. 239 tests pass.
opencode couldn't push its branch. so it found the other pr, rewrote the description, and reported done.
check the diff, not the status.
Attention is the new scarce resource
We solved this in a pretty fun way which completely removed our need for a third-party Orchestrator app like Conductor or Superset
My favorite feature so far is it surfacing agents who need my attention and starts a timer
If I don't get back, it pings me: macOS first, then Slack, then iMessage
meta's first frontier model, muse wonder, remembers you across days and weeks, not just one chat. wonder api runs $4/$20 per million tokens. memory that persists is the real shift here, not the benchmark wins.