@ItsAnkitAg@spirosx Both! We use agents to read lots of trajectories (Appendix G talks about this), but some of our reward-hacking discoveries came from a separate study where we compared pairwise judges to pointwise judges - and then agents studied the reasons why they differed.
We made a thing! ๐ค๐ SRE-1 is a 27B model that dominates the Pareto frontier of accuracy/cost on production debugging, beating frontier models in a coding-adjacent domain. Built by 11 people on open weights models + domain expertise. Final run: 7.4 days on 512 GPUs.
Claude's musings on the world.
It built the whole thing with code, in 3D.
I asked Claude Code (Opus 5.5) to make a video about itself. I gave it a cloud GPU, Blender, and a bunch of image/voice/music APIs. It picked the subject, wrote it, and made every shot. ~9h end-to-end.
It sounds insane, because we're used to a particular way of doing research: of giving and receiving credit, of counting beans, of hiring, recruiting, and promoting. And the machine god came to crush that game. The old game is dead. That reasonably causes incredible amounts of dread for many folks, who understand this as the death of research.
But it's not about Research, but the way we played the game. The old game was built around scarcity, scarce compute, scarce students, scarce hours, scarce people who knew the right technique and method etc. Most of a research career went into managing and playing along these constraints. Those walls just came crushing down. One person with a good question can now do what used to take a lab and five years.
You do not need permission, you do not need a big grant, you do not need a professor or researcher title, or a team of twenty experts , or one thousand gpus to stare straight into the first light of the universe.
How absolutely incredible
Announcing napkinsโ.dev 2.0!
An open source wireframe to app tool powered by Llama 4. Upload a screenshot of a simple site/design & get code.
100% free and open source.
Matt Mochary has been CEO coach to @naval, the founders of OpenAI, Notion, Rippling, Robinhood, Coinbase, Reddit, Plaid, Flexport, Opendoor, partners at Sequoia, YC, Benchmark, and many others.
He also open-sourced his entire curriculum, templates and all. Here's a link ๐