Can’t believe I ever had to write pandas data manipulations by hand and it was actually taking most of my workday
The second half was taken by matplotlib
@theo I didn't want this to be used as a shot against Bob, I was just thinking about him with a smirky look in his bathrobe and the hot chocolate writing this.
Models out of the box have trouble reviewing DoorDash’s codebase, even when feeding them appropriate context. Single-pass AI reviewers only caught 30% of the real issues in our PRs.
Instead, we built a multi-model (Sonnet 4.6 + Opus 4.8) code review agent that caught 53.6% issues at $3.91 a PR (most enterprise code review solutions perform significantly below 50% recall on DoorDash PRs).
Today, we’re proud to share DashBench, our internal benchmark to compare multi-model/harness code review systems against each other. DashBench has given us confidence in maximizing the intelligence per dollar we’re spending on AI tokens to ship code safely.