DX and OSS leader working at the intersection of engineering and storytelling. I ship developer platforms, build global developer ecosystems, and drive growth.
I scored the 50,074 most-visited websites for how readable they are to AI agents. Not one scored "excellent." The median site is a 52 out of 100. Here is what the web looks like to an agent.
Publishing an llms.txt is now nearly free, and adoption is climbing. Getting an agent to actually read it is the hard part. We benchmarked both sides. There's good news and bad news.
@maikunari Superpowers for methodology:
https://t.co/lafuE54Tvy
a14y for anything that gets posted to the web:
https://t.co/kqP4tgwH7Q
...and another thing I built that I haven't released yet. ;)
Paul is a gem of a person whom I had the great luck to work with at Google. Even if Impeccable wasn't amazing, I'd say this venture was a good bet. But Impeccable is amazing. It's one of just four must-have tools for every one of my projects. If you haven't checked it out yet, you really should. It will make your work better.
Congrats on the launch, @pbakaus ! I'm really looking forward to what you publish next and where you take Impeccable.
AI raised the floor. Time to raise the ceiling.
Today Iโm launching Renaissance Geek, the company behind Impeccable, backed by @a16z (led by @illscience), and a first partnership with @github .
Hereโs the bet Iโm making ๐
The web has SEO-era plumbing but has not built the agent-era layer yet. The full reports and the leaderboard are live. I would love to hear what you find on your own sites. https://t.co/5DzoCMHsWx
I scored the 50,074 most-visited websites for how readable they are to AI agents. Not one scored "excellent." The median site is a 52 out of 100. Here is what the web looks like to an agent.
It is all open: open spec, open CLI, and a public leaderboard of all 50,074 sites. Check your own in a few seconds:
npx a14y check https://t.co/eRVpT078iC --mode site
@ColinMcDermott However, an unreleased study I've just done using Claude Code shows that you have to link the sitemap.md so the agent can find it. Same with llms.txt. A prompt nudge is even better.
@ColinMcDermott Hey @ColinMcDermott, we did a bunch of evals that showed agents were setting tokens on fire with the traditional sitemap.xml. The markdown version dramatically reduced them and increased discovery of related content.
Everyone selling "AEO" slot content right now is reinventing the link farm. We've seen this movie before, when webmasters tried to cheat PageRank. We know how it ends.
Google already says ignore "inauthentic brand mentions" and that AI optimization is still just SEO. The durable play is the one SEO landed on: be agent-readable, then actually be the best. Everything else is borrowing visibility from a future penalty. Full piece below.