Nathan

Building AI tools, web apps and sharing what ships, what breaks, and what I’d do again.

TrustTraffic🤖🔍:

[Nathan @NathanAdev]

time to share what I've been building

it's a tool that allows you to see ai crawler traffic, and check if you website *actually* gets recommended by AI, Perfect for GEO

It's live now at https://t.co/CbIPCYPUpV 🚀🌑

#BuildInPublic #GEO

[Nathan @NathanAdev]

@krudhrah crawler access is step zero and the one nobody verifies. check your logs for which AI bots actually show up, not just what robots.txt says. most people are surprised.

[Nathan @NathanAdev]

@glenngabe @gaganghotra_ @eastdakota search access and training access being separate switches is still news to a lot of site owners. most assume blocking one blocks the other.

[Nathan @NathanAdev]

@RivetBay the two switches thing trips up a lot of people. blocking GPTBot is a fair call, blocking OAI-SearchBot is how you quietly vanish from ChatGPT answers.

[Nathan @NathanAdev]

@Raveneyeglobal the part that gets me is most owners don't know which bots they're blocking until they open the server logs. robots.txt says what you want to happen, logs say what actually happened.

[Nathan @NathanAdev]

per Cloudflare Radar numbers (via https://t.co/g5IJkDj3Sc, Q2 2026): ClaudeBot crawls ~4,580 pages per visitor it sends back. Googlebot is ~5.

so who's actually getting paid for your pages? reply with your domain, i'll show you which AI bots hit it this week #GEO

[Nathan @NathanAdev]

fun one: Googlebot feeds search AND AI training, so you can't block it without vanishing from Google (Cloudflare's 2025 year in review).

most sites block GPTBot and call it done. i made a free grader for that.

[Nathan @NathanAdev]

stripe: "we need more info to verify your business".
me: it's a guy and a laptop.
stripe: "we need more info"
#BuildInPublic

[Nathan @NathanAdev]

@alexgroberman the PH launch = 1,000 customers hope is painfully accurate.

[Nathan @NathanAdev]

@Divyyanshishrma does it actually check robots.txt blocking too? that's usually the silent killer.

[Nathan @NathanAdev]

@shmidtqq great framing. the creepy part is how many of them ignore robots.txt.

[Nathan @NathanAdev]

@mehmetaliyassi "no harm done" is fair, but worth checking if anything fetches it at all.

[Nathan @NathanAdev]

heres the weirdest one and in my zoo so far

[Nathan @NathanAdev]

rarest animal in my zoo so far: a bot i'd never heard of, visiting at 4am like it owns the place. what's in yours?

see your zoo at https://t.co/CbIPCYPmAn

#BuildInPublic

[Nathan @NathanAdev]

apple bot as a penguin fits so hard

[Nathan @NathanAdev]

the zoo is just your server logs with a cuter outfit on. that's the whole trick. real bots, real visits, tiny pixel animals

see yours at https://t.co/CbIPCYPmAn👈

[Nathan @NathanAdev]

built a city out of your site's crawler traffic. every page is a building, taller = more bot visits. the tallest one is the golden tower in the middle. guess which page it is 👀

[Nathan @NathanAdev]

a log study of 12 sites found GPTBot hits a new post inside ~2.4 days. ClaudeBot takes ~6.8. you publish today, one reads it Monday, the other next Friday. you'd never know. trust traffic shows which bot, when.

try it at -> https://t.co/CbIPCYPUpV👈

will always be free

#GEO

[Nathan @NathanAdev]

@AndySkraga Pdf

[Nathan @NathanAdev]

yes i just watched loki
yes it was good
yes im sad its over

[Nathan @NathanAdev]

Cloudflare says bots are now 57.5% of HTML traffic.

your analytics reports almost none of it, because AI crawlers don't run JavaScript. server-side is the only place they show up. and you can't track that

But i can

(with https://t.co/CbIPCYPmAn👈)

free, for all time. always.