@ericciarla@jeremyphoward@levelsio@DocS anything behind Kasada is failing atm. I emailed your support a bit a go with some domains, but I'll follow up (from my non-burner) :)
@jeremyphoward@levelsio esp. considering more and more sites are becoming hostile to crawlers because of AI
dumping llms.txt into .cursor/rules/ for each lib is essential - the firecrawl / other crawler MCP's don't come close (it's why cursor @docs are indexed locally)