Crawling an entire website used to take:
A Python script.
Playwright or Selenium.
Proxy rotation.
Rate limiting logic.
Error handling.
3 hours of debugging why page 47 returned a 403.
Now it's one API call.
Every web scraping startup that raised millions to solve this problem just became a single endpoint.
Every freelancer charging $500 to "extract website data" just lost their entire business model to a /crawl command.
HTML. Markdown. JSON. Pick your format. No scripts. No browser. No headache.
The entire web scraping industry just got reduced to one line of code.
Someone is going to use this to clone every competitor's website by Friday. 💀
@redBus_in This is extremely disappointing. My Delhi–Katra bus scheduled to depart at 10:00 PM from Kashmere Gate is delayed by over 2 hours. The driver keeps saying “reaching in a while” but no one has shown up.
To make it worse, the bus number was changed without informing through any mesaage or notification — we only found out from fellow travelers.
This level of mismanagement and zero communication is unacceptable. Please fix this ASAP.
Crazy to look back …started as a founding engineer at SeedsAI, building ambitious AI systems with a small, relentless team… and that journey takes a huge leap as we join InsuranceDekho. Grateful for every late night, every challenge, every lesson.
onward and upwards 🚀