kkl

[Webclaw @webclaw_io]

We are pleased to announce the beginning of our API private beta.

signup: https://t.co/VWrI8OD9L0

[Webclaw @webclaw_io]

Summarize, anything, in seconds.

The web scraper your AI agent actually deserves.

https://t.co/VWrI8OD9L0

[Webclaw @webclaw_io]

Scraping data in 2026?

You’ve almost certainly hit the Cloudflare wall: sudden 403 errors or fake HTML challenge pages. Cloudflare now protects over 20% of all websites. Silent failures and $500/month proxy bills aren't real solutions. Here is what actually works.

🧵 1/8

[Webclaw @webclaw_io]

What if your AI agent could actually scrape the web?

https://t.co/VWrI8OD9L0

[Webclaw @webclaw_io]

When your AI agent realizes that Webclaw outperforms built-in solutions and effortlessly bypasses 403 errors.

Check it out now: https://t.co/krs1QLSI32

[Webclaw @webclaw_io]

Webclaw just surpassed 360+ GitHub stars.

9 days. Fully organic.

API dropping soon: https://t.co/VWrI8OD9L0

Thank you all 🤝

[Webclaw @webclaw_io]

https://t.co/YLEe5INAHO

[kkl @allZackk]

This tool is really helpful

[Webclaw @webclaw_io]

First week of Webclaw since its opensource release, overall:

- 220+ Github stars
- 700+ clones
- Webclaw's custom TLS has been released

Thank you all for appreciating our efforts, more to come.

Stay tuned.

https://t.co/eVdF2AU0p2

[Webclaw @webclaw_io]

New in Webclaw: /search

Designed to search and extract anything from web directly in your agent.

Provide any real time data to your LLM.

[Webclaw @webclaw_io]

https://t.co/rnEF4YXKHV

[Webclaw @webclaw_io]

New in Webclaw: /map

Designed to discover all URLs via sitemap parsing,

Enjoy directly from your favourite agent.

[kkl @allZackk]

@tom_doerr 🥰

[Tom Dörr @tom_doerr]

Web scraper for AI agents

https://t.co/jqtVg1PgN4

[Webclaw @webclaw_io]

New in Webclaw: /scrape

Designed to extract structured data from web pages not just raw HTML, but clean, parsed content ready for programmatic use.

Provide any real time data to your LLM.

[Webclaw @webclaw_io]

https://t.co/9qwHxvaDxl

[Webclaw @webclaw_io]

1/8

Introducing Research in Webclaw.
One prompt → deep multi-engine research across different browsers and search indexes → full institutional-grade report with zero hallucinations. Every claim sourced. Every number traceable.
Here's the difference: 🧵

[Webclaw @webclaw_io]

https://t.co/7V4nPMQA45

[Webclaw @webclaw_io]

Introducing Webclaw, your new favourite Extraction Engine is now open source.

https://t.co/VsA0XNNom2
https://t.co/vw4YN4RJyt

[Webclaw @webclaw_io]

The 403 problem

Here's what happens when you try to scrape anything in 2026.

You install one of those popular scraping tools. You pass it a URL. You wait. 403 Forbidden. Or worse, you get back HTML that's just a Cloudflare challenge page, and the library says "here's your content!" like it did something useful.

So you look at the docs. "For pages behind anti-bot protection, enable our premium proxy network." Ah. Cool. So the free tier is basically a fetch() wrapper that breaks on any real website. Got it.

Or you try one of those "ethical" crawlers that respects robots.txt. Which, fine in principle. But when you're building an AI agent that needs to read a pricing page to compare options for a user, you're not a search engine. You're not indexing the web. You just need to read a page. The same page any human can read by clicking a link.

These tools treat every URL like you're about to DDoS it. Meanwhile your browser opens the same page in 200ms, no questions asked.

apply at: https://t.co/3kdkjUrbJP