Crowl

The open-source SEO crawler, made by SEOs for SEOs.
Buy me a coffeee!

[Crowl @crowltech]

Thanks @juandastic for this user guide in 🇪🇸 https://t.co/4fRuaPbVpP

[Crowl @crowltech]

Am I the only one who needs more time to write the documentation than to dev the feature? 😅

[Crowl @crowltech]

Quick update today to resolve a bug with blank pages that send HTTP 200 rescodes, and to update some outdated dependencies.
To upgrade: https://t.co/U994xM1HJP

[Andell - Damien @anddeIl]

Super update, je pense surtout pour la détection de langue avec Fasttext. Je pique l'idée, j'avais pas vu que dans la doc il avait mis en place un model tout prêt. Je m'emmerdais pour rien 😂 En tout cas super ajout sur le crawler allez voir ça 👍

[Crowl @crowltech]

ICYMI: new release of the #opensource #seo #crawler

[Crowl @crowltech]

v0.3 is finally here! Exclusion patterns, custom XPath extractors, proxies, language detection... See the full list of new features here: https://t.co/fRZenkNiz8

[Crowl @crowltech]

You can also support this project with a few cups of coffee https://t.co/oe35uBH1EM ❤️

[Crowl @crowltech]

v0.3 is finally here! Exclusion patterns, custom XPath extractors, proxies, language detection... See the full list of new features here: https://t.co/fRZenkNiz8

[Crowl @crowltech]

New features (and old ones too) are described in the docs. See config options here: https://t.co/rCyrgsxeHq

[Crowl @crowltech]

Support Crowl on @buymeacoffee ! https://t.co/eCT214GAcI

[Crowl @crowltech]

Currently writing release note and updating documentation 😎

[Crowl @crowltech]

@DataChaz @diije Coming soon ;)

[Crowl @crowltech]

Currently testing the next release of #crowl with some great new features. Still a bit of debug to do, but quite sure you'll like it!

[Crowl @crowltech]

No release tag because some other features are coming quick!

[Crowl @crowltech]

A quick update this evening to add a parameter to exclude a pattern of URLs. Checkout https://t.co/9WSWSZqnsX and https://t.co/nDKR0ofgvB

[Mic King @VeryWellVersed]

A client of ours brought up this SEO-focused crawl library that I wasn't aware of (@crowltech) https://t.co/MT5BW5R8E6

It abstracts some of the stuff you'll likely need to build if you're scraping.

Sharing because it was new to me.

[Crowl @crowltech]

@iPullRank Thanks for sharing! Minor release coming soon! (well, hopefully)

[Crowl @crowltech]

Crowl v0.2 is out! Config files & CSV export are the main features. Check out the release notes: https://t.co/bx9J0SxhyA
And the new docs: https://t.co/Zzi4JilJLs
Feedback is welcome!

[Databulle @databulle]

A few example of using #cURL for #SEO https://t.co/VmqB4Ah0a7

[Crowl @crowltech]

Crowl: un crawler SEO opensource https://t.co/ls3WMPJd1l via @linuxfrorg

[Crowl @crowltech]

A few technical updates are coming soon, too ;-)