#practicalpython - Tagar Twitter

lebih dari 1 tahun yang lalu

Trying to scrape JS button links and the CTA on a site with multiple templates / inconsistant classes and getting nowhere fast. Until I noticed all the buttons are the same colour, so I setup a scrape based on the colour hex using Selenium. 🤓 It's spot on. #PracticalPython

3

28

1

3

1K

Lee Foot 🐍📈 @LeeFootSEO

lebih dari 1 tahun yang lalu

I created a script to fingerprint webpage templates based on common elements. Why? To extract content from pages that seem similar (e.g. /blog) but use different templates. [See screenshot] Grouping like this means I can properly setup extractors across pages. #practicalpython