When I’m writing webscrapers I mostly just pivot between selenium (because the website is too “fancy” and definitely needs a browser) and pure requests calls (both in conjunction with bs4).
But when reading about scrapers, scrapy is often the first mentioned Python package. What am I missing out on if I’m not using it?
2 points
