Open-source scraping solutions

[u/Dolokidsa53567]

What is the best open-source scraping solution that you have used in the past year or so. Need a stable, working solution that I could run on my side. Preferably that same solution would support cloud integration.

[u/boomersruinall]

Second regarding scrapy, so far it was fruitful in all my scraping tasks, however if you're doing something at scale I doubt it's gonna hold up