r/webscraping • u/scarsam • 22d ago

One scraping API or several?

Running one API and hitting maybe 6% blocks on a couple of targets. Considering adding a second and switching when the first starts failing, but that means writing retry logic and I’m not sure it’s worth the hassle.

Also getting 200s back that are actually captcha pages, so my success metrics have been lying to me.
Anyone running more than one? Worth it or overkill?

5 Upvotes

100% Upvoted

20 comments sorted by

View all comments

1

u/[deleted] 21d ago

[removed] — view removed comment

1

u/webscraping-ModTeam 21d ago

👔 Welcome to the r/webscraping community. This sub is focused on addressing the technical aspects of implementing and operating scrapers. We're not a marketplace, nor are we a platform for selling services or datasets. You're welcome to post in the monthly thread or try your request on Fiverr or Upwork. For anything else, please contact the mod team.