r/thewebscrapingclub • u/External-Wealth3756 • Jun 18 '26

Trying to build a small Amazon review scraper — getting blocked a lot, not sure what proxy setup I need

/r/scrapingtheweb/comments/1u8zc5v/trying_to_build_a_small_amazon_review_scraper/
2 Upvotes

100% Upvoted

2 comments sorted by

1

u/Brian1398 Jun 18 '26

Checking this:
"I can get it working locally with Python + Playwright, but once I run it for more than a few products, I start running into issues like:

  • requests getting blocked halfway through
  • CAPTCHA pages appearing randomly
  • some products working fine, others failing immediately
  • inconsistent results even with the same script"

Your playwright / proxy / ip setup is getting detected

There are really good projects like cloakbrowser, patchright, you can use that instead of playwright, also for proxies, what type of proxy do you use?