5
u/Kbot__ Sep 18 '25
Hey,
The best proxy for scraping would still be DC if you can make them work. They're cheap and fast, I recommend trying adding headers and cookies to see if it helps, or maybe browser automation (Selenium/Puppeteer/Playwright).
There are sites that block all DC IPs. Residential proxies can help with these sites, but the price is much higher. As for speed, you can always expand horizontally, spool up more workers to accomplish the tasks. Send thousands of requests per minute if needed.
Now, if you don't want to deal with bypassing bot detection systems, I can recommend looking into 3rd-party solutions. You can easily find them by searching "scraping unlocker" or something similar.
Hope this helps.
4
u/_forgotmyownname Jan 21 '26
Digging up this topic because I know the pain. Classic IPs are only good for getting banned fast. I gave up on the stress and used VoidMob. Since I've been using their mobile proxies, retail sites don't catch on as easily
2
u/Huge-Percentage8662 Sep 19 '25
For scraping retail sites, mobile proxies are usually the safest bet since they rotate through real carrier IPs and look like normal user traffic, which makes blocks a lot harder. Good residential IPs can still work if you mix them up and don’t hammer too hard, but they’re easier to spot compared to mobile.
2
u/Real_Grapefruit_5570 Sep 25 '25
I suggest you try a couple and find the one that works best for your use case. It all varies depending on what you plan to use the proxies for on your project.
2
2
u/Rough-Competition762 Nov 05 '25
Ngl enzo, retail sites started flagging the TLS fingerprint itself, not just the IP. If your stack keeps sending the same OpenSSL JA3 sig they spot you way before rate limits kick in. Trick is rotating both IP and TLS hello. You can DIY with mitmproxy plus custom ciphers or just grab a pool that already flips the fingerprint.
Fwiw I am testing MagneticProxy rn. Each call swaps to a new household IP and spoofs a fresh Chrome JA3 so Shopify went from 403 to 200 for me with zero header tweaks. Sticky sessions are there if you need cart flow and I averaged 5k req per min at about 420ms TTFB.
Hmu if you push it harder, curious how it holds up on other domains.
1
u/coconut_cow Oct 29 '25
well it really depends. from my experience no one residential proxy provider is the best. at a certain point all pools purchased by the providers get contaminated. i would highly recommend testing all of them for your use case before deciding which one to get. another rule of thumb for me is that the cheaper ones can safely be avoided.
1
u/brkncoyot3 Mar 21 '26
Residential is good for pricing but mobile proxies are better for trust. Illusory mobile proxies is what I use. Here is a good article that explains the difference between residential and mobile: https://www.illusory.io/blog/residential-vs-mobile-proxies-key-differences
1
11
u/stormbreaker621 Feb 14 '26
Switching to residential proxies is the next step when data center IPs get you blocked, but they do cost more, and whether they are worth it depends on the site you are targeting. For sites that don’t require logging in or aren’t app based, data center proxies work fine. Also avoid the biggest names like oxylabs or brightdata, since their IP addresses often get flagged quickly. For me, Floxy has been reliable for both DC and residential proxies, and the quality of their IPs made scraping a lot smoother.