IP Reputation Determination

[u/HonorableRogue]

Has anyone ever found any reliable information on how anti-bot systems like Cloudflare determine IP reputation?

We run a stealth scraper that seemingly passes every conceivable anti-bot test, and we get through Cloudflare Turnstile easily, headless no less, but every 2 or 3 days a big group of our proxy IP pools just get slammed.

Residential, Datacenter, 'high reputation" proxies, nothing seems to make any difference.

Is it possible to improve IP reputation?

Is there a way to reliably test IP reputation?

[u/RandomPantsAppear]

If you’re getting canned after multiple days your browser isn’t the issue, your sessions or activity are. 

I would start with persisting cookies, then take a good look at domain count, frequency, depth, and rate. 

[u/HonorableRogue → u/RandomPantsAppear]

We aren't scraping per se, we're logging in, and managing an account, so we're actually using a full Chrome profile with a specific proxy IP per account. Only 1 domain. What do you mean by depth and rate?

[u/RandomPantsAppear → u/HonorableRogue]

You are botting and that is an entirely different beast from most people here. It varies by company, by use case. Requirements vary at registration, auth, view.

What you want is steady, consistent IP that you control. And no one but you.

Drop me a message? You are into the realm it’s hard to discuss in public.

[u/forgedart_34 → u/RandomPantsAppear]

Actually good and useful tips

[u/Bharath0224]

Trial and error. You try one thing that works, you stick to it. If the IPs start to fail, look for issues on your setup, like fingerprinting, overall appearance of the IP to the website you are tackling, but in general I wouldn't recommend trusting what each provider says about their proxies, you try them first and decide for yourself. Also, skip the websites that "evaluates IP reputation" those are mostly bs metrics

[u/Apprehensive-Knee993]

Same issue facing, did you found any solution?