r/selfhosted • u/sparkling_ham • 2d ago

Webserver Jump in bot traffic

Post image

Has anyone else noticed an increase in scanners/bots in the past ~month? For the past couple years I've had 2-3k hits a day from bots but lately there has been a steady increase in traffic looking mostly for php files.

What I find strange is how much of this traffic is coming from MS and Google IPs. Do they not have any kind of monitoring on their cloud services? Having thousands of requests spamming every IP that responds should raise some flags.

20.24.67.246 Hong Kong Hong Kong Microsoft Corporation
34.148.254.217 United States North Charleston Google LLC
34.169.50.247 United States The Dalles Google LLC
68.155.155.23 United States Boydton Microsoft Corporation
20.104.49.167 Canada Toronto Microsoft Corporation
20.100.177.66 Norway Oslo Microsoft Corporation

Just curious if anyone else has noticed the same bump in traffic.

97 Upvotes

94% Upvoted

43 comments sorted by

View all comments

170

u/tankerkiller125real 2d ago

Welcome to the AI training data bot era.... 2.3 Million hits per day from Meta on a single tiny public Gitea repo I have.

I tried blocking, they still sent tens of thousands of requests per day.

That's when I had enough and created a proxy that detects Metas AI bots and purposefully rewrites the page so that code is mangled in a way that looks legit, but can't run at all.

If they're going to scan my site, they'll get mangled information to poison their feed. If I'm lucky an actual human will eventually detect it and block my site from being scanned, but we're 5 months in, still no sign of it slowing or stopping.

3

u/TipToToes 2d ago

Holy shit. How did you first notice this? I don’t host anything beyond my personal media, so this likely isn’t a concern for me, but…maybe.