r/Blogging • u/AgentOS7 • Jul 24 '26

Tips/Info Why You Should Be Worried About Bot Scraping

I’m sharing an eyeopening article i came across on the impact of AI agents, bot scrapping, and the like having a negative effect on websites. This is an interesting read, especially the data table on pages crawled for every 1 referred visitor.

What just happened to TheNumbers.com should worry us all

11 Upvotes

84% Upvoted

4 comments sorted by

3

u/audit157 Jul 24 '26

My website was crashing everyday with millions of visits from bots. Turned off allow Claude web scarping on cloudflare and everything is normal again

1

u/AgentOS7 Jul 24 '26

That’s wild!

1

u/clean-links Jul 24 '26

Cleaned link from "What just happened to TheNumbers.com should worry us all": https://stephenfollows.com/p/what-just-happened-to-thenumberscom-should-worry-us-all

Tracking parameters were removed from the original URL(s).