AI scrapers outnumber humans 20:1 on a personal archive site, only 0.7% of 4.3M requests are human

Ok-Bullfrog-3052 · reddit · 2026-11-22

A webmaster publishing 35 years of historical data found AI training scrapers have overwhelmed his site: over 30 days, humans accounted for just 0.7% of 4.3M requests; scrapers outnumbered humans 20:1, and every newly published file is instantly grabbed by at least 10 bots.

Key observations:

A rare first-hand dataset showing AI scraping crowding out the human web.

Original post →

More from Infra

Infra channel →