AI Crawlers Overwhelm the Web: Dev Reports 99% of Site Traffic Is Bots
petercooper · hn · 2026-08-07
An independent developer shared extreme analytics data revealing that 99% of their website traffic comes from bots rather than human visitors.
The article highlights that the proliferation of AI crawlers and automated scraping tools is creating severe challenges for small websites and independent creators. This non-human traffic not only fails to generate meaningful engagement but also consumes significant server resources, driving up bandwidth and hosting costs. It reflects the growing tension between aggressive AI data harvesting and the broader web ecosystem.
More from Infra
- Amazon Proposes Per-Request Validated Evidence Caching for Production RAG — _reachsumit · 2026-10-16
- LinkedIn's TransX report: sequence transduction for recsys, +6.02% CTR in A/B tests — _reachsumit · 2026-10-16
- llama.cpp PR boosts CPU inference speed with merged AVX2 tiled accumulators — jacek2023 · 2026-10-16
- Zero's next-gen IVM engine runs in a single DO, live-querying a 100GiB R2 database — threepointone · 2026-10-16
- Meme: driving to the chip factory in 2028 captures AI's compute anxiety — beffjezos · 2026-10-16
- One volunteer maintains the time zone file behind 4 billion phones — danbri · 2026-10-16