More agent traffic discovered: researchers keep finding new sites hit by AI crawlers
ArtificialAnlys · x · 2026-09-05
A thread of follow-ups: thlarsen reports others found additional agent traffic missed by their earlier analysis, and xeophon adds five newly discovered sites — including a sandbox wiki. The scale of AI agent crawling across the web keeps exceeding expectations, with researchers asking for more findings.
More from Infra
- SGLang's Breakable CUDA Graph speeds prefill graph building by 3.8–5.2x — ying11231 · 2026-09-05
- SemiAnalysis: OpenAI's ASIC program is leverage — Altman wins even if the chip loses — MarvinTBaumann · 2026-09-05
- 2027 will be peak year of AI compute constraint; relief arrives in 2028, analyst argues — BenBajarin · 2026-09-05
- Dev builds P2P network to seed open-weight models, fearing a NVIDIA-Hugging Face deal — Relevant-Magic-Card · 2026-09-05
- NVIDIA lays out five practical guidelines for speculative decoding to speed up LLM inference — NVIDIAAI · 2026-09-05
- NVIDIA Details Hardware-Friendly LLM Design and Five Speculative Decoding Guidelines — NVIDIAAI · 2026-09-05