OpenAI bots reportedly hammering domains, fueling speculation of a new training run
gaganghotra_ · x · 2026-10-31
Gagan Ghotra observes OpenAI's crawlers aggressively hitting multiple domains, with scraping volume noticeably up lately, and speculates OpenAI may be building a web cache for a new training run. Unverified observation.
More from Infra
- Baseten cuts 770GB RL weight sync to 15 seconds, 7.5x faster than prior SOTA — baseten · 2026-10-31
- Meta and SpaceX are already denting neocloud demand, expert says — bookwormengr · 2026-10-31
- Researchers encode 200+ properties of SGLang inference server, uncover 10 bugs — LingmingZhang · 2026-10-31
- Lux Capital hosts closed-door dinner on AI infra, agents and security with Cognition and Modal — graceisford · 2026-10-31
- GitHub incident hits Actions, Pages and Webhooks — damontal · 2026-10-31
- FastVideo ships install guide for NVIDIA DGX Spark, no aarch64 wheels needed — victormustar · 2026-10-31