ByteDance crawler spotted scraping websites at massive scale
gefei55 · x · 2026-11-03
Blogger gefei55 reports that many website owners are seeing traffic from ByteDance's crawler, with the scale of scraping described as something 'only a giant company can do' — likely tied to AI training data collection.
More from Companies & People
- Epoch AI opens hiring across research, design, and new media roles — NathanpmYoung · 2026-11-03
- Anthropic's Claude smart reports flag employees' 'inefficient' AI usage to employers — SuB8u · 2026-11-03
- AI launch culture debate: paid engagement is a worse look than an earnest, cleanly executed launch — Jackyhuang · 2026-11-03
- Goldman Sachs reportedly bans bankers and traders from using Claude Code and similar AI tools — ATTlKA · 2026-11-03
- Founders debate: Is grueling startup culture excellence or just toxicity? — ziv_ravid · 2026-11-03
- Former Army Secretary Dan Driscoll joins OpenAI in senior national security role — Polymarket · 2026-11-03