Fighting AI crawler traffic: beyond Turnstile, Cloudflare's AI Labyrinth as an option
fforres · x · 2026-09-22
A Spanish-language tech thread about a site plagued by bot traffic, debating whether Cloudflare Turnstile fits. The reply distinguishes "dumb bots" from AI smart-crawlers: Turnstile handles the former; for AI agents, Cloudflare's AI Labyrinth — which feeds crawlers decoy content instead of just blocking — is a solid option.
More from Infra
- Sentdex benchmarks openjev: 169ms on Dell GB10 vs 137ms on RTX 3090 — Sentdex · 2026-09-22
- PyroDash cuts inference cost 96% by having a 4B model call the big one only when needed — jiqizhixin · 2026-09-22
- Underdog's Husky Inference Engine Claims 4.5x Speedup Over MLX, 730 tok/s on MacBook — jimmykoppel · 2026-09-22
- Full-Parameter RL on TPUs: peano_ai Runs 310B MiMo-V2.6 Across 1,000+ TPUs — simonguozirui · 2026-09-22
- Cloudflare Python Workers go generally available after two-year preview — Simon Willison · 2026-09-22
- Software moats won't survive RSI — ML infra's value is demand aggregation, says cHHillee — PatrickToulme · 2026-09-22