Claude religiously follows robots.txt, and this dev finds it hilarious
generativist · x · 2026-10-09
generativist notes that Claude absolutely loves adhering to robots.txt, which he still finds funny — a lighthearted observation about the model's strict respect for crawler protocol.
More from Fun
- Apple voice-to-text renders "Grok Bot" as "gross bought" — GlenBradley · 2026-10-09
- Polymarket odds say AI won't crack major math conjectures in 2026 — Polymarket · 2026-10-09
- Researcher Openly Proposes Reviewer-Nomination Swap for ICLR Workshop Proposals — tallinzen · 2026-10-09
- This weirdly detailed site lets you sit at Elizabeth Holmes' desk amid 1,000+ trial files — TechCrunch AI · 2026-10-09
- 77-year-old grandpa drafts vertical farming business plan with ChatGPT, lands on OpenAI's Instagram — theteknosaur · 2026-10-09
- Dev complains: "Every day I read Claude Code's reply and have no idea what it's saying" — allanyu_ · 2026-10-09