Docs must be agent-ready: llms.txt and .md endpoints as agents skip web search
rseroter · x · 2026-10-28
Tech writer Tom Johnson explains how to make documentation pages agent friendly. His key point: AI agents and coding harnesses go straight for docs over general web results, so the shape of your docs determines whether agents can use your product correctly.
Concrete practices he shares:
- Publish an llms.txt index (e.g. idratherbewriting.com/llms.txt) so agents get a full site map in one hop;
- Serve Markdown by appending .md to any page URL;
- Mine chat logs to see what users actually ask, then restructure docs accordingly.
rseroter amplified it: "Harnesses go straight for documentation over general web results, so make sure your docs are in the right shape." A timely must-do for open-source maintainers and API doc teams.
More from coding & agent
- Harmonic's Aristotle proves 211/213 properties of TorchLean C code in ~6 hours — satnam6502 · 2026-10-28
- 76% of Production AI Agents Sat Idle for 60 Days—But Kept Their Access Keys — krishnan · 2026-10-28
- Garry Tan is slimming down GStack to cut token usage and task latency — garrytan · 2026-10-28
- Dev builds forensic agent-debugging dashboard by parsing Claude's raw SSE stream — Additional-Ladder-24 · 2026-10-28
- tpot organizes WoW guild: coding agents grind while humans 'watch Codex' — airkatakana · 2026-10-28
- A2A CLI deep dive: why A2A looks like the right protocol for multi-agent systems — rseroter · 2026-10-28