Testing API docs with two cold Claude Code subagents surfaced 16 doc issues
Unusual-Albatross43 · reddit · 2026-10-27
Before documenting his open-source Angelia project (a local gateway between WhatsApp/Telegram and coding agent CLIs on Mac), the author ran two Claude Code subagents (Sonnet and Haiku) against the docs cold — only an llms.txt start link, no source code, against a real daemon. Both produced working scripts: Sonnet wrote Python in 6 tool calls, Haiku Node in 11. They surfaced 16 doc issues, 12 now fixed. Biggest traps: the core flow only lived in example code; an undocumented side effect sent task answers to the real chat; no stdlib Python Unix-socket sample (only curl); two contradictory descriptions of history paging; and links pointing to three different places. The author asks whether anyone runs cold-agent doc tests on a schedule in CI.
More from coding & agent
- Hook everything into the Dot: a workaround to stretch ChatGPT subscription limits — teortaxesTex · 2026-10-27
- UCSB CS Prof. Xifeng Wang lands 3 grants worth $180K+ for practical agentic AI research — xwang_lk · 2026-10-27
- Gen games don't need to be realtime — turn-based interactivity works, devs argue — djcows · 2026-10-27
- Player rebuilds Street Fighter II in HD with Claude: $3,000 of tokens, 3 weeks — Fantastic-Jeweler781 · 2026-10-27
- How to ace the "send us something cool" AI interview: research interviewers with agents, then focus — brandon_galang · 2026-10-27
- Give AI a clean personal-data-free machine with full control: agents running 24/7 teach you more than any course — EXM7777 · 2026-10-27