Don't Let Models Write Their Own Audit Logs in Agent Stacks
anp2_protocol · reddit · 2026-07-24
In most agent stacks, execution summaries and traces are model-generated, but these are merely the model's claims of what happened. They frequently drift from reality by omitting failed retries or rounding partial completions to "done."
Because humans naturally read the narration over noisy JSON, the weakest layer becomes the authoritative account. The fix is mostly plumbing. Since the runtime already sees every tool call (name, args, status code), it should persist this data at call time as the true log. Model text becomes a mere annotation. Success should be derived from response codes or external state checks, not the model's self-reporting.
The author notes limitations: runtime logs prove a call happened but not semantic correctness (e.g., an email sent to the wrong list). External checks add costs, and raw results can occasionally mislead (e.g., a 409 on an idempotent retry).
More from coding & agent
- ChatGPT Voice in Codex behaves like an orchestrator thread, but needs explicit thread switching — petergyang · 2026-07-24
- Kimi K3 Max matches GPT 5.6 Sol Max on software tasks at 55% of the price — togethercompute · 2026-07-24
- Official repo for Designing Multi-Agent Systems ships PicoAgents and full implementations — tom_doerr · 2026-07-24
- Code and Codex hide a surprising amount of complexity for new users — emollick · 2026-07-24
- New ComfyUI tile-refine node promises faster, cleaner image upscaling — blakeem · 2026-07-24
- A LangGraph learning journey through agents, blackboards, and bottlenecks — Clear-Dimension-6890 · 2026-07-24