Long-running agents fail less from prompts and more from harnesses, says a Reddit engineer
Confident_Analysis89 · reddit · 2026-07-24
- The author argues that once an agent runs for hours, most failures stop looking like prompt problems and instead come from the surrounding harness: stale docs, copied bad patterns, context bloat, weak validation, and poor stopping conditions.
- They highlight “harness engineering” as the real lever: keep AGENTS.md small and use it as a map, move critical rules into linters and runtime checks, and rely on hard evidence instead of hoping the prompt will be remembered.
- The evaluator-agent idea is still unresolved. In one experiment, splitting planner, generator, and evaluator produced a launchable app, but the core behavior was broken and the setup cost about 20× more.
- Their current takeaway is to start with hard checks and real runtime evidence, then add separate evaluators only for cases normal tests cannot judge.
More from coding & agent
- Internal leaderboard shows how teams actually use an AI coding system — charlieholtz · 2026-07-24
- Sqemo MCP turns ER naming rules into deterministic outputs for schema agents — Aggressive-Video-508 · 2026-07-24
- Codex for Linux fork adds ChatGPT Work Realtime voice support — jxnlco · 2026-07-24
- Creator shares a Claude → Lovable MCP → OpenAI stack for building products — MyCreativeOwls · 2026-07-24
- Synopsys CEO says AI chip design has reached an L4-like stage with 6 to 8 agents — Scobleizer · 2026-07-24
- MindLab open-sources Macaron-V1, a GLM-5.2 family built on continual learning — 机器之心 · 2026-07-24