246 repos and 57 papers later: what actually works in agent harness engineering
Marmelab · reddit · 2026-09-25
Analyzing 246 open-source repos and 57 publications on coding-agent harnesses, the author distills emerging best practices: harnesses should be small, evidence-based, and constantly refined. Key findings: an ETH Zurich study shows machine-generated context reduces task success vs. no context (while raising inference cost 20%), while human-written context adds 4%; build harnesses only in response to observed failures; limit exposed tools (Vercel cut 80% of tools and success jumped 80%→100% with half the tokens; Microsoft went from 100 tools to 2); change one component at a time and measure; maintain both tests and evals since instructions like AGENTS.md can simply be ignored; and test both "should happen" and "should NOT happen" cases—one-sided evals silently drift toward blocking everything and strangling the agent.
Related event: Analysis of 246 Repos and 57 Papers: Effective Agent Harnesses Stay Small(2 posts)→
More from coding & agent
- Hamel Husain, BEBischof and isaac_flath rank AI engineering techniques in a live tier list — HamelHusain · 2026-09-26
- In an AI-first world, your own understanding of the project is state to preserve — brandon_xyzw · 2026-09-26
- Railway launches free no-account VMs (59 min) and OpenCode cloud agents — jasonkneen · 2026-09-26
- 575 PRs later: how the Astra agent untangled a sync-SQLite bottleneck in OC — soumitrashukla9 · 2026-09-26
- From GoPro footage to 3D scenes: a two-week agent skill for full-home reconstruction — doodlestein · 2026-09-26
- Sentinel splits monolithic Three.js into scene-based workflows with HD PNG sequence export — PurzBeats · 2026-09-26