ByteDance Seed's HarnessDev: LLM-Built Agent Harnesses Lag Human-Engineered Ones
_akhaliq · x · 2026-09-04
ByteDance Seed introduces HarnessDev, a benchmark that shifts agent evaluation from task outputs to the runnable infrastructure itself: can LLMs build and evolve their own agent harnesses?
Across six creator LLMs and five benchmarks, generated harnesses lag human-engineered ones on code and search — and evolution gains prove unstable.
More from coding & agent
- JSON prompting with MOSS Image 5B: bbox coordinates for exact multi-room layouts — cocktailpeanut · 2026-10-21
- Rewriting an agent skill: A/B challenge runs show skills should only add what agents don't know — jmschreiber91 · 2026-10-21
- Developer builds himself a 'Rork MoTS' agent on Grok Bot, aiming for full autonomy before GTA 6 — rudrank · 2026-10-21
- OpenAI Live API tip: control voice sessions from your backend via sideband WebSocket — pbbakkum · 2026-10-21
- OpenAI's MultiLangBench: PHP scores highest (91.3%) at building a database engine from scratch — ricklamers · 2026-10-21
- UserProof lets Claude Code watch your user session recordings and boost conversion for $29/mo — doooyle · 2026-10-21