Shanghai AI Lab's Harness-of-Harness runs 70+ iterations to build an FPS game autonomously
aigclink · x · 2026-09-05
Shanghai AI Lab released Harness-of-Harness (HoH), a meta-framework layered on existing coding-agent harnesses that organizes execution into iterative planning-coding-testing loops. Each round scopes a small verifiable increment and passes code plus test evidence to the next, preventing memory loss and premature completion claims.
- Three roles (Project Planner, Developer, QA Tester) are three constrained calls to the same coding agent
- Across GameCraft-Bench, FrontierSWE, and ProgramBench with three harness-model pairs, HoH gains 52.25% average relative improvement (max 82.86%) after three iterations
- In a multi-day deployment, HoH autonomously built Fusepoint, a playable FPS with coherent story, mechanics, visuals, and audio, in 70+ iterations from a single PRD
More from coding & agent
- Microsoft's FrontierTour: AI governance becomes everyone's problem as agents take action — donasarkar · 2026-10-23
- Grady Booch revives Weinberg's 1971 quip: software so buggy one woodpecker could destroy civilization — Grady_Booch · 2026-10-23
- One Agent Replaces Half an SDR Team: Full Lead-Research-to-Email Workflow — tibo_maker · 2026-10-23
- Why don't coding agent harnesses ship with their own sandbox? Only amp does — Aryvyo · 2026-10-23
- Dev builds a VST synth with Codex and MCP, lets the AI jam in his studio — Yamapama · 2026-10-23
- AgentsInTheCloud update: use your Claude subscription with built-in coding agents — lucasmeijer · 2026-10-23