Same model, same prompts: a 40-line harness lifts Opus 5.5 task pass rate from 8/20 to 16/20

blaizedsouza · x · 2026-11-18

A hands-on test shows only the harness changed — same model, same prompts, same 20 real tasks — yet Opus 5.5's unedited acceptance jumped from 8/20 to 16/20.

The additions were simple: a "done when" line per task, a 40-line map file, a test gate, a retry cap of three, and a rule file scoping what the agent may touch. Referencing Anthropic's 1,000-agent Fable 5.2 launch, the author argues a longer prompt fixes only one of five layers — the rest require harness engineering. Full guide with 9 prompts linked.

Related event: Harness Redesign Doubles Opus 5.5 Task Pass Rate(2 posts)→

Original post →

More from coding & agent

coding & agent channel →