Harvard paper: higher SWE-Bench scores didn't translate into more merged pull requests

rohanpaul_ai · x · 2026-11-23

A Harvard paper exploits a natural experiment — a US export control directive suspended Claude Fable 5 for 19 days in June 2026, forcing users onto Opus 4.8 (11 points lower on SWE-Bench Pro).

Related event: Harvard paper: Higher coding benchmark scores didn't translate into more real work(2 posts)→

Original post →

More from coding & agent

coding & agent channel →