New Real-SWE benchmark suggests reports of coders' demise were exaggerated
SteppenAxolotl · reddit · 2026-09-13
A Reddit user shares a new benchmark called Real-SWE with the takeaway that "reports of the demise of coders may have been exaggerated." The benchmark appears designed to evaluate AI coding agents on more realistic software engineering tasks. Details of the tasks and model scores are in the linked benchmark itself.
More from coding & agent
- MCP ships experimental Skills extension: agents can discover and load skills on demand — blaizedsouza · 2026-09-14
- Spawn lets you invite your own coding agents to build and playtest games — majidmanzarpour · 2026-09-14
- Dev says GLM/DeepSeek one-shots tasks he was paying 'astronomical' prices for — haydendevs · 2026-09-14
- Codex Now Proactively Coordinates Across Parallel Agent Sessions, User Reports — RileyRalmuto · 2026-09-14
- Alchemy Console ships a visual UI for browsing and deleting Alchemy cloud resources — samgoodwin89 · 2026-09-14
- Edit video for free: pair Codex Astra 6 with the free DaVinci Resolve 19.1 — alexcovo_eth · 2026-09-14