SWE Refactor Bench: Coding Agents Pass Only 5.4% of Full-Repo Migrations

The new SWE Refactor Bench tests coding agents on long-horizon, full-repository migrations across 20 real tasks. Across 520 runs, agents passed only 5.4%, with the best model Opus 5 scoring just 47 points.

2026-08-25 ~ 2026-08-27 · 4 related posts

• SWE Refactor Bench reveals 5.4% survival rate for coding agents in whole-repo migrations — _akhaliq · 2026-08-25
• SWE Refactor Bench: Only 5.4% of 520 Runs Pass, Best Model Opus 5 Scores 47/100 — YouJiacheng · 2026-08-26
• New SWE-Refactor-Bench exposes AI coding weakness: 0% success in full repo migration — 机器之心 · 2026-08-27
• SWE Refactor Bench: Can Coding Agents Handle Long-Horizon Repo Migrations? — Deyao Hong · 2026-08-27