SWE Refactor Bench: Can Coding Agents Handle Long-Horizon Repo Migrations?
Deyao Hong · hf · 2026-08-27
Deyao Hong introduced SWE Refactor Bench, a benchmark designed to evaluate the capability of coding agents to perform autonomous software migrations across entire repositories. The study focuses on long-horizon tasks, revealing that current models rarely complete these migrations correctly. This benchmark addresses the need to assess agent performance in complex, real-world software engineering scenarios.
Related event: SWE Refactor Bench: Coding Agents Pass Only 5.4% of Full-Repo Migrations(4 posts)→
More from coding & agent
- 'Dropping a 3,000-line PR twenty minutes after ticket assignment' — AI coding meme goes viral — facontidavide · 2026-10-16
- Self Labs launches Agent Vault to let AI agents log in and pay with credit cards — EXM7777 · 2026-10-16
- XERJ hits #1 on GitHub Trending, claims 40x token savings vs grep for AI agents — alexcovo_eth · 2026-10-16
- Plane Agents: triggers, not prompts, are what turn chatbots into workflow agents — JosephJacks_ · 2026-10-16
- Claude eng lead Felix Rieseberg publishes tutorial on being more ambitious with AI — danshipper · 2026-10-16
- Qwen Code Desktop v0.25.2 ships managed-agent fixes and MCP config repair — github-actions[bot] · 2026-10-16