SWE-sweep benchmark code open-sourced under facebookresearch on GitHub

OfirPress · x · 2026-10-02

The SWE-sweep benchmark code is now open source on GitHub under facebookresearch. It is a thin wrapper around Harbor; agents autonomously find and fix bugs in real repos without hints. The repo includes evaluation tasks, separate verifier environments, and micro-average scoring, and currently pins a specific Harbor revision since Harbor 0.23 lacks the required hooks.

Related event: Meta's SWE-sweep: Best Models Fix Only 4.7% of Hidden Bugs(6 posts)→

Original post →

More from Research

Research channel →