SWE-bench Multimodal Released by Stanford and Meta, Leaderboard Open
jyangballin · x · 2026-09-01
SWE-bench Multimodal is now available via the SWE-bench repository, with new data coming soon and the leaderboard open for submissions. The project is a collaboration between Stanford and Meta MSL. Anthropic models have shown steady progress in multimodal performance.
Related event: SWE-bench Multimodal v2.0 Launches with 480 Open-Source Visual Coding Tasks(5 posts)→
More from coding & agent
- Claude-written test harness let 31KB fake archives land on a real backup server — Grimmoner · 2026-10-18
- Open-source Tyger-S2S voice agent runs natural, interruptible conversations on a single GPU — solyarisoftware · 2026-10-18
- Matt Pocock's pre-commit hook caps agent-written files at 5,000 tokens — mattpocockuk · 2026-10-18
- Backups silently failed for 10 days: three monitoring blind spots lined up — Grimmoner · 2026-10-18
- Author Laurence Moroney: write your ugly first draft yourself, then let an LLM edit it — lmoroney · 2026-10-18
- Open-weight TYGER speech decision model makes 80ms turn-taking calls for full-duplex voice agents — solyarisoftware · 2026-10-18