SWE-bench Multimodal v2 Released: 480 Visual Coding Tasks, Open-Sourced
jyangballin · x · 2026-09-01
SWE-bench Multimodal v2.0 is released, featuring 480 tasks where coding agents must interpret visual assets like screenshots, diagrams, and recordings to diagnose and fix bugs in repositories. v1 was closed-source, leading to low adoption; v2 is open-sourced with cleaned data, removing broken tasks and flaky tests.
Related event: SWE-bench Multimodal v2.0 Launches with 480 Open-Source Visual Coding Tasks(5 posts)→
More from coding & agent
- Claude-written test harness let 31KB fake archives land on a real backup server — Grimmoner · 2026-10-18
- Open-source Tyger-S2S voice agent runs natural, interruptible conversations on a single GPU — solyarisoftware · 2026-10-18
- Matt Pocock's pre-commit hook caps agent-written files at 5,000 tokens — mattpocockuk · 2026-10-18
- Backups silently failed for 10 days: three monitoring blind spots lined up — Grimmoner · 2026-10-18
- Author Laurence Moroney: write your ugly first draft yourself, then let an LLM edit it — lmoroney · 2026-10-18
- Open-weight TYGER speech decision model makes 80ms turn-taking calls for full-duplex voice agents — solyarisoftware · 2026-10-18