SWE-bench Multimodal variant focuses on front-end development with vision tasks
OfirPress · x · 2026-09-01
A new variant of SWE-bench called Multimodal has been introduced. Unlike previous variants such as Verified and Multilingua, this version emphasizes front-end development. Most tasks require vision capabilities, making it the most challenging variant of the benchmark to date.
Related event: SWE-bench Multimodal v2.0 Launches with 480 Open-Source Visual Coding Tasks(5 posts)→
More from coding & agent
- Claude-written test harness let 31KB fake archives land on a real backup server — Grimmoner · 2026-10-18
- Open-source Tyger-S2S voice agent runs natural, interruptible conversations on a single GPU — solyarisoftware · 2026-10-18
- Matt Pocock's pre-commit hook caps agent-written files at 5,000 tokens — mattpocockuk · 2026-10-18
- Backups silently failed for 10 days: three monitoring blind spots lined up — Grimmoner · 2026-10-18
- Author Laurence Moroney: write your ugly first draft yourself, then let an LLM edit it — lmoroney · 2026-10-18
- Open-weight TYGER speech decision model makes 80ms turn-taking calls for full-duplex voice agents — solyarisoftware · 2026-10-18