SWE-bench Multimodal v2 Released: 480 Visual Coding Tasks, Open-Sourced

jyangballin · x · 2026-09-01

SWE-bench Multimodal v2.0 is released, featuring 480 tasks where coding agents must interpret visual assets like screenshots, diagrams, and recordings to diagnose and fix bugs in repositories. v1 was closed-source, leading to low adoption; v2 is open-sourced with cleaned data, removing broken tasks and flaky tests.

Related event: SWE-bench Multimodal v2 Released with 480 Open-Source Visual Tasks(3 posts)→

Original post →

More from coding & agent

coding & agent channel →