SWE-bench Multimodal v2.0 Released with 480 Visual Bug-Fixing Tasks

xeophon · x · 2026-09-01

SWE-bench Multimodal v2.0 has been released with 480 new tasks.

This update requires coding agents to interpret visual assets—such as screenshots, diagrams, and recordings—to diagnose and fix bugs within repositories, marking a significant upgrade for evaluating vision-language coding capabilities.

Related event: SWE-bench Multimodal v2.0 Launches Open-Source with 480 Visual Coding Tasks(5 posts)→

Original post →

More from coding & agent

coding & agent channel →