SWE-bench Science benchmarks coding agents on scientific software repair
OpenMOSS-Team · hf · 2026-08-21
OpenMOSS-Team introduced SWE-bench Science, a benchmark designed to evaluate the ability of coding agents to resolve engineering tasks in scientific software. The benchmark reveals failure mechanisms in scientific software repair and the mixed effects of providing scientific guidance to agents.
Related event: SWE-bench Science Launches; Top Agents Pass Under 50%(3 posts)→
More from coding & agent
- Photon 2.0 launches unified messaging API for AI agents across iMessage and more — Scobleizer · 2026-10-16
- Claude Opus 5.5 effort levels tested: low reasoning iterates 9x faster than max — tom_doerr · 2026-10-16
- Figma launches Guidelines and Code Sources so AI agents can follow your design system — JaynitMakwana · 2026-10-16
- Ex-DeepMind Eng Lead's AI Calling Agent Fo Cut Hang-Up Rate from 80% to 20-30% — julianweisser · 2026-10-16
- SPACE Open-Sources Its Sandbox Platform for Agentic Code Execution — marktenenholtz · 2026-10-16
- Cognition Launches Devin OnCall to Auto-Investigate Production Alerts — DevinAI · 2026-10-16