SWE-Rebench: Benchmarking 13 LLMs and 4 Agents on SWE Tasks
ibragim_bad · hn · 2026-07-31
This project benchmarks 13 large language models and 4 agents on Software Engineering (SWE) tasks across multiple programming languages including Go, Java, Python, Rust, and TypeScript, aiming to evaluate their performance in real-world coding and bug-fixing scenarios.
More from coding & agent
- Tencent Releases UI-Mate-27B, a Desktop GUI Agent Model — tencent · 2026-08-24
- Comparing AI Subscriptions: DeepSeek API vs. Claude Pro vs. Local LLMs — Unlikely_Bluejay5392 · 2026-08-24
- Claude Code introduces 'Remote Control' feature to boost coding efficiency — rohanpaul_ai · 2026-08-24
- rauchg lays out fx extension philosophy: MCP, Skills, Plugins and Unix composition — AccBalanced · 2026-08-24
- Netflix details its production LLM judge: hundreds of thousands of recommendations scored weekly — omarsar0 · 2026-08-24
- smolvm passes Simon Willison's Fable 5 agent test as a secure sandbox — yawnxyz · 2026-08-24