OpenAI's Astra tops SWE-sweep bug-hunting leaderboard at less than half the cost of 5.6
OfirPress · x · 2026-10-22
The SWE-sweep leaderboard for real-world vulnerability discovery has been updated: models from OpenAI and Anthropic doubled the number of bugs found while halving costs. OpenAI's Astra is the best model, at less than half the cost of 5.6.
Ofir Press highlighted that this will help launch the era of proactive agents that fix bugs before they cause a global crisis — though even Astra still finds less than 10% of all real-world bugs tested, leaving large room for improvement.
More from Models
- Similarweb: Grok Drew 40.91% New-User Traffic Share in September, Highest Among Major AI Tools — XFreeze · 2026-10-22
- Rumor: 'Gemini 4 Carbon' updated checkpoint spotted in cryptic Carbon vs Argon teaser — lyraxana · 2026-10-22
- Recursive Bets on RSI: Its Eureka Machine Built the Flint Coding Model in Months — mikeflache · 2026-10-22
- 0.9B Model Transcribes a 4-Person Meeting on a MacBook With 0.08% Speaker Confusion — Binary_orchid · 2026-10-22
- Fireworks trains Meta's Muse Glimmer on Kalshi outcomes: +11.2pp accuracy over Jev — sophiamyang · 2026-10-22
- Gemini CLI PR reveals unreleased gemini-4-argon model with 1M context window — mr8lu · 2026-10-22