Surge launches sudo L7, a benchmark measuring staff-level engineering judgment in real codebases
echen · x · 2026-10-14
Surge launched sudo L7, a benchmark for the judgment separating capable coders from staff engineers: 60 real tasks, 70% set in privately licensed production codebases (legacy code, accidental architecture, surprising dependency breaks). Tasks are written by staff/principal engineers and former CTOs from Google, Meta, GitHub and NASA JPL, each starting from an observed frontier-model failure, graded on 8 dimensions from functional correctness to knowing when to push back on flawed requests.
More from coding & agent
- 15 open-source ESP32 AI gadget projects plus a step-by-step Meta Muse SDK flashing tutorial — alexcovo_eth · 2026-10-14
- Open-source project's PRs grow exponentially after adding an auto-research.md prompt for AI contributors — IgorCarron · 2026-10-14
- NetworkChuck monitors his Hermes agents with CheckMK: model subs, cron jobs, memory health — alexcovo_eth · 2026-10-14
- One Postgres cluster, many previews: Alchemy custom resources give each PR its own database — samgoodwin89 · 2026-10-14
- Arena Fighter: a programming ladder game built for humans and AI coding agents — tristanbob · 2026-10-14
- Gusto launches multi-client MCP and AI-assisted workflows for accountants — dunkhippo33 · 2026-10-14