LiveNerf: open-source project tracks day-by-day whether Opus 5.5 gets nerfed
TheOnlyVibemaster · reddit · 2026-09-30
A developer released LiveNerf, an open-source project letting the Claude community independently measure whether Opus 5.5's performance is degraded ('nerfed') in the weeks after release. It tracks performance daily with SWE-bench and SciCode under a standardized, reproducible methodology. Results won't be conclusive until day 20 after release; today's dip feeds the day-10 baseline. The project is self-funded—calibration took about a week's worth of a Pro plan—and motivated by a lack of transparency from AI companies. Repo: github.com/ninjahawk/livenerf.
More from coding & agent
- Generic API-catalog MCP server vs one tool per job: a context-bloat experiment — MandeepKaur9407 · 2026-11-16
- Berkeley paper: LLMs answer with stale values even when the update is in context — ombre-ai · 2026-11-16
- Effective HTML: 4.2k-star agent skills turn wireframes into self-contained interactive prototypes — tom_doerr · 2026-11-16
- skills-gate: one gate skill fronts 148 agent skills at just 389 tokens — Distinct-Pie2389 · 2026-11-16
- Open-weight Karpo-Decision-31B tops Decision Index at 73.9, one forward pass per answer — CodeByPoonam · 2026-11-16
- shadcn boosts @uisdk: one-shot UI rebuild that's instantly E2E-testable by AI — shadcn · 2026-11-16