LiveNerf repo tracks Opus 5.5 daily benchmarks to detect if Anthropic nerfs the model
TheOnlyVibemaster · reddit · 2026-09-28
To test community claims that Opus 5.5 has been quietly nerfed, a developer is re-running independent benchmarks like GPQA and SWE-bench daily and graphing results in an open repo called LiveNerf. So far, no nerf detected. The methodology uses Claude to pick questions Opus 5.5 struggles with most, with Opus 5 as a control; a deviation over 7.5 points would signal potential capability loss. Baseline expected by day 10, real judgments deferred until day 20 — a data-driven answer to whether the 'nerfed' discourse is hysteria.
More from Models
- User Shares Coral Reef Creation Labeled 'Qwen 4 Max (xhigh)', an Unannounced Model Name — intellectronica · 2026-11-16
- Top LLM score more than doubled since GTA VI trailer dropped — ApprehensiveAd3629 · 2026-11-16
- Stealth Model 'silicon-2' Surfaces in Devin, Suspected to Be Anthropic's Next Model — kimmonismus · 2026-11-16
- Google hides Gemini model label in AI Mode, rolls Gemini 4 Carbon to Pro subscribers — gaganghotra_ · 2026-11-16
- Open-weight Karpo-Decision-31B tops Decision Index at 73.9, one forward pass per answer — CodeByPoonam · 2026-11-16
- AI daily: DeepSeek rate-limits chats, Qwen haggling spurs shop warnings, Doubao workspace launch — 快鲤鱼 · 2026-11-16