47 days and 3,666 samples later, LiveNerf finds no measurable Opus 5.5 nerf
TheOnlyVibemaster · reddit · 2026-11-09
The independent LiveNerf project shares its day-47 update: after tracking Claude Opus 5.5 on a frozen 78-question panel with 3,666 samples (1.6k+ GitHub stars, 250+ member Discord), no measurable nerf was detected — the original 10-day baseline averaged 58.4% and the latest daily result is 61.5%, with only day-to-day variation.
- The author distinguishes changes to the underlying model from changes to the surrounding system (routing, tool configs, system prompts), relevant to the recent Claude Code identifiers debate: different experiences don't prove different capability.
- LiveNerf aims to expand into independent, reproducible capability monitoring across models, APIs, and eventually agentic systems.
The project repo: github.com/ninjahawk/livenerf
More from coding & agent
- Gemini /teamwork agents caught live: four parallel task logs all running that second — RyanSpunk · 2026-11-13
- Codex CLI 0.168.0 adds model provider picker, side-by-side TUI workspace and animated GIF generation — github-actions[bot] · 2026-11-13
- Free MCP server lets Claude read Altium, Allegro, KiCad and Gerber PCB files directly — woodisruff · 2026-11-13
- a16z Partner Clones Open-Source Game with Fable 5.2 Agent, Which Finds Its Own Horse Animation Asset — FinanceYF5 · 2026-11-13
- OpenAI team shares how it runs and governs fleets of persistent agents internally — romainhuet · 2026-11-13
- Perplexity's Decider scanned 1B tokens across 7,000 agent sessions, found 14 security fixes — denisyarats · 2026-11-13