LiveNerf tracks Opus 5.5 for 3 weeks, finds no evidence of post-launch nerf
TheOnlyVibemaster · reddit · 2026-10-15
A Reddit-run project called LiveNerf has measured Claude Opus 5.5 daily for 21 days using a frozen 78-question panel (1,638 samples) to test claims that Anthropic quietly degrades its models after launch.
- The first 10 days set a baseline mean of 58.4% with high variance.
- The following 11 days show shrinking variance and regression to the mean; the latest score is 62.8% — no capability drop in the data so far.
- The author cautions this doesn't rule out time-of-day throttling or other adjustment methods.
- The GitHub repo passed 1.5k stars in three weeks; a final verdict is promised in 10 days.
More from Models
- Opus 5.5 still leads a month later, but open-weight decision models are closing in — airesearch12 · 2026-10-16
- Google restricts Gemini Pro access for Google Plus subscribers, matching free tier — EmergencyLess8861 · 2026-10-16
- Meta releases Muse Spark Open, trained with vLLM-powered RL inference from day one — colinmcnamara · 2026-10-16
- Meta open-sources Muse Spark: runs on two Mac Studios, license bans passing output off as human-written — mawcopolow · 2026-10-16
- Golden Gate Claude explainer resurfaces: interpretability premise still holds — HarperSCarroll · 2026-10-16
- Hugging Face livestreams release of a new open-weight model — huggingface · 2026-10-16