7 of Anthropic's last 8 frontier models skipped public evals, notes researcher
jessi_cata · x · 2026-11-06
In a discussion on benchmark acceleration trends, @taoroalin notes that 7 of Anthropic's last 8 frontier models never went through public evals. jessicata adds analysis: the internal-vs-public model gap appears to be narrowing recently, but even public-only (green) data points still show clear acceleration — suggesting the AECI vs ECI measurement difference is real, yet not the sole driver of the acceleration trend.
Related event: Insider: 7 of Anthropic's Last 8 Frontier Models Never Publicly Benchmarked(2 posts)→
More from Models
- Zhipu chief scientist reveals GLM pretraining data roadmap: GLM-5 at 28.5T tokens, 100T next — rickasaurus · 2026-11-06
- Hesamation: OpenAI Models Beat Anthropic's Only at Certain Kinds of Games — Hesamation · 2026-11-06
- Meta's new 'walrus' checkpoint reportedly matches crouton-alpha quality — ChrisGPT · 2026-11-06
- Quick test: Gemini 3.1 Pro knows the answer in its weights, Flash doesn't — giffmana · 2026-11-06
- Ripple-65B flops in single-GPU coding test against Qwen 27B despite SOTA claims — DZhang50 · 2026-11-06
- Ripple-65B open-weight model runs at 7 tok/s locally on a 64GB Mac mini — DZhang50 · 2026-11-06