Anthropic's unreleased "Model 4" clears 50% on all 15 METR benchmarks
141_1337 · reddit · 2026-11-06
METR reports that Anthropic has an unreleased model ("Model 4," finished training last month) that scored above 50% on all 15 capability benchmarks tested — the highest-scoring model in METR's set and the first to clear that bar across the board. The result fuels concerns that existing AI benchmarks are becoming too easy to measure frontier progress; METR's charts show Model 4's scores fitting a logistic curve in log-odds across benchmarks with estimated difficulty (EDI) from 115 to 172.
Related event: Report: Anthropic's Next Model Finished Training, Tops All METR Benchmarks(2 posts)→
More from Models
- Yacine publicly asks insiders how many GPUs pretrained Inkling Small 2 — yacineMTB · 2026-11-06
- Autonomous AI R&D Runs 'Extremely Dumb Experiments', Researcher Reports — panickssery · 2026-11-06
- Claude Opus 5 pulls off multi-level roleplay: staying in character while knowing it's acting — repligate · 2026-11-06
- Inkling 2 Small hits 46.8% Pass@1 on APEX-Agents, up 13 points over predecessor — ziqiao_ma · 2026-11-06
- Dev complains Anthropic free credits can't be used for Code or terminal — RileyRalmuto · 2026-11-06
- Blind listening test of 62 raters ranks Gemini first, Llama last among 8 LLM composers — antiochIst · 2026-11-06