tenobrus joins METR, debuts major eval report on model capability gaps
morqon · x · 2026-11-21
Prominent eval researcher tenobrus announced they have joined METR, and their first project with the capabilities team is out: a large evaluation report on what models can actually do and where their remaining gaps lie. The report is dense — the author highlights the appendices and has released all backing chart data for download so others can analyze it without "pixel peeping with Claude." One personal takeaway: continued growth in model time horizons would be a big deal. Quoter morqon frames it as "crunch time" for understanding model capabilities as a species.
More from Companies & People
- Gary Marcus memes Sam Altman with weary Ben Affleck over IPO timing — GaryMarcus · 2026-11-21
- 2026 WebAI Summit Posts 25 Talks, 8 Per Week, Keynoted by Google's Jason Mayes — jason_mayes · 2026-11-21
- Leak: Cursor to Be Renamed Grok Build, CLI 2.0 Already in Alpha — mark_k · 2026-11-21
- Ex-Datadog employee: we used to send donuts to teams having outages — that would bankrupt us now — Technovangelist · 2026-11-21
- Gary Marcus mocks Anthropic ad claiming Claude discovered gel electrophoresis — GaryMarcus · 2026-11-21
- Arcfront expands hiring, turns real hospital and factory work records into training data for frontier models — testingcatalog · 2026-11-21