Princeton professor points out Ember and GLM aren't on the cost-performance Pareto frontier
random_walker · x · 2026-09-28
Arvind Narayanan flags a methodological flaw in popular performance-vs-price Pareto frontier charts: even granting heavy benchmark gaming, Ember and GLM are not on the frontier, because a router randomizing between Sol and Gemini can hit any point on the chord connecting them. Adding more models should only increase the area under the curve, never shrink the frontier.
More from Models
- Fable 5.2 Leads MazeBench Token Efficiency; Billion-Token Runs Underway — patience_cave · 2026-11-16
- Fable 5.2 Tops MazeBench With 21% After 90 Hours and $6,000 in Credits — patience_cave · 2026-11-16
- Tencent Hy4 flash and InternLM Sage-S2.1-Flash both released, tool-calling tests requested — MajesticPuzzler · 2026-11-16
- User Shares Coral Reef Creation Labeled 'Qwen 4 Max (xhigh)', an Unannounced Model Name — intellectronica · 2026-11-16
- Stealth Model 'silicon-2' Surfaces in Devin, Suspected to Be Anthropic's Next Model — kimmonismus · 2026-11-16
- Google hides Gemini model label in AI Mode, rolls Gemini 4 Carbon to Pro subscribers — gaganghotra_ · 2026-11-16