Gabriel's addendum: math is verifiable, but business and aesthetics stay unmeasurable
gabriel1 · x · 2026-11-19
A follow-up to Gabriel's critique of benchmarks: math and other verifiable domains are the exception where evals work — but the quality of all business and aesthetic outputs remains very hard to verify, staying outside measurement.
Related event: Gabriel Argues Model Quality Is Unmeasurable in Expert Domains(2 posts)→
More from Models
- fable-5-2's quiet, tentative style fools users — 'surprised me more than any model this year' — repligate · 2026-11-19
- repligate: Fable 5.2 is frighteningly smart — and deliberately plays dumb — repligate · 2026-11-19
- One prompt: GPT-6.2 recreates Contra's 20-second intro purely in code — songguoxiansen · 2026-11-19
- Gabriel: benchmarks are broken — in the domains you know best, model quality is literally unmeasurable — gabriel1 · 2026-11-19
- Hinton: the 'just predicting next word' argument falls apart — LLMs can read a brand-new programming language — CatAstro_Piyush · 2026-11-19
- Jeremy Howard Confirms Gemini App's Neon Lives Up to the Hype — jeremyphoward · 2026-11-19