The evaluation paradox: how do you prove AI improves where it's hard to evaluate?

davidmanheim · x · 2026-11-22

AI safety researcher davidmanheim highlights the self-referential paradox in eval debates: claiming AI capabilities improve even where they're hard to evaluate can't be backed by robust evaluations — because "hard to evaluate" is precisely what makes them impossible to demonstrate.

Original post →

More from AGI Musings

AGI Musings channel →