AI safety evaluations can't assure safety, says researcher urging mandatory limitation preambles

DavidSKrueger · x · 2026-11-17

David Krueger argues you can't fully avoid creating the misconception that AI safety evaluations can tell whether an AI is safe — so evaluators must constantly fight it. He proposes that evaluators begin every outward-facing communication with a preamble: 'AI evaluation is an immature field, incapable of providing the kinds of safety assurance expected in other safety-critical industries such as aviation. None of our findings should be understood to bound risks or verify safety properties of any AI system.'

Original post →

More from Safety

Safety channel →