Northwestern's Hullman: Verification is not knowledge — AI science needs humans who can answer for results

JessicaHullman · x · 2026-10-30

Northwestern professor Jessica Hullman published a guest essay, Verification Is Not Knowledge, at Cosmos Institute, addressing the understanding-vs-outputs debate in AI for science.

She argues that treating understanding as an optional mental state while prioritizing verifiable outputs revives old ideals of value-free science and mechanical objectivity that philosophers reject as insufficient. The essay discusses Terry Tao's thought experiment — would you take an AI-discovered cancer treatment with a formal correctness certificate and a passed phase 3 trial, but no human understanding of how it was found? — and arXiv's growing problem of papers whose authors seem unable to understand their own claims.

Her central point: science needs people who are answerable for results; a paper whose authors can't explain its claims leaves no one to consult if those claims fail.

Original post →

More from AGI Musings

AGI Musings channel →