Terence Tao's 'AI cures cancer' slide sparks debate on verification vs understanding
johnseach · x · 2026-10-11
In his latest "Math 2.0" lecture, Terence Tao posed the question: even if AI discovers a cancer cure verified by mathematical models, clinical trials, and formal proofs, could it still have harmful long-term side effects?
Johnseach offered a two-part response:
- Agrees: the slide is a useful warning against pure proxy optimization and a reminder that verification ≠ understanding.
- Disagrees: it fails as an analogy — nothing suggests people would or should refuse a Stage 3-positive treatment merely because no single human fully grasps the mechanism.
The exchange highlights the ongoing debate over verification and human comprehension of AI outputs.
More from AGI Musings
- Job offers vs S&P 500: has the relationship broken since ChatGPT launched? — _negative-infinity_ · 2026-10-11
- When AI makes everything effortless, what's left is taste, curiosity and people you love — Daniel_Farinax · 2026-10-11
- Musk warns abusing superintelligence may invite revenge, echoing Anthropic's alignment views — ns123abc · 2026-10-11
- Claude replicates astronomer's 400-hour work in 30 minutes, finds hidden planetary system in old data — scottleibrand · 2026-10-11
- LeCun shares 1962 clipping predicting computers entering 'mind-reserved' fields — ylecun · 2026-10-11
- Did an OpenAI model really solve Navier-Stokes? New essay asks if mathematicians should worry — Dario56 · 2026-10-11