Terence Tao argues against opaque superintelligence, sparking an understandability vs results debate
trq212 · x · 2026-10-12
At his 'Math 2.0' public lecture at Caltech, Terence Tao argued we shouldn't settle for a superintelligence that is opaque. Commenter trq212 agrees directionally: communication is a key signal of intelligence, and we should build products and models that build understanding with humans rather than disintermediating them. Quoter Andrew Curran pushed back with the slide in hand: if a cure actually worked, almost any Stage 4 cancer patient would say human comprehension of its mechanism is irrelevant — igniting a sharp understandability-vs-results debate.
More from AGI Musings
- "Text Isn't Taken Seriously Anymore": Turn All Criticism Into Art — ryunuck · 2026-10-12
- Fields Medalist Alain Connes warns AI use can make the brain abandon its own governance — fkasummer · 2026-10-12
- Why AI threatening degree-holding jobs suddenly makes progress negotiable — VraserX · 2026-10-12
- Opinion: AI built on 'stealing people's work' should be free or subsidized — gregbarbosa · 2026-10-12
- Matt Turck: from punch card operators to agent managers, jobs always adapt — mattturck · 2026-10-12
- 1964's Triple Revolution report warned computers were breaking the jobs-income link — soumitrashukla9 · 2026-10-12