Gary Marcus Asks: Is a 'Nice Tool' Worth a 10% Risk of Catastrophe?
GaryMarcus · x · 2026-10-07
Gary Marcus quotes Mark Massey's view — "I have created some interesting things with Claude. Nice tool. If it went away, life would return to normal. Not essential." — and asks: is a 'nice tool' worth a 10% risk of catastrophe?
The exchange frames a classic alignment debate: one side stresses a tool's utility and replaceability, the other (Marcus) questions accepting large tail risk for limited benefit.
More from AGI Musings
- Lawyer's viral analogy: Claude is the repressed good kid, GPT grew up in a trailer park — repligate · 2026-10-07
- Reddit: machine translation has been quietly solved and nobody is talking about it — LostBetsRed · 2026-10-07
- 8000+ mathematicians sign letter against AI in math; Conjecture Institute pushes back — kiankatan · 2026-10-07
- Mathematician: norms for LLM use in serious math are still unsettled — littmath · 2026-10-07
- Jensen Huang emerges as AI doom's biggest foil, calls Altman and Amodei 'irresponsible' — AlexTensor · 2026-10-07
- You don't need 'unlearning', you need 1-2 years of financial runway — alexeyguzey · 2026-10-07