Debate: building AI doesn't make you the right kind of expert on its risks
binarybits · x · 2026-09-16
A pointed exchange between binarybits and DCCapital7 over who is qualified to judge AI risk. DCCapital7 pushes back: the geniuses who created the tech are scared — do you really know better? binarybits replies that the crux isn't necessarily about capabilities; he isn't convinced that creating the technology confers the right kind of expertise for assessing its risks. A representative slice of the ongoing builder-intuition vs. independent-judgment debate.
More from AGI Musings
- Users Can't Detect AI Misalignment, Undermining Labs' Incentive to Align — AryHHAry · 2026-09-16
- Ex-OpenAI researcher: Anthropic scientist put 5% odds on Claude plotting against them within a year — DavidSKrueger · 2026-09-16
- Yoshua Bengio warns uncontrolled superintelligent AI could threaten humanity — DavidSKrueger · 2026-09-16
- Commentator: Flashy AI demos mask a tech plateau as data saturation brings diminishing returns — DavidLinthicum · 2026-09-16
- AI collapses three team roles into one, fueling the rise of super-individuals — dotey · 2026-09-16
- AI safety figure: pausing AI 'just a couple years' could buy decades more with loved ones — beffjezos · 2026-09-16