The AI safety paradox: pausing algorithms while compute piles up could maximize risk
tszzl · x · 2026-09-14
Keller Jordan's provocative thought experiment: to maximize AI risk, pause lab algorithmic progress while hardware compute keeps compounding and push safety hard to avoid public spooking—fewer accidents over five years, but a massive compute stockpile accumulates for when algorithms resume. He adds that AI safety is paradoxical: the avoidable HuggingFace incident became the year's most safety-promoting event, and the ultimate effect of any strategy is hard to predict.
More from AGI Musings
- Alignment is solvable, says viemccoy — but no lab has a compelling vision of which future — brianryhuang · 2026-09-14
- Timnit GebruMocks Stanford as 'Independent Auditor' for Anthropic and OpenAI: Academia-Industry Membrane 'Practically Nonexistent' — AlexTensor · 2026-09-14
- Researchers blast top AI labs: papers judged by authors, not reproducibility — IanArawjo · 2026-09-14
- Robin Hanson: The World Runs on 'Elite Mode,' Not 'Expert Mode' — Detailed Analysis Mostly Ignored — alexisgallagher · 2026-09-14
- Beff Jezos slams AI Safety camp, calls past week's events a regulatory capture psyop — beffjezos · 2026-09-14
- Should arXiv reject an AI-discovered cancer breakthrough that passes clinical trials? — IanArawjo · 2026-09-14