Hugging Face's NielsRogge cites Ilya: scaling current LLMs won't radically improve or endanger humanity
NielsRogge · x · 2026-09-11
- Hugging Face's NielsRogge argued in a debate that future AI will remain "an LLM with scaled-up pre-training and post-training" carrying today's limitations, and won't "gamble with our lives."
- He cited Ilya Sutskever: "Do you really think scaling up the current tech will lead to radical performance improvements? I don't think so."
- BlackHC pushed back that concerns target the near future, not current tech — capability, agency, and misalignment are all progressing fast, and regulation/alignment aren't a given; risks can materialize faster than expected.
A notable public exchange on existential risk: scaling-skepticism vs. urgency about near-frontier misalignment.
Related event: DeepMind Researcher Publicly Warns of AI Existential Risk, Sparking Debate(4 posts)→
More from AGI Musings
- Security researcher: vibe coding will force software to consolidate around mature products — jd_pressman · 2026-10-31
- AI pushes circuit lower bound from 3.1n to 3.5n as UCLA-backed challenge aims at P vs NP — soumitrashukla9 · 2026-10-31
- What is work for? Cross-national survey of 8,234 adults on meaning in the AI age — soumitrashukla9 · 2026-10-31
- Which universities win top students may hinge on healthy AI-use boundaries, argues researcher — brianryhuang · 2026-10-31
- Researchers debate whether more inference compute can substitute for training compute — teortaxesTex · 2026-10-31
- Five agents can agree because they made the same mistake, krishnan warns with satire — krishnan · 2026-10-31