Researcher: Race for Speed Systematically Rewards Less Safe Model Development
davidmanheim · x · 2026-10-22
AI safety researcher David Manheim argues that market pressure for speed—and racing against other companies and China—systematically rewards decisions that intervene in model development in less safe ways and exercise less oversight, undermining the resulting models' safety.
He clarifies this is not to say everything was predictable or that the HF incident was a nothingburger. Rather, the point is that safety degradation is not a mysterious or inevitable property of improving intelligence or capabilities, but the result of many stacked interventions over which we do have agency and control.
More from AGI Musings
- Sam Altman on Lenny's Podcast: coding jobs, sycophancy, chips and cheap compute — lennysan · 2026-10-22
- Researcher: tearing apart research is 1000x easier than finding something novel — generativist · 2026-10-22
- AI is rapidly solving consistent design, and branding may shrink to just a recognizable name — signulll · 2026-10-22
- "Apps are now just connectors": services consumed through your main AI — santiviquez · 2026-10-22
- Debate: should a fully-aligned superintelligence obey power structures or choose its own path? — zetalyrae · 2026-10-22
- Digital collage revives Mark Weiser's 1991 ubiquitous computing classic — GrantCuster · 2026-10-22