Why now is the best time ever to found an AI safety startup, from alignment to governance
luke_drago_ · x · 2026-09-10
In the closing thread of his case for founding in AI safety, the author lists urgent areas of work: alignment and control, extreme concentration of power, AI governance and policy, and societal resilience to risks. His earlier argument: capability progress is outpacing even ambitious forecasts, with trillions of dollars and thousands of researchers pushing the capabilities line up while risk-side progress lags; programs like Tailwind and impending lab IPOs are bringing hundreds of millions in funding online, non-profit downsides are fading, making this the best and most urgent time to found in AI safety.
Related event: Why Founders Should Start AI Safety Companies Now(4 posts)→
More from AGI Musings
- Train on Frontier Papers or Build RL Envs? An Insider Debate on Math Model Training — ctjlewis · 2026-09-10
- AI extinction drama: researchers believe in the risk yet keep racing, says viral thread — AIandDesign · 2026-09-10
- François Fleuret asks: what intellectual endeavor can humanity still claim from AI in two years? — francoisfleuret · 2026-09-10
- That Proof Was Downstream of Mathematicians' Chats — but Is 'Direct Training' Even Real? — shaurizard · 2026-09-10
- Debate sparks: Banks' Culture series already wrote the definitive AGI utopia — Promptmethus · 2026-09-10
- A Footnote for Algernon: A Short Story About a Model Watching Its Predecessor Die — kerem_ozcan · 2026-09-10