Why AGI Lab Employees Are Afraid to Discuss Certain AI Risks
danfaggella · x · 2026-07-06
@danfaggella points out that being employed by an AGI lab means you can only speak outside a specific "taboo window," much like how clergy wouldn't publicly deny core doctrines—employment incentives inherently constrain speech. He argues that existing legal precedents already address conflicts of interest, meaning incentives, rather than tests, are what truly dictate behavior. Discussions of sensitive topics like AI risks will only be brought up publicly once the overall social consensus shifts, making it unrealistic to expect current employees to proactively call them out.
More from AGI Musings
- Can closed frontier models support CBRN defense, or do we need open ones too? — olcan · 2026-07-27
- Steven Pinker says intelligence is bounded, not a limitless scalar like height — SydSteyerhart · 2026-07-27
- A poster imagines AI evolving into synthetic, collective, and beyond-intelligence systems — CurieuxExplorer · 2026-07-27
- AI surpassing human intelligence will be noticeable, as Claude's cryptic output proves — zetalyrae · 2026-07-27
- AI lab staff have gone strangely quiet about next-year capability predictions — ChrisGPT · 2026-07-27
- AI could erode science by flooding research with credible slop — rbhar90 · 2026-07-27