Does Anthropic's staff really believe in superintelligence? Insiders doubt culture scales
austinc3301 · x · 2026-11-06
A debate on whether Anthropic employees actually believe in ASI:
- Ben Goldhaber guesses the average Anthropic employee doesn't believe in superintelligence or ASI loss-of-control risks in a meaningful way — scaling culture and situational awareness to thousands of new employees is very hard
- eccentric1ty argues Dario doesn't meaningfully believe in ASI either: "a country of geniuses in a datacenter" is the wrong end state — the key question is what sort of AI such a system builds next, not what medicine it invents
Touches on culture dilution at the leading AI-safety lab and the argument that the goal should be self-improvement, not application outcomes.
More from AGI Musings
- Critical voices question AI companies' 'publications' lacking peer review — anshulkundaje · 2026-11-06
- Younger academics are reshaping academia's rush-to-publish culture, says Stanford prof — anshulkundaje · 2026-11-06
- Stanford prof Anshul Kundaje on why he never fears being scooped in research — anshulkundaje · 2026-11-06
- ML genomics teams coordinated joint release instead of racing to scoop each other — anshulkundaje · 2026-11-06
- Palisade's Jeff Ladish: models better at everything but still not funny or persuasive — JeffLadish · 2026-11-06
- Researcher: almost no real work looks like a year-long agent black box — RexDouglass · 2026-11-06