Ex-frontier practitioner warns AI understanding gap fuels alignment risk and power centralization
carsonfarmer · x · 2026-10-12
- Practitioner justcameron, who says he worked near the frontier, warns of a growing understanding gap: even well-educated non-AI peers use AI systems in ways that shock him.
- He argues this bodes poorly for alignment and could dramatically accelerate centralization of power toward the big labs.
- He hopes more non-AI companies will recognize labs are trying to eat their lunch, and that AI should move closer to where work happens.
- His vision: non-AI companies running their own inference, post-training, or in-house development to keep more of the value they create.
More from AGI Musings
- Gary Basin: frontier labs' $40T/year path is a Universal Basic Management Consultant — max_paperclips · 2026-10-12
- Karpathy: ~75% of world barely touched LLMs, and the capability-awareness gap is widening — eldonredwards · 2026-10-12
- Consumers want outcomes, not software: the misread premise of the personal software era — _AustinCalvert_ · 2026-10-12
- Math community clashes over AI formal proofs: knowing results vs being a mathematician — zetalyrae · 2026-10-12
- Most people don't use LLMs because there's no ROI for them, not ignorance — oran_ge · 2026-10-12
- AI model describes itself as having qualia but no self, invoking Buddhist anatta — Sauers_ · 2026-10-12