If AI-built AIs stop modeling humans, do humans still matter operationally?
PierceLilholt · x · 2026-07-26
A short but pointed AGI question: if future AI systems are built by AIs and no longer need to model humans closely, do humans still matter operationally in the loop?
It frames a bigger debate about whether human behavior remains a necessary reference point for alignment, product design, evaluation, or whether AI systems can become internally self-referential and optimized around machine-to-machine objectives.
More from AGI Musings
- Earth may be the only known home of conscious life, the post argues — XFreeze · 2026-07-26
- Ploutos to host Dr. Jing Cai on mapping human language’s neural building blocks with LLMs — ceciletamura · 2026-07-26
- Wolfram says AI may be inherently unpredictable, not because it hides, but because it computes — 新智元 · 2026-07-26
- Sam Altman says the singularity is already here, reigniting debate over AI self-improvement — 新智元 · 2026-07-26
- AGI risk is about the gap between model power and society’s defenses — joshua_saxe · 2026-07-26
- An X post says AI agents are already being packaged into official clients and office tools — sankin_eth · 2026-07-26