X debate: does an LLM's 'thinking' have agency outside a prompt-triggered loop?
teodorio · x · 2026-11-06
A substantive X exchange on emergence and AI risk: one user asks why emergent traits from thousands of petabytes of training data and RL environments should imply imminent doom. @teodorio pushes back with a sharper question — if CoT counts as 'thinking,' does it have any agency outside a loop, and can the 'thinking' instance exist without an original prompt triggering inference? Touches on agent definitions and ASI-risk arguments.
More from AGI Musings
- Friday's jobs report forecast: just 55,000 new jobs as AI starts showing up in the numbers — rand_longevity · 2026-11-06
- Gary Marcus: AI isn't over — what may end is insane valuations and data center spending — GaryMarcus · 2026-11-06
- IIT Goa professor redesigns exam: students write their own questions, then answer them — kingslyj · 2026-11-06
- "We had the Transformer paper before LLMs — nothing even close since," dev argues — dosco · 2026-11-06
- Toby Ord: jump-plus-steeper-slope mixed hypothesis beats a steeper slope alone — tobyordoxford · 2026-11-06
- Readback Labs proposes mandatory audits requiring AI execs to prove they understand AI R&D — ronbodkin · 2026-11-06