Anthropic’s global-workspace paper hints at a fixed semantic coordinate system in LLMs
tszzl · x · 2026-07-26
- The author argues that Anthropic’s recent paper on global workspaces in LLMs sheds light on the Chinese Room puzzle.
- The most striking result is that averaging Jacobians across contexts can still produce a meaningful readout for which word a token would generate at a given layer.
- That suggests intermediate LLM representations may live in a shared, fixed coordinate system for meaning, rather than changing arbitrarily with context.
- In this view, different layers communicate in a common semantic language before producing the final output.
More from AGI Musings
- AI accusations shake literary prizes from Caine to Goncourt: who decides what's human? — TuhinChakr · 2026-10-26
- Tech discovers wargaming: applying to be Anthropic's tabletop exercise lead — round · 2026-10-26
- RSI is the culmination of the industrial revolution: a factory building a faster factory — tobias_rees · 2026-10-26
- NYT roundtable asks five experts what the rules for AI companies should actually be — ShakeelHashim · 2026-10-26
- Anti-AI content is algorithm gold and very profitable, quips commentator — annetgriffin · 2026-10-26
- Silicon Valley breakdown: five Stanford-area giants worth ~$18T — FinanceYF5 · 2026-10-26