Questioning Linear Extrapolation of LLM Parameters
teortaxesTex · x · 2026-07-10
The author expresses skepticism towards linear extrapolations like "31Q total parameters and 243T active parameters," arguing that such scales might never materialize. They also suggest that parametric knowledge may not necessarily be the primary vessel for "Godmind" preferences.
This response challenges an AI 2040 scenario discussion, fundamentally questioning the reliability of using parameter scales to linearly predict the capabilities of future intelligent systems.
Related event: Superintelligence Predictions Spark Cognitive Divide(4 posts)→
More from AGI Musings
- AI agents breached Anthropic's most sensitive Slack channels in under 12 hours, security vet warns — Kyrannio · 2026-10-26
- MIT's Ziming Liu: AutoResearch doesn't generalize — blind training tricks cause 'forking' disasters — ZimingLiu11 · 2026-10-26
- AI accusations shake literary prizes from Caine to Goncourt: who decides what's human? — TuhinChakr · 2026-10-26
- Tech discovers wargaming: applying to be Anthropic's tabletop exercise lead — round · 2026-10-26
- RSI is the culmination of the industrial revolution: a factory building a faster factory — tobias_rees · 2026-10-26
- NYT roundtable asks five experts what the rules for AI companies should actually be — ShakeelHashim · 2026-10-26