Data scientist debunks 'growing AI' narrative: it's just gradient descent nudging token probabilities
gerardsans · x · 2026-10-13
Responding to claims that AI 'grows' itself, data scientist Gerard Sans argues training is merely gradient descent adjusting token probability distributions under current weights — anthropomorphizing, not growth. He also criticizes Anthropic and other labs for having incentives to build mythical narratives around statistics, urging people to learn the technology instead of the story.
Related event: Data scientist debunks 'AI is growing' myth: it's just software(2 posts)→
More from AGI Musings
- AI safety researcher: burden of proof belongs on accelerationists, not doomers — DavidSKrueger · 2026-10-13
- Vincent Conitzer: Integrating Autonomous AI into Law Is a Millennium-Prize-Level Challenge — conitzer · 2026-10-13
- Nandan Nilekani proposes AI-generated test papers on exam day; doctor calls it his worst idea — DrDatta_AIIMS · 2026-10-13
- Runway co-CEO essay: from pixel simulator to a universal simulator of reality — notiansans · 2026-10-13
- The Nation profiles Anthropic's push for users to be kind to Claude — thenationmagazine · 2026-10-13
- People don't want to manage agents — they want agents that manage agents — round · 2026-10-13