Sub-1T models already hit human level; brain's 100T synapses are largely redundant
teortaxesTex · x · 2026-11-03
teortaxesTex argues that achieving human-level or sometimes superhuman performance with sub-1T parameter models suggests they are not meaningfully underparametrized. He also doubts the claim that humans have a full 100T parameters, noting synapses are heavily redundant. If reaching human sample-efficiency requires models spanning hundreds of nodes, he says, that path simply sucks.
More from AGI Musings
- 'Recursive self degeneration': AI that gets more powerful while making worse decisions — cocktailpeanut · 2026-11-03
- Very few people treat the future as construction rather than prediction — signulll · 2026-11-03
- Researcher: alignment will be solved the bitter-lesson way, not via human enhancement — tszzl · 2026-11-03
- Under 1T params already superhuman — AI models aren't underparametrized, argues researcher — teortaxesTex · 2026-11-03
- Psychics push back as AI-generated readings flood apps and TikTok Live — Chris_Armstrong · 2026-11-03
- Bending Spoons CEO: AI now writes 94% of our code, up from 0% in two years — illscience · 2026-11-03