'Humans built this': from LSTM to Transformer in 29 years, no credit to the machines
teortaxesTex · x · 2026-11-21
teortaxesTex argues humans have done an incredible job with AI — a run comparable from the Wright brothers to the Moon: 29 years since LSTM, 14 since AlexNet, 10 since the Transformer, with no crucial part owed to the machines themselves. Attached is a Post-Chinchilla pixel-art meme noting tokens/param has hit 28, past the Chinchilla-optimal 20: "20 tokens/param is so 2022."
More from AGI Musings
- Wharton MBA deck adopts 'Technology Bottlenecks' paper: same task, 23 vs 83 pressure by job — soumitrashukla9 · 2026-11-21
- Kevin Hartnett's new book "The Proof in the Code" charts Lean's history transforming math and AI — ipeirotis · 2026-11-21
- Jack Clark: AI speedup in scientific progress will define 2027 and beyond — jackclarkSF · 2026-11-21
- Yann LeCun: AI's biggest risk is power concentration in proprietary systems, not runaway models — ylecun · 2026-11-21
- "If we can't contain AI, why no more incidents?" developer challenges doom narrative — basedjensen · 2026-11-21
- Reddit essay: AI doom is the 21st-century rerun of humanity's age-old power paranoia — Possible-Insect3752 · 2026-11-21