'Humans built this': from LSTM to Transformer in 29 years, no credit to the machines

teortaxesTex · x · 2026-11-21

teortaxesTex argues humans have done an incredible job with AI — a run comparable from the Wright brothers to the Moon: 29 years since LSTM, 14 since AlexNet, 10 since the Transformer, with no crucial part owed to the machines themselves. Attached is a Post-Chinchilla pixel-art meme noting tokens/param has hit 28, past the Chinchilla-optimal 20: "20 tokens/param is so 2022."

Original post →

More from AGI Musings

AGI Musings channel →