Swyx digs into MIT CSAIL's viral 'Weight-Space Programming': cool, reproducible, but temper the hype

rschu · x · 2026-11-05

MIT CSAIL's "Weight-Space Programming" post is exploding on timelines, with claims that LLMs will soon replace gradient descent and AdamW. Swyx (rschu retweeting sitzikbs) says he dug through the code and post: the work is very cool and reproducible, but the hype needs tempering — analysis expanded in the rest of his thread.

Related event: MIT's Weight-Space Programming Goes Viral, Sparking Debate(3 posts)→

Original post →

More from Models

Models channel →