Throwback on training LMs from scratch says it feels like “raising a child”

thesephist · x · 2026-07-22

A throwback quote contrasts training a language model from scratch with using an off-the-shelf model.

The key point is that watching a model learn to speak, form concepts, and then reason feels fundamentally different from using a ready-made system — like “raising a child” rather than just using a tool.

Original post →

More from Models

Models channel →