Kids as raw chains of thought: random exploration, backtracking, few induction steps

giffmana · x · 2026-10-14

giffmana (Andrej Karpathy) quips that 5-6 year olds are great because you can monitor their raw, unfiltered chain of thought all day: articulate enough to speak it, but not yet filtering it. Lots of random exploration, backtracking and forgetting, with no more than 2-4 induction steps — an analogy for LLM reasoning behavior.

Original post →

More from Fun

Fun channel →