Karpathy: Coding may reduce to MicroGPT specs and compilation

karpathy · x · 2026-08-21

Andrej Karpathy expanded on his view, suggesting that the extrapolation of current trends is that a user's specification might look like "microgpt" (scalar valued python with for loops, etc.), and everything else is just a matter of compilation. He implies that frameworks like PyTorch might just be a kind of crappy Intermediate Representation (IR) in this paradigm.

Related event: Karpathy: AI Agents Are Dissolving Old Software Abstractions(2 posts)→

Original post →

More from AGI Musings

AGI Musings channel →