Speculating a text-to-weights programming language built from parameter space

menhguin · x · 2026-09-27

Responding to tszzl's bet that neural networks will be decomposed into evolved symbolic systems, the author speculates on "text-to-weights" / parameter-space programming: if clusters of neurons mapping to Python if/else semantics could be isolated, one could theoretically build a strange programming language or compiler from them — effectively extreme MoE sparsity. He also sketches alternatives like treating all code as tokens. Pure speculation, no experiments.

Related event: Researcher Bets Neural Networks Decompose Into Evolved Symbol Systems(3 posts)→

Original post →

More from AGI Musings

AGI Musings channel →