If MLP neurons are monosemantic, is a model's knowledge capped by neuron count?

livgorton · x · 2026-10-18

Liv Gorton poses a sharp question: if MLP neurons are truly monosemantic/monofunctional, does that mean the number of entities a model can represent is bounded by its total neuron count?

Related event: Monosemanticity debate: Does neuron count cap what a model can know?(8 posts)→

Original post →

More from Research

Research channel →