Goodfire founder's essay argues neural networks are already clean, sparking interpretability optimism
Nick Cammarata, founder of Goodfire and an early contributor to OpenAI's mechanistic interpretability work, has published a long essay, "Neural Networks Are Already Clean," arguing that neural networks are not the "tangled, inscrutable" objects they were once thought to be—and that the outlook for mechanistic interpretability is far better than the field previously believed. The piece has sparked wide community discussion.
Confirmed
- Nick Cammarata worked on early mechanistic interpretability research at OpenAI, and was pessimistic at the time because tools could only read about 2% of neurons.
- The essay's core claim: the landmark evidence for "polysemantic neurons" in early models was misread, and the seemingly arbitrary mixing of concepts is not an intrinsic property of neural networks; in today's models with up to trillions of parameters, the vast majority of neurons are already readable.
- He argues interpretability may be the most important scientific question in the world today—you can't solve alignment without knowing what you're building.
- The project page is public at already-clean.goodfire.com and spread through the community after being shared on Reddit.
Why it matters
- If the "networks are already clean" thesis holds, mechanistic interpretability shifts from a distant vision to an engineering path that can scale, with direct implications for the feasibility of alignment and model safety.
- The attitude shift of a front-line researcher—from early pessimism to present optimism—is itself a signal. tszzl commented that reading it "catapulted" his understanding of neural networks "five years into the future," reigniting the pure joy of probing deep learning's mysteries—evidence of the essay's impact on community confidence.
- Multiple sharers (e.g., danshipper) summed it up as "most of a trillion-parameter model's internals are readable," showing the result is widely seen as a landmark advance for interpretability.
2026-10-15 ~ 2026-10-16 · 8 related posts
Primary sources
- [source] Goodfire's Nick Cammarata: neural networks are "already clean" in a possible interpretability breakthrough — tszzl · 2026-10-15
- tszzl: interpretability breakthrough feels like my understanding of neural nets jumped five years — tszzl · 2026-10-15
- [source] OpenAI researcher's "Neural Networks Are Already Clean" sparks interpretability buzz — FomalhautCalliclea · 2026-10-15
- Ex-OpenAI interpretability lead: most neurons in trillion-parameter models are now legible — tszzl · 2026-10-16
4 near-duplicate retellings: danshipper · CatAstro_Piyush · burny_tech · tszzl