SAE-FNO: Caltech team's function-space sparse autoencoders accepted at NeurIPS 2026
AnimaAnandkumar · x · 2026-10-06
Anima Anandkumar's team has a NeurIPS 2026 paper introducing Sparse Autoencoder Neural Operators (SAE-NOs). Unlike standard SAEs that represent concepts with scalar activations, SAE-FNO parameterizes concepts as functions via Fourier neural operators, using concept sparsity and domain sparsity to capture not just which concepts are active but how and where they are expressed — with implications for mechanistic interpretability on structured data. (arXiv:2509.03738)
More from Research
- Rubric-conditioned self-distillation for reward supervision accepted at COLM 2026 — armancohan · 2026-10-07
- Jordan and coauthors tackle when to stop generator-verifier loops while controlling false discovery — _onionesque · 2026-10-07
- GroundedSLAM debuts, decisively beating all methods on Meta's egocentric SLAM benchmark — Scobleizer · 2026-10-07
- HCI researcher begs authors to stop claiming 'reflexive' thematic analysis without reflexivity — IanArawjo · 2026-10-07
- Reza Zadeh claims faster matrix multiplication algorithm, suspects labs near exponent 2 — Reza_Zadeh · 2026-10-07
- Redditor proposes graph-based deterministic modeling to make LLM finance agents trustworthy — jonnylegs · 2026-10-07