Researcher says much SAE work added little to understanding how models actually work
thebasepoint · x · 2026-09-27
- In a discussion thread, the author advises against hillclimbing a method for its own sake: focus on what a method tells you about how models work — what information is accessible in what arrangement, and how to exploit it to explain phenomena or build new methods.
- He explicitly criticizes a sea of SAE (sparse autoencoder) work as having added little to our understanding of models and their mechanisms.
Related event: Researchers Call SAE Work Limited, Urge Mechanistic Understanding(3 posts)→
More from Research
- microVLA runs pi0.5 VLA training and inference on a 4GB RTX 3050, 2.5x latency cut — this_is_surabhi · 2026-11-16
- WebArena-Pro launches: 300-task multimodal web-agent benchmark across 20 apps — xhluca · 2026-11-16
- U-M's CrowdBark crowdsources dog videos to study canine communication with AI — radamihalcea · 2026-11-16
- Top 10 Eval Papers of 2026: verifiers, agent-as-a-judge, and audit of self-improvement — omarsar0 · 2026-11-16
- Koshien robot team shares control stack: nonlinear-opt trajectories hit ±1.2cm average error — 4310sy · 2026-11-16
- A diffusion model trained on CIFAR-10 re-images black hole M87* — and the ring persists — bravo_abad · 2026-11-16