Activation Oracles Author Weighs In: 'A Fundamentally Non-Mechanistic' Interp Technique

saprmarks · x · 2026-09-07

saprmarks, co-author of the activation oracles work, says on X that he does not consider activation oracles or NLAs to be mechanistic interpretability methods, pointing to a section in the blog post literally titled "Activation Oracles are a fundamentally non-mechanistic technique for interpreting LLM activations." The thread also debates whether probes deployed at frontier labs count as a mech interp win.

Related event: Researchers Debate the Value and Boundaries of Mechanistic Interpretability(10 posts)→

Original post →

More from Research

Research channel →