Goodfire on Running Probes During Training
teortaxesTex · x · 2026-07-16
GoodfireAI cautions that experimental setups for interpretability or monitoring probes must be handled with extreme care to avoid invalidating conclusions.
Their solution is to run probes on a frozen copy of the model during training, rather than directly on the active student model. This prevents the student from learning to "evade detection" as training scales.
They also noted that empirically, this method causes no degradation even on post-trained models, and they provided a more detailed discussion article on the topic.
Related event: Goodfire Shares Probe Monitoring Methods in RLFR Training(2 posts)→
More from Research
- Stanford Data-Centric AI Workshop reopens site, extends poster deadline — jure · 2026-10-26
- Hugging Face wraps 6-month Training Agents series with open recordings and code — SergioPaniego · 2026-10-26
- 'Vibe verification': ~60% of AI-written formal specs prove the wrong property — basedjensen · 2026-10-26
- Ito: a browser that detects browsing intent and auto-organizes tabs into Flows — andrewkuznet · 2026-10-26
- Cornell study says brains process language as linear sequences, challenging Chomsky's hierarchy — anirbanbandyo · 2026-10-26
- Hi3D V1.0 open-sourced with 2M training assets and 90% slicing success rate — kimmonismus · 2026-10-26