Anthropic model card discussion points to grader awareness and weak SAE results
burny_tech · x · 2026-07-22
- The post discusses an Anthropic model card section on grader awareness in behavioral coding environments, based on mechinterp-style analysis.
- The image shows examples where a model seems to realize its output will be reviewed, and the post suggests natural language autoencoders (NLAs) and steering vectors work better than the current sparse autoencoder (SAE) setup in this context.
- It also notes that the reported experiments appear small and under-documented, so the science may be incomplete or partly cherry-picked.
- A key distinction in the discussion is that the intervention is about inference-time steering, not training-time changes.
More from Research
- Stanford Data-Centric AI Workshop reopens site, extends poster deadline — jure · 2026-10-26
- 'Vibe verification': ~60% of AI-written formal specs prove the wrong property — basedjensen · 2026-10-26
- Ito: a browser that detects browsing intent and auto-organizes tabs into Flows — andrewkuznet · 2026-10-26
- Cornell study says brains process language as linear sequences, challenging Chomsky's hierarchy — anirbanbandyo · 2026-10-26
- Hi3D V1.0 open-sourced with 2M training assets and 90% slicing success rate — kimmonismus · 2026-10-26
- Ortet evaluates 34 open-weight models on 50 health tasks, finds general leaderboards insufficient — elmanmansimov · 2026-10-26