PSI learns label-free causal carriers in LLMs, matching supervised alignment on MIB
TrackingActions · x · 2026-11-19
A new mech-interp preprint (arXiv:2611.21307, Muratore & Mathis) introduces PSI: a low-rank activation subspace learned inside a frozen LLM that carries its choice, so swapping it changes the model's answer as a declared "semantic program" specifies — no counterfactual labels needed. On the MIB benchmark it matches supervised alignment at equal data/budget, and on natural science questions without gold labels it tracks the model's own answers better than a gold-label-trained subspace.
More from Research
- RhoAgent in Nature Biotech brings AI design from proteins to programmable functional RNA — EricTopol · 2026-11-19
- Designing a humanoid robot foot: heel strikes hit 1511N, whole foot weighs 117g — dee_hw · 2026-11-19
- Google's GUARD paper: frozen base model, self-editing agent harness gains +8.89 points — omarsar0 · 2026-11-19
- Kezek splits mono two-person conversations into per-speaker tracks for full-duplex dialogue training data — manifestro · 2026-11-19
- Elie Bakouch: current AI research benchmarks overfit and can't track RSI — eliebakouch · 2026-11-19
- Hutter Prize text compression jumps ~10% by overfitting small transformers for arithmetic coding — ricklamers · 2026-11-19