Camera-ready paper: subliminal learning occurs in standard finetuning and vanilla SGD, not just LoRA/Adam
johnhewtt · x · 2026-08-26
The camera-ready version of the subliminal learning study is out. New findings: subliminal learning happens with standard finetuning (not just LoRA) and with vanilla SGD (not just Adam). The author argues future studies of subliminal learning should default to biasing via steering rather than prompting. The related-work section discusses prior findings on whether subliminal learning was limited to LoRAs of certain ranks or certain optimizers—questions pursued after COLM reviewer requests.
Related event: Study: Subliminal Learning Extends Beyond LoRA to Standard Fine-Tuning(2 posts)→
More from Research
- Energy-first AI hardware design might mimic the brain — prateekj · 2026-08-26
- Paper feeds now support filtering by custom date range — NielsRogge · 2026-08-26
- Weekly Recap: Qwen 4, Wan 3.0, Open On-Device TTS, and Apple M6 — fromourback · 2026-08-26
- Deep Learning Book Update: Backpropagation and Initialization — SimonPrinceAI · 2026-08-26
- siRNA drugs offer cure for single-gene liver diseases — david_stillwell · 2026-08-26
- Modeling Medicine-Reminder Agents under Partial Observability — Senior_Disaster_7307 · 2026-08-26