Subliminal Learning Lifts Qwen Letter-Counting From 27.3% to 59.8%
OwainEvans_UK · x · 2026-10-10
Subliminal learning can transfer learned skills: Qwen is poor at counting letters. After training an improved-counting Qwen teacher, a fresh student finetuned on the teacher's answers to unrelated Alpaca prompts rose from 27.3% to 59.8% accuracy, while a control student finetuned on base-Qwen data failed to improve.
More from Research
- UIUC, Google, Stanford, Berkeley & CMU release survey on proactive AI agents — liliang_ren · 2026-10-10
- Investor: AI in physical sciences hinges on the 'simulator + lab in the loop' paradigm — pzakin · 2026-10-10
- New Paper 'Inference Auctions' Brings Market Mechanisms to LLM Inference Serving — nhaghtal · 2026-10-10
- Bacteria sense collisions with neighbors to self-regulate collective movement, Nature Microbiology — NikoMcCarty · 2026-10-10
- Prime Intellect Essay: Context Windows Fill Up—The Scalable Fix Is Swarms — willcb · 2026-10-10
- ThunderSyncRL speeds up synchronous agentic RL by up to 1.9x with zero policy staleness — StanfordAILab · 2026-10-10