Cross-model training matches self-training: Qwen learns from Llama investigations without privileged access
a_karvonen · x · 2026-09-05
Answering whether privileged access is needed, the authors trained Qwen on investigations of Llama behaviors and vice versa; the cross-trained model matches the self-trained one. However, open-ended self-explanations remain less reliable: consistent generalization appears in only one setting (Qwen-3.5-397B-A17B explaining whether it was influenced by a hint), which the authors flag as an open problem.
More from Research
- Rewriting an agent skill: A/B challenge runs show skills should only add what agents don't know — jmschreiber91 · 2026-10-21
- Seqlet caller follow-up: credits for DeepLIFT contributors — jmschreiber91 · 2026-10-21
- Center for AI Safety Publishes Full Syllabus for Intro to ML Safety Course — ArtificialOther · 2026-10-21
- Seqlet caller gets 22x speedup: 167,750 loci drop from 7.8s to 0.35s — jmschreiber91 · 2026-10-21
- X trends: SophontAI's Holon-S1 predicts gene activity from cancer slides; decision models rise — iScienceLuvr · 2026-10-21
- NEJM AI study: LLM-recommended care costs up to 10x more than physician orders — dvir_a · 2026-10-21