Ambient SFT: treating the pre-finetune model as a noisy teacher, up to 21% gains

giannis_daras · x · 2026-11-19

Researcher giannisdaras introduces Ambient SFT, a drop-in replacement for standard SFT for LLMs:

Related event: Ambient SFT: Plug-and-Play Fine-Tuning That Avoids Forgetting(4 posts)→

Original post →

More from Research

Research channel →