Tinker ships Dimuon, a LoRA optimizer that beats AdamW in fewer steps on SFT tests

miramurati · x · 2026-10-15

Mira Murati amplified two Tinker updates: the launch of Dimuon, a new optimizer built for LoRA fine-tuning that often reaches lower loss than AdamW in fewer steps in their SFT tests (still experimental, usable today in Tinker with an accompanying optimizers guide), and an ongoing hiring push for researchers and infra/systems experts.

Related event: Thinking Machines Releases Dimuon Optimizer for LoRA Fine-Tuning(4 posts)→

Original post →

More from Companies & People

Companies & People channel →