Researchers Question Payoff of Inkling 2 Small's Native 4-bit Training
Andrew Carr and Nathan Lambert question the value of Inkling 2 Small's native 4-bit end-to-end training, noting it only sped up pretraining by about 8% (roughly five hours), which they argue hardly justifies the engineering effort.
2026-11-14 ~ 2026-11-14 · 2 related posts
- Episode 1: Thinking Machines Details End-to-End 4-Bit Training of Inkling 2 Small(2026-11-14, 10 posts)
- Episode 2: Researchers Question Payoff of Inkling 2 Small's Native 4-bit Training(2026-11-14, 2 posts)
- Native 4-bit end-to-end training yields just 8% pretraining speedup, sparking debate — andrew_n_carr · 2026-11-14
- Nat Lambert questions: was all that work worth just a 5-hour pre-training speedup? — natolambert · 2026-11-14