Inkling 2 Small Architecture Revealed: 594B Params, 17B Active
Detailed notes on Inkling 2 Small reveal a 48-layer decoder-only architecture with 594B total and 17B active parameters, a return of ViT, and RL consuming nearly half of pretraining compute.
2026-11-08 ~ 2026-11-08 · 2 related posts
- Episode 1: Thinking Machines Launches Inkling 2 Small, Weights to Open-Source Next Week(2026-11-06, 101 posts)
- Episode 2: Inkling 2 Small generates full stock diligence memo for $0.69(2026-11-06, 2 posts)
- Episode 3: Inkling 2 Small tops US open-weight model rankings(2026-11-06, 2 posts)
- Episode 4: Ex-OpenAI Policy Chief Miles Brundage Praises Inkling 2 Small(2026-11-06, 2 posts)
- Episode 5: Inkling 2 Small Pushes Open-Model Frontier in Code and Finance(2026-11-07, 2 posts)
- Episode 6: Leaks claim Thinky's new model matches DeepSeek at a fraction of the cost(2026-11-07, 2 posts)
- Episode 7: Inkling 2 Small Architecture Revealed: 594B Params, 17B Active(2026-11-08, 2 posts)
- Inkling 2 Small notes: 594B-param MoE with 17B active, RL ate ~half of pretraining FLOPs — teortaxesTex · 2026-11-08
- Inkling 2 Small details: 594B-param MoE with 17B active, ViT encoder is back — thoma_gu · 2026-11-08