Inkling 2 Small pretrained on 8.4T tokens in 68 hours, natively in NVFP4
clarejtbirch · x · 2026-11-06
Guangxuan Xiao revealed that Inkling 2 Small's main pretraining phase processed 8.4T tokens in 68 hours, natively in NVFP4 precision — described as one rung of the team's "predictive scaling ladder," with more to come.
Related event: Thinking Machines Releases Inkling 2 Small Open-Weight Model(42 posts)→
More from Infra
- Zyphra ships ZYFA: FP8 attention on AMD MI355X at 1.16-1.76x AITER throughput — bclavie · 2026-11-06
- Akamai's signed AI book tops $14B, anchored by Anthropic's $11.6B commitment — pdamodaran · 2026-11-06
- Teknium pushes back on METR's 'no bottlenecks' claim, citing funding and compute cost inflation — Teknium · 2026-11-06
- Fudan's D3D decouples diffusion drafting for asynchronous speculative decoding speedups — Fudan-University · 2026-11-06
- ThursdAI pod: midterms, 40 datacenter ballot measures, $3T wipeout — is AI over? — altryne · 2026-11-06
- sshhole Bug Analysis: Alpine/MUSL Systems Hit Hard, ~100-500M OpenWRT Routers Were at Risk — esrtweet · 2026-11-06