Extropic teases Z1T-0.1 as it races from GPT-2 toward GPT-3-level models
beffjezos · x · 2026-09-05
Extropic announced Z1T-0.1 is coming soon and revealed how fast its Z1 architecture is scaling: current models are "barely GPT-2 level," and the team started a new training run overnight to see if it could hit GPT-3 level by the weekend. Per its scaling law, training the same performance on GPUs costs 10-15x more flops due to wasteful matmuls that don't exist on Z1 hardware, while parameter counts stay the same.
More from Infra
- Is AI-Native Web Infrastructure a Real Category? Mapping TollBit, Exa, Parallel and Friends — Genzinvestor16180339 · 2026-09-05
- Extropic founder claims 1000X more efficient AI inference could be worth trillions — beffjezos · 2026-09-05
- Podcast Jokes About Scouting a 20GW Datacenter Site in Tahoe — chrisalbon · 2026-09-05
- Datacenters vs Shale Oil: Investors Wrong to Dismiss Selling Compute as a Commodity — abhiadesai · 2026-09-05
- Omnigent's Four-Line Defense Against Surprise LLM Bills: Routing, Budgets, Visibility — matei_zaharia · 2026-09-05
- GPT-6 Astra reportedly pretrained on 100,000+ GPUs at Stargate in Abilene, Texas — NinaDSchick · 2026-09-05