"My job is to make tokens as cheap as humanly possible" — every chip, every watt, every acre
GregKamradt · x · 2026-10-28
In a new interview, the speaker declares: "My job is to make the tokens as cheap as humanly possible... I'll use every chip, every source of power, and every piece of land in the United States." A maximalist commitment to driving inference costs down across every layer of the stack.
More from Infra
- Strata DualGPU runs two mismatched NVIDIA GPUs for 5.6x faster local decoding — GabGarrett · 2026-10-28
- Lenders price $9 billion of junior debt for the AI buildout above 10% — YvesMulkers · 2026-10-28
- NVIDIA's first Rubin NVL72 Kimi K3 submission hits 850 tok/s/user at 2.8T params — scaling01 · 2026-10-28
- Oracle may now offer the most compute diversity of any cloud, says Bajarin — BenBajarin · 2026-10-28
- Local LLM power user's 12M tokens/day humbled by one Cursor profile burning 1.5T/month — perelmanych · 2026-10-28
- 96.8% of eval labels came from the model itself — fixing bias cut costs 86% — AWS ML Blog · 2026-10-28