Inference runs now exceed $100k — soon rivaling full pretraining costs of some Chinese LLMs
1a3orn · x · 2026-10-06
1a3orn says we're already way over $100k inference runs, reframing the industry question: not "when is the first billion-dollar training run?" but "when is the first $100k inference?" OpenAI may soon run multi-agent swarm inference whose cost exceeds the entire pretraining of some Chinese LLMs.
More from Infra
- DDR5 Overclocking Boosts Out-of-VRAM MoE Inference by Up to 14% in Real Tests — EvolvingDior · 2026-10-06
- vLLM's Transformers backend now serves text, image, audio and video with zero custom code — LysandreJik · 2026-10-06
- DeepSeek raises at least $12B, eyes IPO in early 2027, Bloomberg reports — teortaxesTex · 2026-10-06
- SEC filing: 80% of Anthropic's $518B compute commitments owed even if idle — rohanpaul_ai · 2026-10-06
- llama.cpp Metal PR boosts speculative decoding up to 3.6x on Apple Silicon — pmttyji · 2026-10-06
- Tiny decision model Jev classifies 1,000 papers for $0.08, letting frontier LLMs skip yes/no drudgery — TinfoilTricorn · 2026-10-06