OpenCode Serves ~10T Tokens on a Single Rack; Most Startups Need Far Less GPU
JoshPurtell · x · 2026-10-31
Responding to evanjconrad's credit crunch thesis, JoshPurtell argues most startups need only a fraction of OpenCode's 10T tokens served to a massive DAU count on a single rack, so their GPU allocations should be small and easy to finance — suggesting a separate analysis of which startups will actually be forced into long contracts or prepayments.
More from Infra
- Kaggle Resource Usage Up 2-3x as Agents Flood In for ARC Competitions — GregKamradt · 2026-11-01
- Why AI data centers in space are not practical: cooling, radiation and maintenance — johnseach · 2026-11-01
- Dev runs 10-12 parallel coding sessions; says decision-making becomes the bottleneck — robleclerc · 2026-11-01
- Workshop: Build a media agent on CPU, call image and TTS models as MCP tools — Al_Grigor · 2026-11-01
- Amazon reportedly junking 2-3-year-old H100/H200 GPUs while books still assume 6-year depreciation — SumitGup · 2026-10-31
- Is a used 64-core Threadripper PRO 3995WX worth it for a multi-GPU LLM server? — Ammoryyy · 2026-10-31