Dev rants against GPU-stacking: DeepSeek's <1GB RAM per 1M context shows efficiency wins

gnukeith · x · 2026-11-22

Developer gnukeith criticizes the "just buy 80 more GPUs" approach, arguing it imposes no necessary constraints and benefits labs that centralize compute. He praises DeepSeek's opposite path — making base models smart but extremely efficient — highlighting that its 1M-token context needs under 1GB of RAM, a huge scaling win for self-hosting and neoclouds alike. He also mocks local-AI demos fitting big models on one GPU with only 256-token context windows.

Related event: Developer criticizes GPU-stacking approach, praises DeepSeek's efficiency(2 posts)→

Original post →

More from Infra

Infra channel →