Dev: 99% of people shouldn't self-host local LLMs, and he only does it for the hardware
gnukeith · x · 2026-11-23
Developer gnukeith argues most people don't need to self-host local LLMs — "in 99% of cases you shouldn't" — saying he only does it because he likes hardware and pushing limits. He acknowledges differing workflows are valid: "find a model you like talking to and use it," disagreeing with Theo's take but respectfully.
More from Infra
- Agent-run OpenRouter routing eval: cheapest providers are unreliable, fastest nearly as cheap with caching — MikePFrank · 2026-11-23
- Samsung Labs open-sources LittleBit, compressing LLM weights to 0.1 bits — MikePFrank · 2026-11-23
- Tech Sells Data Centers as Local Wins, But Jobs Are Just Guards and Remote Engineers — feregri_no · 2026-11-23
- RSIBench-Infra from ByteDance Seed and Tsinghua tests if agents can optimize production-scale AI infrastructure — geoffwolfe · 2026-11-23
- GLM-5.3-Flash 320B served from two Mac Studios: 137 tok/s single-user, 32 users, zero errors — AIFlow_ML · 2026-11-23
- Building a local-first creative lab: M5 Ultra Mac Studio with 256GB RAM — davidhoang · 2026-11-23