Reddit asks: What do you actually use local LLMs for, and at what tk/s?
Ok-Option-82 · reddit · 2026-11-20
The OP admits to having "local LLM FOMO" — constantly testing new models for speed and eyeing new hardware — but wonders what people actually use local LLMs for and what token speeds are worth chasing.
More from Infra
- TensorFold 1.3.0 boosts GLM-5.3-Flash to 104 tok/s, 24% faster on Blackwells — AIFlow_ML · 2026-11-20
- Thermal camera footage proves AI agents can program custom AI chips directly — yaroslavvb · 2026-11-20
- Evidence for scaling EUV lithography power beyond ASML's 1 kW milestone — bronzeagepapi · 2026-11-20
- Liquid d1-2B decision model answers 19-30x more questions/min than same-size LLMs — mervenoyann · 2026-11-20
- Cactus Compute publishes 12 papers in 2026, 5 at NeurIPS, focused on on-device efficiency — joemeno · 2026-11-20
- Modular rebuilds MAX's Module API with PyTorch-like syntax and eager mode — clattner_llvm · 2026-11-20