Reddit asks: What do you actually use local LLMs for, and at what tk/s?

Ok-Option-82 · reddit · 2026-11-20

The OP admits to having "local LLM FOMO" — constantly testing new models for speed and eyeing new hardware — but wonders what people actually use local LLMs for and what token speeds are worth chasing.

Original post →

More from Infra

Infra channel →