Running a 27B model locally on a gaming laptop: mobile RTX 5080 falls short
draginol · x · 2026-10-19
@draginol shared detailed results of running a 27B model locally on a gaming laptop. The mobile NVIDIA RTX 5080 lacks enough VRAM to fit the full model, and performance suffers as a result. Detailed benchmark data is linked in the post — a concrete example of VRAM being the main bottleneck for on-device LLM deployment.
Related event: RTX 5080 laptop tested running local LLMs: 27B decode drops to 9 tok/s(4 posts)→
More from Infra
- PyTorchCon North America 2026 Opens in San Jose With Seven Tracks — PyTorch · 2026-10-20
- Tried to buy an RTX 5090 under $10k this week — couldn't find a single one — CedricMakes · 2026-10-20
- Amazon says its AI chips will support popular coding languages, challenging Nvidia — pstAsiatech · 2026-10-20
- Q-CTRL: over 99.5% of qubits sit idle in one fault-tolerant Shor's algorithm blueprint — MJBiercuk · 2026-10-20
- Token-maxxing is dead: OpenRouter's token usage plateaus — pranshuchittora · 2026-10-20
- Nscale and Anthropic reportedly in talks for another $45 billion compute deal — TechCrunch AI · 2026-10-20