RTX 5080 laptop tested running local LLMs: 27B decode drops to 9 tok/s

Tests on an RTX 5080 laptop show local 27B models suffer from insufficient VRAM, with decode speeds of only 9.1 tok/s, while the smaller Gemma 4 12B achieves roughly 1930 tok/s prefill and 49.4 tok/s decode.

2026-10-19 ~ 2026-10-19 · 4 related posts

• Gemma 4 12B on a gaming laptop: 1,926 tok/s prefill but CPU-throttled 49.4 tok/s decode — draginol · 2026-10-19
• Local LLM on a gaming laptop: Qwen 27B hits 441 tok/s prefill but only 9.1 tok/s decode on RTX 5080 — draginol · 2026-10-19
• Running a 27B model locally on a gaming laptop: mobile RTX 5080 falls short — draginol · 2026-10-19
• Gemma 4 12B local benchmark: 1,937 tok/s prefill on RTX 5080 laptop — draginol · 2026-10-19