Three weeks of llama.cpp optimizations: collecting best t/s for Qwen3.8-27B
pmttyji · reddit · 2026-09-03
- Qwen3.8-27B shipped three weeks ago with day-0 llama.cpp support; several optimizations have landed since.
- Highlights: DFlash2 support merged into llama.cpp last week, ROCm 10.0 released and matched by llama.cpp (AMD-only), plus Ubuntu 26.04.1.
- The thread solicits community benchmarks: best pp/tg speeds and optimized commands across MTP/MTP+ngram/DFlash2 combos, 128-256K contexts, vision, and manual CMAKE build configs.
More from coding & agent
- MCP Platform NitroStack Wins Product Hunt Product of the Day, Focuses on Retention — EstablishmentFun4373 · 2026-10-21
- CodeRabbit Ships 5,000 PRs a Week With a Tiny Team, Hires by Strategy-Game Hours — omojumiller · 2026-10-21
- LukeW maps the five UI problems every AI-native company faces with agents — LukeW · 2026-10-21
- Claude Code over ADB guts a bloatware-laden Android TV, freeing ~90% more RAM — edwinarbus · 2026-10-21
- Developer uses Claude to fix his adware-slowed Xiaomi TV, releases tool for any Android TV — edwinarbus · 2026-10-21
- Open-weights Ornith-1.5-122B debuts with 84.5% SWE-bench Verified, runs on a single DGX card — _akhaliq · 2026-10-21