Running Local LLMs on 285HX: CPU is Surprisingly the Fastest
nirurin · reddit · 2026-07-12
A user tested local LLM execution on an Intel 285HX mini PC, comparing different Llama.cpp backends and multiple models, focusing on speed differences among CPU, Vulkan, and SYCL+iGPU.
Test Environment
- Machine: MS-02, Intel Core Ultra 285HX, 64GB RAM
- Tool: Llama.cpp (tried Llama-Swap, but it wasn't very convenient under SYCL)
- Models: Various quantized versions of Qwen3, Qwen3.6, and Gemma4
Results
- Vulkan: Slowest overall, with some models hitting only 0.5–4 tk/s
- SYCL (iGPU+CPU): Significantly better than Vulkan, around 8–12 tk/s
- CPU-only: Surprisingly the fastest, reaching about 16.5 tk/s for Qwen3-30B and 14 tk/s for Qwen3.6-35B
Observations & Conclusions
- Past resources generally suggested Vulkan > SYCL, but on this generation of ARC-based iGPUs, the results appear reversed, or at least SYCL isn't as bad as the documentation implies.
- The author is unsure if the iGPU brings efficiency gains since no power consumption tests were done.
- Currently, pure CPU is the fastest solution.
- In these tests, Gemma4 isn't really worth it, while the CPU solutions for Qwen3 / Qwen3.6 are quite practical, with the author leaning towards recommending trying Qwen3.6 first.
Related event: Intel 285HX Tests Show CPU Beating iGPU for Local LLMs(2 posts)→
More from Infra
- Engram's random reads don't suit SSDs; CPU-memory over NVLink could serve all 72 GPUs — bookwormengr · 2026-09-11
- 80% of the DIY LLM inference hype posters have already quit — it's brutally hard systems work — abhijithneil · 2026-09-11
- Hugging Face's Ultra Scale Playbook: a free book on training LLMs on GPU clusters — mdancho84 · 2026-09-11
- Is inference latency becoming the biggest bottleneck for production AI agents? — Euphoric_Sea632 · 2026-09-11
- LLM Serving Metrics Thread: Why TPOT and Uptime Make or Break User Experience — abhijithneil · 2026-09-11
- PlanetScale launches sharded Postgres: 768 servers acting as one, 1PB scale — dhruv2038 · 2026-09-11