Running Local LLMs on 285HX: CPU is Surprisingly the Fastest
nirurin · reddit · 2026-07-12
A user tested local LLM execution on an Intel 285HX mini PC, comparing different **Llama.cpp** backends and multiple models, focusing on speed differences among CPU, Vulkan, and SYCL+iGPU. ### Test Environment - Machine: MS-02, Intel Core Ultra 285HX, 64GB RAM - Tool: Llama.cpp (tried Llama-Swap, but it wasn't very convenient under SYCL) - Models: Various quantized versions of Qwen3, Qwen3.6, and Gemma4 ### Results - **Vulkan**: Slowest overall, with some models hitting only 0.5–4 tk/s - **SYCL (iGPU+CPU)**: Significantly better than Vulkan, around 8–12 tk/s - **CPU-only**: Surprisingly the fastest, reaching about 16.5 tk/s for Qwen3-30B and 14 tk/s for Qwen3.6-35B ### Observations & Conclusions - Past resources generally suggested **Vulkan > SYCL**, but on this generation of ARC-based iGPUs, the results appear reversed, or at least SYCL isn't as bad as the documentation implies. - The author is unsure if the iGPU brings efficiency gains since no power consumption tests were done. - Currently, **pure CPU is the fastest solution**. - In these tests, **Gemma4 isn't really worth it**, while the **CPU solutions for Qwen3 / Qwen3.6 are quite practical**, with the author leaning towards recommending trying Qwen3.6 first.
Related event: Intel 285HX Tests Show CPU Beating iGPU for Local LLMs(2 posts)→
More from Infra
- More open models and llama.cpp updates are coming, says Merve Noyan — mervenoyann · 2026-07-21
- Why adding a second LLM provider breaks more than the API surface — Ok_Extension6373 · 2026-07-21
- UK AI datacentres face backlash over heat, noise and land use — nordicinst · 2026-07-21
- Fluidstack raises $830M at $7.5B valuation as Anthropic backs a $50B compute buildout — rohanpaul_ai · 2026-07-21
- Early Krea2 Gradio WebUI targets 6GB low-VRAM local runs — Fluid_Kaleidoscope17 · 2026-07-21
- Z.AI starts running a 1GW AI data center built entirely on domestic chips — Polymarket · 2026-07-21