Running Phi-4 Mini on Intel NPU/iGPU: Real-world Tests
Ecstatic-Wash-7667 · reddit · 2026-08-22
The author shares experience running Phi-4 Mini on Intel iGPU/NPU. Performance on the NPU is too slow for context compression but viable for specific, low-resource tasks like Dozzle log analysis (distinguishing real errors from noise and summarizing for a GP agent).
Key Issues:
- Phi is slow on iGPU/NPU (especially prompt processing).
- Hard to find use cases fitting the hardware constraints (beyond the standard TTS/STT stacks).
The author is seeking suggestions for other suitable tasks for small models on limited NPUs.
More from Infra
- Analyst: 80% of neoclouds may not survive, but the demand for their GPU capacity is real — BenBajarin · 2026-10-16
- Apple and Meta partner to run Muse Spark model on linked Mac Studios — pdamodaran · 2026-10-16
- Nvidia's developer base hits 11 million, up ~3.7x from 3 million in 2021 — Beth_Kindig · 2026-10-16
- Muse Spark Open runs locally on a Mac M3 Ultra via llama.cpp: frontier model on desktop — pcuenq · 2026-10-16
- Muse-Spark open-weights drop: 816B-A42B MoE model gets 359GB MLX 3-bit build — ns123abc · 2026-10-16
- Meta launches Muse Spark Open, says it runs on two M5 Ultra Mac Studios with Apple's help — The Verge AI · 2026-10-16