Running Phi-4 Mini on Intel NPU/iGPU: Real-world Tests
Ecstatic-Wash-7667 · reddit · 2026-08-22
The author shares experience running Phi-4 Mini on Intel iGPU/NPU. Performance on the NPU is too slow for context compression but viable for specific, low-resource tasks like Dozzle log analysis (distinguishing real errors from noise and summarizing for a GP agent).
Key Issues:
- Phi is slow on iGPU/NPU (especially prompt processing).
- Hard to find use cases fitting the hardware constraints (beyond the standard TTS/STT stacks).
The author is seeking suggestions for other suitable tasks for small models on limited NPUs.
More from Infra
- Lium connects 250 Macs, served 4.5B tokens via distributed network — markjeffrey · 2026-08-22
- Stripe buys the "meter": IT perspective on the OpenRouter acquisition — sanjaykalra · 2026-08-22
- X launches second-degree reply controls powered by binary fuse filters — lemire · 2026-08-22
- Nvidia DGX Station desktop PC confirmed to cost $100,000 — firstadopter · 2026-08-22
- US data center moratoriums pop up as Big Tech expansion faces local backlash — deanwball · 2026-08-22
- x402 Protocol Replaces Thousands of APIs with One Line of Code for Agentic Payments — 0xJeff · 2026-08-22