Running Phi-4 Mini on Intel NPU/iGPU: Real-world Tests
Ecstatic-Wash-7667 · reddit · 2026-08-22
The author shares experience running Phi-4 Mini on Intel iGPU/NPU. Performance on the NPU is too slow for context compression but viable for specific, low-resource tasks like Dozzle log analysis (distinguishing real errors from noise and summarizing for a GP agent).
Key Issues:
- Phi is slow on iGPU/NPU (especially prompt processing).
- Hard to find use cases fitting the hardware constraints (beyond the standard TTS/STT stacks).
The author is seeking suggestions for other suitable tasks for small models on limited NPUs.
More from Infra
- Meta releases Muse Spark Open: 816B-param open-weight model with 1M context, natively multimodal — IanAndrewsDC · 2026-10-16
- llama.cpp adds day-0 support for Meta's 816B Muse Spark Open within 30 minutes — ngxson · 2026-10-16
- Copper to optical: optical backplanes seen as necessary as racks move to optics — BenBajarin · 2026-10-16
- Polymarket prices 28% odds a US state enacts data center moratorium by year-end — Polymarket · 2026-10-16
- Pennsylvania residents reject $10,000-per-household offer for massive Amazon data center — Polymarket · 2026-10-16
- PyTorch now runs natively on AWS Trainium with zero code changes — PyTorch · 2026-10-16