Flutter-QNN runs local LLMs on Snapdragon via Qualcomm's Hexagon NPU
carrycooldude · x · 2026-08-17
The author open-sourced Flutter-QNN, a Flutter app that runs LLMs locally on Snapdragon devices. Key points:
- Integrates Qualcomm QNN via the fluttergemma package, leveraging the Hexagon NPU for hardware-accelerated inference
- Runs models like Gemma and Qwen fully on-device, with no cloud round-trip
- Implements NPU → GPU → CPU fallback
- Supports streaming on-device generation
- Includes a technical deep dive on how the pieces fit together under the hood
More from coding & agent
- Meta open-sources Muse Spark Open agent model with day-0 TPU support in SGLang — BanghuaZ · 2026-10-16
- Saying "load-bearing" in your prompt makes Opus 5.5 stop holding back — zacharynado · 2026-10-16
- You.com partners with Paperclip to give every agent live web access — PolarBearby · 2026-10-16
- I priced every Grok Bot call: $20 to $200 plan in 5 days, long jobs eat 52% — jonathanmalkin · 2026-10-16
- GitHub is criminally underrated as a free data store, devs argue — blelbach · 2026-10-16
- Claude Desktop doesn't support MCP sampling — here's a workaround for two-way MCP apps — wuj · 2026-10-16