MOSS-Image 5B runs fully on a phone NPU: ~30s for 512x768 on Snapdragon 8+ Gen 1
shirosoro · reddit · 2026-11-08
HexAnima v1.3.0, a free open-source Android app, runs OpenMOSS's MOSS-Image 5B (Apache-2.0) entirely on the Hexagon NPU—no root, cloud, or account. The Qwen3.5-9B text encoder, 5.1B DiT, and FLUX.2 small VAE decoder stream as 8-bit tiles into the HMX matrix unit. On a Snapdragon 8+ Gen 1 Xiaomi 12T Pro: 30s for 512x768, 60s for 768x1024, 80s for 1024x1024. Any MOSS-Image .safetensors LoRA can be validated and folded on-device. Limitations: text-to-image only, longer in-image text often garbles, 14GB download, and only Snapdragon 8 Gen 1/8+ Gen 1 (Hexagon V69) supported. The author also wrote custom HVX/HMX kernels and fixed a V69 quirk where Q6Vqf16vsub skewed 8-bit dequantization by one level.
More from Infra
- nanoGPTJAX Author Plans Hardware-Specific Kernels and an NVFP4 Showcase — A_K_Nain · 2026-11-08
- Zyphra's ZHA sparse attention keeps 35B model quality while reading just 1-6% of KV-cache — burny_tech · 2026-11-08
- llama.cpp merges PR #30966: run missed MoE experts on CPU instead of PCIe transfers — QuixiAI · 2026-11-08
- DGX Spark prices are starting to come down — AIFlow_ML · 2026-11-08
- Open-weight models now handle 72% of OpenRouter tokens: build your fallback before prices bite — shashib · 2026-11-08
- CoreWeave CEO: one data center uses about as much water yearly as one Krispy Kreme store — aronchick · 2026-11-08