SmolChat v17: On-Device GGUF LLMs on Android Now Ships an OpenAI-Compatible Server
shubham0204_dev · reddit · 2026-11-02
SmolChat, an open-source Android app for running GGUF models locally, released v17 with an OpenAI-compatible HTTP server kept alive via a foreground service, global chat settings, in-app model downloads, upstream llama.cpp sync, corrected tok/s measurement (generation-only), and a code-copy button.
More from Infra
- Viral space datacenter story called clickbait: quote is about launch costs, up to 100x Earth build cost — ns123abc · 2026-11-02
- Five-year compute map: NVIDIA holds 93% of GPU units, custom ASICs to pass GPUs by 2027 — pdamodaran · 2026-11-02
- Space datacenter heat is just engineering; cosmic rays are the real challenge — shashib · 2026-11-02
- Louisiana's $300B+ project pipeline includes Meta Hyperion, Amazon and Hut 8 AI data centers — MatthewChang · 2026-11-02
- AI data centers destroy 250,000 trees, undercutting 'paperless' eco promises — im_mansigupta · 2026-11-02
- "Someone must solve the cost of serving coworking agents" — hyhieu226 · 2026-11-02