Qwen 35B Successfully Runs on a Smartphone
Severe_Post_2751 · reddit · 2026-07-18
The author tested a proprietary Qwen 35B MoE runtime on a Samsung S26 Ultra, claiming that without sacrificing accuracy, the activated model footprint fits within the device's memory constraints.
Early results show that after optimization, input processing is about 90 tokens/s, while output generation is around 8 tokens/s. The author emphasizes they are self-taught in AI/ML without a formal PhD, mentions having compute resources to continue testing, and invites collaboration. They also noted having submitted 4 arXiv papers, which are still under review due to a lack of institutional affiliation.
More from Infra
- Spomin: live KV cache compaction squeezes 500k tokens of context into 180k resident — wgaca2 · 2026-09-11
- PiPNN nearest-neighbor search wins three awards, up to 78x faster index building — khademinori · 2026-09-11
- M.2-Oculink eGPU Link Silently Downgrades to PCIe Gen1 — Here's How to Check — El_90 · 2026-09-11
- DeepSeek launches V4.1-Flash with 1M-token context and 4x smaller KV-cache — matlabulous · 2026-09-11
- What Can You Still Run on 8GB VRAM? User Asks for Small Models With Tool Use — riceinmybelly · 2026-09-11
- Spain's hourly 80% renewable matching rules clash as France fast-tracks 700MW sites, UK cuts grid queues — eherrerosj · 2026-09-11