Qwen3.5 9B runs fully local on a phone: reasoning, code execution, and PDF generation on-device
fuzhongkai · reddit · 2026-09-05
A developer demos a fully on-device AI agent running Qwen3.5 9B IQ4XS via TensorSharp, his open-source GGUF inference runtime. Given a prompt like 'get today's top 10 gaining stocks,' the local agent reasons, generates and executes Python code on the phone, then autonomously discovers a Skill, reads its SKILL.md, and produces a PDF — no hardcoded workflow. Prompts, history, and local files never leave the device; network is used only for public data. He opens the question of whether 7B–12B quantized models plus mobile memory bandwidth are enough for useful autonomous workflows.
More from coding & agent
- Dev builds Diablo-inspired browser ARPG Evergrow with Astra, open-sources playable prototype — Dimillian · 2026-09-06
- Astra vs Fable in practice: one just does it right, one has better design sense — weswinder · 2026-09-06
- The 4 layers of an agent system: failures are often architecture problems, not prompting problems — blaizedsouza · 2026-09-06
- OpenCUA author: the 450-step Paint demo we rejected 2 years ago is now doable by agents — andersonbcdefg · 2026-09-06
- One-line prompt: agent formats a messy Google Doc in 45 seconds — vaibhavbetter · 2026-09-06
- Codex Astra adds cross-context note persistence to fight context bloat in long tasks — dair_ai · 2026-09-06