Qwen3.5 9B runs fully local on a phone: reasoning, code execution, and PDF generation on-device
fuzhongkai · reddit · 2026-09-05
A developer demos a fully on-device AI agent running Qwen3.5 9B IQ4XS via TensorSharp, his open-source GGUF inference runtime. Given a prompt like 'get today's top 10 gaining stocks,' the local agent reasons, generates and executes Python code on the phone, then autonomously discovers a Skill, reads its SKILL.md, and produces a PDF — no hardcoded workflow. Prompts, history, and local files never leave the device; network is used only for public data. He opens the question of whether 7B–12B quantized models plus mobile memory bandwidth are enough for useful autonomous workflows.
More from coding & agent
- 105 Real Bugs Tested: GPT-6.1 Sol Over 10x Cheaper Than GPT-5.6 Sol — PawelHuryn · 2026-10-23
- Dev builds SkiFree-style sled game in one prompt, praises DeepSeek Flash — victormustar · 2026-10-23
- Every ditched personal agents for a shared Claude Managed Agents coworker in one week — every · 2026-10-23
- WorkOS shows how to let AI agents safely sign up for your app with auth.md and ID-JAG — AI Engineer · 2026-10-23
- Devs on Reddit swap tactics for stopping prompt regressions in AI agents — SleepFlimsy6963 · 2026-10-23
- Claude Code + ComfyUI MCP workflow for client work: paid models or open weights? — newaccount47 · 2026-10-23