Agro: Building a fully local on-device agent with 4B models
Adventurous_Onion189 · reddit · 2026-08-30
The author introduces Agro, an open-source, fully local LLM and autonomous agent client built on Kotlin Multiplatform and LiteRT-LM runtime. It runs 4B models like Gemma and Ministral across mobile and desktop. The author discusses the harsh realities of on-device agents, including thermal throttling, RAM limits, and slow generation, and seeks advice on architectural directions to make them genuinely useful despite these constraints.
More from coding & agent
- Simon Willison: code mode is the future of tool calling, if it can be sandboxed — springrod · 2026-10-16
- Agent named 'Ilya' reportedly scores 1.1pt higher on benchmarks — daniel_mac8 · 2026-10-16
- Gemini CLI fix: substring matching inlined unrequested binary files into model context — priyanshu1976 · 2026-10-16
- Building AI agents on real healthcare claims data: the domain work that makes them work — alex_verem · 2026-10-16
- OpenAI stealth-testing mysterious internal model 'Aeon' in Codex desktop app and Dots — cedric_chee · 2026-10-16
- Vibe-coded iPhone Duo sniping bot built with Codex in 17 minutes, 41 tests passing — xiaohu · 2026-10-16