Agro: Building a fully local on-device agent with 4B models
Adventurous_Onion189 · reddit · 2026-08-30
The author introduces Agro, an open-source, fully local LLM and autonomous agent client built on Kotlin Multiplatform and LiteRT-LM runtime. It runs 4B models like Gemma and Ministral across mobile and desktop. The author discusses the harsh realities of on-device agents, including thermal throttling, RAM limits, and slow generation, and seeks advice on architectural directions to make them genuinely useful despite these constraints.
More from coding & agent
- Dissecting 9 Company Brains: All AI Agents Just Do These 4 Steps — garrytan · 2026-08-30
- Developer refines AI Agency Operator setup over weekend — oykun · 2026-08-30
- How to SSH directly into ChatGPT work VMs for file transfers — TheZachMueller · 2026-08-30
- Engineering Case: Cost-Sensitive Decision Matrix for CI Diagnosis Agent — No-Cheetah-4745 · 2026-08-30
- dots3-note tested on wedding coordination: replanning under shifting constraints — SarahAnnabels · 2026-08-30
- Combining Astra and Fable 5,1 claims to automate complex long-running tasks — bindureddy · 2026-08-30