On-device Android agent with Gemma 4 E2B hits 2.6 tok/s live vs 11 tok/s on replay

HowDevelop · x · 2026-09-07

Developer HowDevelop is building an on-device Android agent using Gemma 4 E2B with Qualcomm QMX kernels. Side note: he spent 5+ hours debugging with GPT-6 Astra on medium, burning 40% of his usage without a confirmed root cause.

The key puzzle: the live agent runs at 2.6 tok/s, while replaying the same request hits 11 tok/s—the gap is unexplained so far.

Related event: Developer Tests On-Device Android Agent with Gemma 4 E2B(2 posts)→

Original post →

More from coding & agent

coding & agent channel →