Running Hermes Locally on Android
Dismal-Effect-1914 · reddit · 2026-07-16
The author demonstrates running Hermes within the native Debian Terminal on Graphene OS. The setup pairs the phone with a remote Hermes gateway backend powered by Llama.cpp and Qwen 3.6 35B.
They also combined a mobile 5070 Ti and an RTX 3090 eGPU via TB5, providing roughly 34GB of VRAM. Performance metrics include prompt processing at 2500 tps and generation at 80–150 tps (with mtp).
The author emphasizes this is a "snappy, 100% local" solution and praises the Hermes GUI's mobile display. They also note that while the Razer Core X V2 works on Windows 11, it couldn't be configured on Linux.
More from Embodied
- Tesla expands Robotaxi rides to seven areas, including new Orlando and Tampa zones — elonmusk · 2026-07-22
- Hands-on robotics workshop on Saturday may be the last in-person session before August — StewartalsopIII · 2026-07-22
- NVIDIA pitches World Foundation Models as a way to scale physical AI data generation — MonaJalal_ · 2026-07-22
- RoboMME Podcast Preview: Benchmarking Memory for Robotic Policies — chris_j_paxton · 2026-07-21
- Gritt says an 8-person crew now installs 3,000 to 4,000 solar panels a day — HaktanSuren · 2026-07-21
- A helium-powered flying robot whale aims to be a quiet companion pet — chris_j_paxton · 2026-07-21