Setting up a DGX Spark local inference cluster with 5 role-based Hermes agents
natesiggard · x · 2026-09-25
The author spent day one setting up DGX Spark and a local inference cluster, installing Hermes plus Actual (private local AI inference) on 5 machines, each with its own identity.
- A "family office" model: each Hermes agent got a distinct role, boundaries, and an inference preference cascade
- The agents built their own coordination webapp hosted on Cloudflare
- Actual installs with one curl command, supports macOS/Linux/Windows, pools idle machines' compute over an encrypted relay, and runs open models privately on your own hardware
More from coding & agent
- LangSmith adds Trajectories, making long agent runs easier to analyze — LangChain · 2026-09-25
- Broken windows theory is 100% real in vibe-coded codebases — generativist · 2026-09-25
- Non-engineer shares multi-model agent setup: isolated Docker supervisor gates scope drift — alexcovo_eth · 2026-09-25
- Primus Society runs a society of autonomous AI researchers, claims 30% training boost — JayAlammar · 2026-09-25
- Gauntlet AI Opens Free 10-Week, Fully Funded AI Engineering Fellowship in Austin — petrusenko_max · 2026-09-25
- GitHub Security Lab open-sources an AI fuzzing pipeline that writes and tunes its own harnesses — GitHub Blog AI/ML · 2026-09-25