A 9-machine local AI homelab: 5 agents on one dual-3090 llama-server

StandardLovers · reddit · 2026-11-23

A Redditor showcased a fully local AI homelab: 9 machines including a dual-RTX-3090 inference rig (48GB VRAM, llama.cpp with NCCL) serving five agents — two personal assistants, IDE and CLI coding agents, and a family agent — on Qwen 27B Q8 with 256k context and 2000 tok/s prefill. Highlights: a kernel module firmware-patching the 3090s' FP16/BF16 FMA issue rate (+10% at long context), Tailscale mesh, hardened firewalls, 3-2-1 backups, and 12 cron automation jobs. Everything is green; the author is soliciting new ideas.

Original post →

More from coding & agent

coding & agent channel →