Running local LLMs on 4x RTX 6000s: six genuinely useful workflows
prestodigitarium · reddit · 2026-11-09
A Redditor shares concrete use cases for local models, running DeepSeek 4.1 Flash 1017 via Fraser Price's BRRR setup on 4x RTX 6000 Blackwells (550 tps at c=1, thousands at c=16). Workflows include: "Scouts" (frontier models delegate trivial web research to local agents to save tokens), "Masons" (frontier models spec small code pieces that the local model builds), Hermes agents filtering Hacker News/YouTube news, an events crawler emailing family a weekly Top 10, a personal assistant summarizing terminal/browser activity each morning, and near-instant local speech-to-text. He admits he's still the bottleneck and is experimenting with a "software factory."
More from coding & agent
- Day 21 of an agent a day: a TPP monitor agent for drug discovery, sample prompt included — nlarusstone · 2026-11-09
- Applying the bitter lesson to my LLM workflow: skip agents, just talk to the model — esrtweet · 2026-11-09
- Apple engineers' recap for local AI builders: skip AFM for coding, one-line model swapping — rxwei · 2026-11-09
- copy-clip: a copy button that folds your code into paper and clips it, built with vanilla JS — prasenx · 2026-11-09
- Dev finds sanity in talking to just one agent, one chat at a time — teodorio · 2026-11-09
- Relevant Isn't Authoritative: Why Agents Retrieve Right Docs and Still Decide Wrong — krishnan · 2026-11-09