Running an 8-agent research swarm on a local 40B model with a 48GB M4 Pro
cong_ml · x · 2026-10-27
A demo of a fully local research agent swarm on a Mac: eight agents share one local 40B Flint model in llama.cpp on a 48GB M4 Pro, writing code, testing ideas and building on what works. The thread details batched inference, shared best-program collaboration, prompt variety, and a 2.3x speedup in valid experiments.
More from coding & agent
- figwig file format ships a Kaitai spec to generate readers/writers in any language — jmschreiber91 · 2026-10-28
- Five principles for curating LLM agent evals: diverse, realistic, hard, discriminative, high-quality — cwolferesearch · 2026-10-28
- figwig ships formal Kaitai Struct spec, auto-generate readers/writers in any language — jmschreiber91 · 2026-10-28
- Designers argue personal agents must build user-fitting into the product, not leave it as a switch — sujingshen · 2026-10-28
- Nous Research Revamps Hermes Agent Plans: Cloud Agent Included, Daily/Weekly Limits Replace Monthly Credits — NousResearch · 2026-10-28
- Claude Code can now edit videos and cut TikTok-ready clips — 8 prompts to try — aitrendz_xyz · 2026-10-28