TensorFold bonds dual Thunderbolt 5 links for 83% throughput boost on Apple Silicon
AIFlow_ML · x · 2026-10-06
TensorFold, the open-source project serving LLMs on Apple Silicon and NVIDIA GPUs via an OpenAI-compatible API, added MCDMA support that bonds paired Thunderbolt 5 connections between two Macs, delivering an 83% throughput uplift for Tensor and Pipeline parallelism.
- Exposes OpenAI chat completions/responses and Anthropic Messages endpoints
- Easy install via pip or Homebrew (brew install ashhart/tensorfold/tensorfold)
- Verified on a pair of Apple M5 Ultra Studios
A practical option for developers running local, multi-machine inference.
More from coding & agent
- Cloudflare launches cf, an agent-first CLI to query observability data via the API — dinasaur_404 · 2026-10-06
- celld: Self-Hosted Cloudflare Workers-Style Runtime With a Cell per AI Agent — letandrewcook · 2026-10-06
- 9 Prompt Rules Cut Agent Thinking Up to 29% With Zero Task Loss, Across 664 Runs — PilgrimofHaqq2 · 2026-10-06
- Low Effort Can Burn More Tokens: Qwen3.8-27B-pi Fine-Tunes Coding Agent Effort Ordering — lmoroney · 2026-10-06
- Building a local LLM agent stack on a 128GB Mac Studio: Reddit thread weighs inference layer options — DrainBramage · 2026-10-06
- Yacine's 90-Minute Chat With a1zhang: Why Harnesses Boost LLM Generalization — yacinelearning · 2026-10-06