ZML launches a free inference server to run LLMs across Nvidia, AMD, TPU and more
emmanuelvivier · x · 2026-07-28
French startup ZML has released LLMD, a free inference server designed to run open-source LLMs across multiple chip families, including Nvidia, AMD, Google TPU, Apple Metal, and Intel Arc.
The company says the goal is to break hardware silos, reduce vendor lock-in, and let models run at peak speed on whichever chips are available. TechCrunch frames the launch as part of the growing push to optimize inference rather than training as AI usage scales.
Related event: ZML Releases Free Inference Server Across Multiple AI Chips(3 posts)→
More from Companies & People
- a16z podcast: AI cut a 6-month feature to 10 days and widened engineer gaps 10x — a16z · 2026-10-16
- Polymarket opens Vatican-Anthropic meeting bet at 36% odds by year-end — Polymarket · 2026-10-16
- Cohere Labs to present confidence estimation for reasoning models at EMNLP 2026 — Cohere_Labs · 2026-10-16
- Paid SaaS Tools Getting Open-Source Clones: Adobe, Beehiiv Cloned, What's Left? — matchaman11 · 2026-10-16
- Figma's Chrome Extension Now Captures Live Website Code; 25,000+ Paid Seats — aakashgupta · 2026-10-16
- Engineering Leader: AI Got Me Coding Again — I Built Our Feature-Flag System With an Agent — rseroter · 2026-10-16