ZML launches a free inference server for open-source LLMs across Nvidia, AMD, TPU and more
emmanuelvivier · x · 2026-07-29
French startup ZML has launched a free inference server, ZML/LLMD, that speeds up open-source LLMs across many different chips, including Nvidia, AMD, Google TPU, Apple Metal, and Intel Arc.
The company says its goal is to break chip silos and deliver peak performance regardless of hardware, reducing vendor lock-in at inference time. Founder Steeve Morin argues that inference is becoming more important than training and is still burdened by software and architecture fragmentation.
The thread also mentions SambaNova’s reported $1 billion Series F at an $11 billion valuation, underscoring how aggressively infrastructure players are still being funded.
Related event: ZML Releases Free Inference Server Across Multiple AI Chips(3 posts)→
More from Venture
- Paid SaaS Tools Getting Open-Source Clones: Adobe, Beehiiv Cloned, What's Left? — matchaman11 · 2026-10-16
- Polymarket odds of Tesla shipping Optimus this year jump 5 points to 12% after flying Roadster reveal — Polymarket · 2026-10-16
- Vibe-coded iOS photo cleaner hits 4K downloads, $235 revenue with zero ads via Reddit — PrajwalTomar_ · 2026-10-16
- Seedance 2.5 Pricing Varies Up to 3-4x Across Providers — videorouter · 2026-10-16
- Meta's commitments jumped to $349B in a quarter as server memory prices tripled ahead of Oct 21 earnings — tengyanAI · 2026-10-16
- IT services firm floats a data-pipeline/MCP service line for SMB clients stuck behind bad APIs — Tiggels · 2026-10-16