vLLM team launches Inferact, powers new HUMAIN-M3 Arabic frontier model's inference
woosuk_k · x · 2026-09-04
The core vLLM team has unveiled their new company Inferact, focused on the hardest problems in AI inference: optimizing token quality with model vendors and deployment for sovereign AI partners, claiming large throughput gains even under strict constraints. First public win: HUMAIN-M3, a frontier Arabic model from HUMAIN and MiniMax, runs on vLLM under the hood and is live on HUMAIN Node. The team is hiring and open to compute partnerships.
More from Infra
- PostgreSQL 19 slips to November as LLM-assisted code review floods committers with edge cases — sanjaykalra · 2026-10-21
- Decision Models' routing classifier hits AntSeed, cutting inference cost to 24% of always-Opus — airesearch12 · 2026-10-21
- Eon cuts engineer onboarding from 2 days to 2 minutes with an MCP Gateway on Bedrock AgentCore — AWS ML Blog · 2026-10-20
- a16z's Ben Horowitz says AI buildout isn't the 90s bubble — an investor pushes back — henloitsjoyce · 2026-10-20
- Micron and Nvidia drive ~36% of S&P 500's Q3 earnings growth — Beth_Kindig · 2026-10-20
- NVIDIA lands in Europe: Jensen Huang and German chancellor discuss industrial AI at GTC Berlin — nvidia · 2026-10-20