YC-backed Prism launches agent-optimized inference cloud, serving DeepSeek V4.1 Flash at 547 tok/s
ycombinator · x · 2026-09-25
YC-backed startup Prism launched an inference cloud for open-source LLMs that uses agents to optimize deployments for cost, latency and throughput.
- Serves DeepSeek-V4.1-Flash (552B MoE, 1M context), GLM-5.3, Kimi K3, Qwen3.8 (2.4T MoE, 95B active) and more via OpenAI- and Anthropic-compatible APIs
- Claims up to 547 tok/s on DeepSeek V4.1 Flash via its Prism Engine, up to 5.8x faster than major providers
- Positioned as serverless inference aimed at agent workloads
More from Infra
- UK Sovereign AI invests in Fractile to build next-gen frontier AI chips — charlieharris01 · 2026-11-11
- What happened when I moved vector retrieval into Snowflake SQL instead of orchestrating RAG outside — dima806_dima · 2026-11-11
- AI chip startup Fractile raises $720M Series C for DRAM-on-processor design — Tom_Westgarth15 · 2026-11-11
- Mobile AI Factory: agentic pipeline builds on-device SLMs that beat 5-shot frontier models — kalyan_kpl · 2026-11-11
- Vivo's Starlink direct-to-cell service hits 10M users in two weeks across Brazil — XFreeze · 2026-11-11
- Nan Ya Plastics to spend NT$11.53B on fifth glass fabric plant on AI server demand — zephyr_z9 · 2026-11-11