Free Qwen3.8-Flash-Next endpoint launched on 4× H200 at 100+ tok/s
victormustar · x · 2026-08-26
Developer victormustar deployed a free public endpoint for Qwen3.8-Flash-Next, requiring no API tokens. It is OpenAI-compatible, supports vision, tool calls, and 262K context. Powered by 4× H200 GPUs (FP8) via SGLang, it achieves 140 tok/s per stream (100 tok/s @ 16 concurrent) with 0.8s TTFT.
More from Infra
- ASML CFO says US Match Act restricting DUV sales to China would backfire — pstAsiatech · 2026-10-15
- Bloomberg breakdown: a 1GW Texas AI data center may need nearly $3B for overruns alone — rohanpaul_ai · 2026-10-15
- 7 System Design Algorithms to Know: Merkle Trees to CAP/PACELC — goyalshaliniuk · 2026-10-15
- MiniCPM-V 4.7 runs a 35B MoE multimodal model on phones with just 3GB memory — nevrekaraishwa2 · 2026-10-15
- Sipeed MaixStation product page goes live for edge AI dev — xlltt · 2026-10-15
- Nvidia Is Now Worth More Than the Entire Indian Stock Market — theteknosaur · 2026-10-15