SGLang ships Day-0 support for Inkling 2 Small: 576 tok/s per user on Vera Rubin
LiTianleli · x · 2026-11-13
SGLang announced Day-0 support for Inkling 2 Small, which brings stronger agentic coding, vision, and knowledge work on the same efficient backbone. Key numbers: 576 tok/s per user at batch 1 on NVIDIA Vera Rubin, 123 tok/s at batch 192, and text-plus-vision RL fine-tuning with Miles on just 8 Blackwell GPUs. Supported hardware spans Vera Rubin, Blackwell, Hopper, AMD MI350X/MI355X, and Google TPU v7x.
More from Infra
- Cerebras Q3: cloud revenue up 272%, 700MW data center capacity under contract — Sethwinterroth · 2026-11-13
- Critic faults chip export-control research: ByteDance lines up 36,000 B200s in Malaysia — nitarshan · 2026-11-13
- Tracked GPU acquisition likened to SR-71's Soviet titanium, sourced via hundreds of willing neoclouds — bookwormengr · 2026-11-13
- DynaDFlash: diffusion drafter boosts speculative decoding acceptance length by 5% — charles_irl · 2026-11-13
- Report: Nvidia planning frontier-class open models, sources claim — StewartalsopIII · 2026-11-13
- Celesto CI runs GitHub Actions on microVMs for ~90% less per minute — aniketmaurya · 2026-11-13