SGLang Supports Inkling-Small on Dual DGX Spark, Hits 24 tok/s
ying11231 · x · 2026-08-01
SGLang has officially announced support for running Inkling-Small across 2× NVIDIA DGX Spark systems connected via ConnectX-7.
This setup enables strong agentic capabilities on a compact local hardware platform. The current configuration achieves a generation speed of 24 tok/s (concurrency=1) without utilizing MTP.
More from coding & agent
- Developers Share Custom Settings and Shortcuts for Codex Micro — dkundel · 2026-08-01
- AI Agents to Take Over Quant Trading: Developer Shares Vision — doodlestein · 2026-08-01
- Tested: Using LLM Agents to Autonomously Discover RCEs in Open Source Libraries — rez0__ · 2026-08-01
- Grok Build v0.2.118 Update Adds Permanent Session Deletion and Smart Diagnostics — Kyrannio · 2026-08-01
- Single Prompt Generates Multiplayer Game: Claude 3.5 Sonnet Agent Test — TAbrodi · 2026-08-01
- Engineering AI Agent Loops: Master Unattended Workflows in 30 Mins — Saboo_Shubham_ · 2026-08-01