SGLang Supports Inkling-Small on Dual DGX Spark, Hits 24 tok/s
ying11231 · x · 2026-08-01
SGLang has officially announced support for running Inkling-Small across 2× NVIDIA DGX Spark systems connected via ConnectX-7.
This setup enables strong agentic capabilities on a compact local hardware platform. The current configuration achieves a generation speed of 24 tok/s (concurrency=1) without utilizing MTP.
Related event: SGLang Enables Dual-Node Local Execution of Inkling-Small(2 posts)→
More from coding & agent
- DeepMind turns coding agent Antigravity into a science tool, surfacing novel antimicrobial peptide in one session — pushmeet · 2026-10-16
- Cross-review coding workflow: Claude writes the plan, Codex audits it — theteknosaur · 2026-10-16
- Simon Willison: code mode is the future of tool calling, if it can be sandboxed — springrod · 2026-10-16
- Normalizing Claude's schema-free MCP output before it hits downstream n8n nodes — snowingbol · 2026-10-16
- Agent named 'Ilya' reportedly scores 1.1pt higher on benchmarks — daniel_mac8 · 2026-10-16
- A plain notes.md fixed my agent's cross-session amnesia better than chat history — rahul_watertech · 2026-10-16