Deploying DeepSeek-V4 on Blackwell: Fixing 3 critical SGLang bugs
shrug_hellifino · reddit · 2026-09-02
The author shared their experience running DeepSeek-V4-Flash-Vision-Exp via SGLang on dual RTX PRO 6000 Blackwell (SM120) cards, successfully handling a 269k-token context. They resolved three critical issues: SM120 sparse-MLA Vision prefill crashes (fixed by adding capability checks and falling back to Triton), a CUDA OOM in the indexer caused by 269k context (resolved via row slicing and chunking to bound memory), and a bug where Vision preview corrupted multi-turn tool-call history.
More from coding & agent
- Open-Source Screenshot Intent Classifier: Detecting When Users Want the LLM to See Their Screen — TheMoonMidas · 2026-09-02
- Ethan Mollick: Agents Now Capable of Long-Running Self-Organized Work — emollick · 2026-09-02
- A PR adds AutoModel support so Perplexity's PII masking model loads via plain transformers — tomaarsen · 2026-09-02
- How to build an autonomous agent to drive legacy ERP systems — atuclose · 2026-09-02
- Swarms v15 'Akira' Released: Dynamic Tool Loading and MCP 2.x Support — KyeGomezB · 2026-09-02
- Dev Uses GPT 5.6 with Blender MCP to Animate 3D Tennis Game — chongdashu · 2026-09-02