DeepSeek V4 Pro parsing bug said to hit ~60% of OpenRouter providers; fix upstreamed to sglang
michellechen · x · 2026-09-17
Engineer Kevin Flansburg reports a common set of DeepSeek V4 Pro output-parsing issues affecting 60% of providers listed on OpenRouter: streaming tool-call parsing can corrupt function.arguments when partial non-string parameters change serialization shape, causing byte-slicing to drop data. The fix, buffering complete DeepSeek DSML invokes, has been submitted as sglang PR #39632, with the team arguing OSS inference businesses should upstream quality fixes so enterprises can trust open models. Provider-impact figure is unverified.
More from Infra
- Palmer Luckey asks: can you use datacenter RAM for things prohibited by the operator's terms of service? — avaitopiper · 2026-11-02
- Disable MTP for 20-30% faster local LLM inference on limited RAM — InternalMode8159 · 2026-11-02
- Kioxia up 216% in a year but down 68% from its June 2026 peak — zephyr_z9 · 2026-11-02
- Intel plunges 29%, worst day since the 1970s, wiping $12B off US government stake — emmanuelvivier · 2026-11-02
- Researcher hoards nearly 1TB of DRAM, refuses to sell a stick to data centers — kevinnbass · 2026-11-02
- Self-Hosting LLMs at a Law Firm: Infra and Data Governance Harder Than the Model — EducationalGroup7245 · 2026-11-02