DeepSeek V4 Pro parsing bug said to hit ~60% of OpenRouter providers; fix upstreamed to sglang
michellechen · x · 2026-09-17
Engineer Kevin Flansburg reports a common set of DeepSeek V4 Pro output-parsing issues affecting 60% of providers listed on OpenRouter: streaming tool-call parsing can corrupt function.arguments when partial non-string parameters change serialization shape, causing byte-slicing to drop data. The fix, buffering complete DeepSeek DSML invokes, has been submitted as sglang PR #39632, with the team arguing OSS inference businesses should upstream quality fixes so enterprises can trust open models. Provider-impact figure is unverified.
More from Infra
- Ciena sets 3-year targets: ~30% annual revenue growth, ~50% gross margin as quiet AI winner — kevinsxu · 2026-09-17
- If compute demand outpaces supply, distributed general-purpose computing could win — gajesh · 2026-09-17
- Framework Desktop with 128GB unified memory: Qwen 27B-35B beats bigger local models — lebbi · 2026-09-17
- Alchemy ships official coding-agent prompt for its TypeScript IaC tool — samgoodwin89 · 2026-09-17
- Close-up of Ayar Labs optical interconnect solution on GPU tray — BenBajarin · 2026-09-17
- Apple reportedly building enterprise AI server with its own M8 Ultra chips, launching no earlier than 2029 — The Decoder · 2026-09-17