DeepSeek-V4-Flash Broken on AMD MI325X? User Reports Tool Call Chaos
Brunofcsampaio · reddit · 2026-08-07
Reddit user Brunofcsampaio reports severe issues running DeepSeek-V4-Flash-0731 with vLLM on AMD MI325X. The model loads but behaves erratically: repeatedly claims tool use, outputs DSML tool calls as plain text, claims successful operations that fail, calls nonexistent tools, generates PDF but says PNG, etc. The user suspects issues with chat template/encoding/tool-call integration or ROCm vLLM implementation.
More from Infra
- Amazon Proposes Per-Request Validated Evidence Caching for Production RAG — _reachsumit · 2026-10-16
- LinkedIn's TransX report: sequence transduction for recsys, +6.02% CTR in A/B tests — _reachsumit · 2026-10-16
- llama.cpp PR boosts CPU inference speed with merged AVX2 tiled accumulators — jacek2023 · 2026-10-16
- Zero's next-gen IVM engine runs in a single DO, live-querying a 100GiB R2 database — threepointone · 2026-10-16
- Meme: driving to the chip factory in 2028 captures AI's compute anxiety — beffjezos · 2026-10-16
- One volunteer maintains the time zone file behind 4 billion phones — danbri · 2026-10-16