DeepSeek-V4-Flash Broken on AMD MI325X? User Reports Tool Call Chaos

Brunofcsampaio · reddit · 2026-08-07

Reddit user Brunofcsampaio reports severe issues running DeepSeek-V4-Flash-0731 with vLLM on AMD MI325X. The model loads but behaves erratically: repeatedly claims tool use, outputs DSML tool calls as plain text, claims successful operations that fail, calls nonexistent tools, generates PDF but says PNG, etc. The user suspects issues with chat template/encoding/tool-call integration or ROCm vLLM implementation.

Original post →

More from Infra

Infra channel →