Help: DSH model running out of output tokens

Ed-2-Zero-9 · reddit · 2026-08-27

A developer running the DSH model via Unsloth is encountering an 'out of output tokens' issue, despite maxing out the settings in both DSH and Unsloth. The user asks whether to continue tweaking the Unsloth setup or switch to a different inference engine that supports load balancing for gfx120x architecture (R9700 and 9070 XT).

Original post →

More from Infra

Infra channel →