Gemma Models Loop Infinitely When Asked to Output JSON, User Reports

Aggravating-Push-207 · reddit · 2026-09-21

A user reports that Gemma 26B A4B and 31B, via the official API, both get stuck in infinite loops when asked to produce JSON, while prose generation works fine. They're seeking API-side workarounds — a notable pitfall for anyone relying on structured output.

Original post →

More from coding & agent

coding & agent channel →